objective-c - 试图将鼠标点击发送到游戏窗口，mac

Question

所以我一直在尝试使用 CGPostMouseEvent 和 CGEventPostToPSN 将鼠标点击发送到 mac 游戏，不幸的是一直很不成功。

我希望有人能够帮助我以不同的方式思考这个问题，或者意识到我所缺少的东西。 Google 帮不上什么忙。

我的猜测是，这是因为我试图将点击事件发送到游戏窗口 (openGL)，而不是普通窗口。

这是我尝试发送的另一个例子: CGEventRef CGEvent； NSEvent *自定义事件； NSPoint 位置； 位置.x = 746; 位置.y = 509;

    customEvent = [NSEvent mouseEventWithType: NSLeftMouseDown
                                     location: location
                                modifierFlags: NSLeftMouseDownMask
                                    timestamp: time(NULL)
                                 windowNumber: windowID
                                      context: NULL
                                  eventNumber: 0
                                   clickCount: 1
                                     pressure: 0];

    CGEvent = [customEvent CGEvent];
    CGEventPostToPSN(&psn, CGEvent);

有趣的是，我可以很好地移动鼠标 (CGDisplayMoveCursorToPoint(kCGDirectMainDisplay, clickPt);)，但我无法发送任何点击 :/

如有任何帮助，我们将不胜感激。

编辑:奇怪的是，一旦我使用 CGDisplayMoveCursorToPoint 移动鼠标，实际上我什至必须在物理上上下移动我的鼠标，然后才能单击，这很奇怪。游戏不接受任何输入，除非我向上/向下移动它(然后指针会改变)。

谢谢!

Answer 1

您尝试构建的是“bot”或“robot”，它们基本上以有序的方式向游戏发送命令。基本上它会在你离开时为你播放。这对于强制您玩游戏以收获矿物、商品或任何能给您金钱以在游戏中前进的游戏来说非常有用。这真的很无聊。我已经成功地为一款流行游戏做到了这一点，尽管我不能提及这款游戏，因为它违反了所有这些类型的游戏针对“机器人”的用户协议(protocol)。所以要小心你在做什么，因为它可能会破坏你对许多 MMPG 的用户协议(protocol)。但我在这里成功发布了这个，因为 Mac 可用的机器人较少，我无法研究，而 PC 我发现了很多。所以为了公平竞争......这是代码。我建议将其编译为命令行，并在 AppleScript 中执行宏(逻辑将驻留在如何模仿游戏点击鼠标、移动和发送键，基本上是您的 AI。

1.- 首先你需要运行类来获取所有游戏都有的 psn“进程序列号”。基本上它在什么线程上运行。您可以在 Mac 中名为“事件监视器”的实用程序中找到进程的名称。这也可以在 AppleScript 中轻松完成。一旦你有了名字，这个类就会定位并返回给你它的 psn。

#import <Cocoa/Cocoa.h>
#include <Carbon/Carbon.h>
#include <stdio.h>

@interface gamePSN : NSObject 
{
  ProcessSerialNumber gamePSN;
  ProcessInfoRec gameProcessInfo;
  pid_t gameUnixPID;    
}

- (ProcessSerialNumber) gamePSN;
- (ProcessInfoRec) gameProcessInfo;
- (pid_t) gameUnixPID;  
- (void) getPSN;
@end

@implementation gameSN

- (ProcessSerialNumber) gamePSN  { return gamePSN; }
- (ProcessInfoRec) gameProcessInfo { return gameProcessInfo; }
- (pid_t) gameUnixPID; { return gameUnixPID; }

- (void) getPSN
{
    auto OSErr osErr = noErr;
    auto OSErr otherErr = noErr;
    auto ProcessSerialNumber process;
    auto ProcessInfoRec procInfo;
    auto Str255 procName;     
    auto FSSpec appFSSpec;
    auto char cstrProcName[34];
    auto char one ='G';   // FIRST CHARCTER OF GAME PROCESS NAME THESE NEED TO BE CHANGED AS I PUT IN FAKES
    auto char two ='A';   // SECOND CHARACTER OF GAME PROCESS NAME THESE NEED TO BE CHANGED AS I PUT IN FAKES
    auto char three = 'M';  // THIRD  CHARACTER OF GAME PROCESS NAME THESE NEED TO BE CHANGED AS I PUT IN FAKES
    auto unsigned int size;

    process.highLongOfPSN = kNoProcess;
    process.lowLongOfPSN  = kNoProcess;
    procInfo.processInfoLength = sizeof(ProcessInfoRec);
    procInfo.processName = procName;
    procInfo.processAppSpec = &appFSSpec;

    while (procNotFound != (osErr = GetNextProcess(&process))) {

    if (noErr == (osErr = GetProcessInformation(&process, &procInfo))) {
        size = (unsigned int) procName[0];
        memcpy(cstrProcName, procName + 1, size);
        cstrProcName[size] = '\0';

        // NEEDS TO MATCH THE SIGNATURE OF THE GAME..FIRST THREE LETTERS
        // IF YOU CANT FIND IT WITH THE ACTIVITY MONITOR UTILITY OF APPLE MAC OS
        // THEN RUN THIS SAME CLASS WITH AN NSLOG AND IT WILL LIST ALL YOUR RUNNING PROCESSES.

        if (    (((char *) &procInfo.processSignature)[0]==one) && 
                (((char *) &procInfo.processSignature)[1]==two) && 
                (((char *) &procInfo.processSignature)[2]==three) && 
                (((char *) &procInfo.processSignature)[3]==two))
        {
            gamePSN = process;
            otherErr = GetProcessInformation(&gamePSN, &gameProcessInfo);
            otherErr = GetProcessPID(&process, &gameUnixPID);
        }

        }

    }
}

一旦有了这个进程号，就可以很容易地发送键事件和鼠标事件。这里是鼠标事件点击发送。

//  mouseClicks.h
//  ClickDep
//  Created by AnonymousPlayer on 9/9/11.


#import <Foundation/Foundation.h>

@interface mouseClicks : NSObject

- (void) PostMouseEvent:(CGMouseButton) button eventType:(CGEventType) type fromPoint:(const CGPoint) point;
- (void) LeftClick:(const CGPoint) point; 
- (void) RightClick:(const CGPoint) point;
- (void) doubleLeftClick:(const CGPoint) point;
- (void) doubleRightClick:(const CGPoint) point;

@end

/
//  mouseClicks.m
//  ClickDep
//  Created by AnonymousPlayer on 9/9/11.v


#import "mouseClicks.h"

@implementation mouseClicks

- (id)init
{
    self = [super init];
    if (self) {
        // Initialization code here if you need any.
    }

    return self;
}

- (void) PostMouseEvent:(CGMouseButton) button eventType:(CGEventType) type fromPoint:(const CGPoint) point;
{
    CGEventRef theEvent = CGEventCreateMouseEvent(NULL, type, point, button);
    CGEventSetType(theEvent, type);
    CGEventPost(kCGHIDEventTap, theEvent);
    CFRelease(theEvent);
}

- (void) LeftClick:(const CGPoint) point;
{
    [self PostMouseEvent:kCGMouseButtonLeft eventType:kCGEventMouseMoved fromPoint:point];
    NSLog(@"Click!");
    [self PostMouseEvent:kCGMouseButtonLeft eventType:kCGEventLeftMouseDown fromPoint:point];
    sleep(2);
    [self PostMouseEvent:kCGMouseButtonLeft eventType:kCGEventLeftMouseUp fromPoint:point];
}

- (void) RightClick:(const CGPoint) point; 
{
    [self PostMouseEvent:kCGMouseButtonRight eventType:kCGEventMouseMoved fromPoint:point];
    NSLog(@"Click Right");
    [self PostMouseEvent:kCGMouseButtonRight eventType: kCGEventRightMouseDown fromPoint:point];
    sleep(2);
    [self PostMouseEvent:kCGMouseButtonRight eventType: kCGEventRightMouseUp fromPoint:point];
}

- (void) doubleLeftClick:(const CGPoint) point;
{ 
    [self PostMouseEvent:kCGMouseButtonRight eventType:kCGEventMouseMoved fromPoint:point];
    CGEventRef theEvent = CGEventCreateMouseEvent(NULL, kCGEventLeftMouseDown, point, kCGMouseButtonLeft);  
    CGEventPost(kCGHIDEventTap, theEvent); 
    sleep(2);
    CGEventSetType(theEvent, kCGEventLeftMouseUp); 
    CGEventPost(kCGHIDEventTap, theEvent); 

    CGEventSetIntegerValueField(theEvent, kCGMouseEventClickState, 2);  

    CGEventSetType(theEvent, kCGEventLeftMouseDown);  
    CGEventPost(kCGHIDEventTap, theEvent);  
    sleep(2);
    CGEventSetType(theEvent, kCGEventLeftMouseUp); 
    CGEventPost(kCGHIDEventTap, theEvent); 
    CFRelease(theEvent); 
}

- (void) doubleRightClick:(const CGPoint) point;
{ 
    [self PostMouseEvent:kCGMouseButtonRight eventType:kCGEventMouseMoved fromPoint:point];
    CGEventRef theEvent = CGEventCreateMouseEvent(NULL, kCGEventLeftMouseDown, point, kCGMouseButtonRight);  
    CGEventPost(kCGHIDEventTap, theEvent); 
        sleep(2);
    CGEventSetType(theEvent, kCGEventRightMouseUp); 
    CGEventPost(kCGHIDEventTap, theEvent); 

    CGEventSetIntegerValueField(theEvent, kCGMouseEventClickState, 2);  

    CGEventSetType(theEvent, kCGEventRightMouseDown);  
    CGEventPost(kCGHIDEventTap, theEvent);
        sleep(2);
    CGEventSetType(theEvent, kCGEventRightMouseUp); 
    CGEventPost(kCGHIDEventTap, theEvent); 
    CFRelease(theEvent); 
} 
@end

您可能需要玩一下 sleep ，即按下鼠标按钮和释放鼠标按钮之间的时间间隔。我发现有时使用 1 秒是行不通的。放 2 秒让它一直工作。所以你的主要目标是以下。

int main(int argc, char *argv[])
{
    NSAutoreleasePool *pool    = [[NSAutoreleasePool alloc] init];
    NSUserDefaults *args    = [NSUserDefaults standardUserDefaults];

    // Grabs command line arguments -x, -y, -clicks, -button
    // and 1 for the click count and interval, 0 for button ie left.
    int x        = [args integerForKey:@"x"];
    int y        = [args integerForKey:@"y"];
    int clicks    =    [args integerForKey:@"clicks"];
    int button   =    [args integerForKey:@"button"];
    //int interval=    [args integerForKey:@"interval"];
    int resultcode;

   // PUT DEFAULT VALUES HERE WHEN SENT WITH EMPTY VALUES
    /*if (x==0) {
        x= 1728+66;
        y= 89+80;
        clicks=2;
        button=0;
    }
     */
    // The data structure CGPoint represents a point in a two-dimensional
    // coordinate system.  Here, X and Y distance from upper left, in pixels.
    CGPoint pt;
    pt.x    = x;
    pt.y    = y;



    // Check CGEventPostToPSN Posts a Quartz event into the event stream for a specific application.
    // only added the front lines plus  changed null in Create Events to kCGHIDEventTap

    gamePSN *gameData = [[gamePSN alloc] init];
    [gameData getPSN];
    ProcessSerialNumber psn = [gameData gamePSN]; 
    resultcode = SetFrontProcess(&psn);

    mouseClicks *mouseEvent =[[mouseClicks alloc] init];

    if (button == 0)
    {
        if (clicks==1) {
            [mouseEvent LeftClick:pt];
        } else {
            [mouseEvent doubleLeftClick:pt];
        }
    }   
    if (button == 1)
    {
        if (clicks==1) {
            [mouseEvent RightClick:pt];
        } else {
            [mouseEvent doubleRightClick:pt];
        }
    }   

    [gameData release];
    [mouseEvent release];

    [pool drain];
    return 0;
}

希望这对您有所帮助....记住您可以通过发送以下命令在终端或 AppleScript 中执行此操作。

do shell script "/...Path to Compiled Program.../ClickDep" & " -x " & someX & " -y " & someY & " -clicks 1 -button 1"

游戏愉快!!!!