I really like the feature in Sikuli that allows you to select a screenshot to click and specify where within that screenshot to click. For example when there are multiple buttons that look the same, just taking a screenshot of the button itself won't cut it because Sikuli can't differentiate.
Some other automation tools don't allow you to select where you want the mouse to click within a screenshot, or it is difficult to specify where you want the mouse to click.
So my question is, is there another software tool that has this feature that Sikuli has? The reason I'm looking for something else is because I don't want to rely on image recognition completely. I was hoping to use pywinauto with Sikuli to do some of the automation, but that isn't possible.
There is at least one: eggPlant by TestPlant.
It is an automation tool using image recognition, and
You can search part of the screen by setting the SearchRectangle global property.
References:
http://www.testplant.com
http://docs.testplant.com/ePF/using/epf-finding-images.htm#Working
For Python integration Automa would be nice, and it does have nifty image recognition functions where you can have multiple image parts working together. Not exactly what you are asking but it just might be of use.
References:
http://www.getautoma.com
http://www.getautoma.com/features/image_recognition
The odds are a bit longer but possibly AutoIt can help you as well. It interfaces with the standard Windows GUI objects and has the benefits of being both very stable and quite easy to use. It has a small tool you can use to show the properties of the screen object you want to access. No learning curve to speak of, however no image recognition or real integration to Python either.
Reference:
https://www.autoitscript.com/site/autoit/