Search code examples
node.jspyautoguirobotjs

Is there anything similar to PyAutoGUI for NodeJS that can try to locate an image inside a screen capture?

I am trying to code a bot to automate some tasks on a videogame with JS and Node, so far I've been using RobotJS. The problem I'm facing is that I need to find something on the screen as it moves from time to time to then click on it. Something similar to PyAutoGUI locateOnScreen() function.

It needs to use AI to have some tolerance too, as the image will not be exactly the same from time to time, though it's almost the same so I think any basic AI for image recognition would detect it fine.

Does anyone have an idea on what to use for this specific case?

Solution

  • Try this package called node-moving-things-tracker. I have been using it reliably for a while. It is being actively maintained. Data outputs are well-organized and interpretable. There are a few examples here: https://www.npmjs.com/package/node-moving-things-tracker