Find something on screen - Help getting started

[talahaski]

Can anybody help me with this project. I'm not sure how to get started.


I have a simple game window open that displays a number of flags on a map.

I want to build a c# application that will "look" at the screen, find the nearest flag, move the mouse curser to the nearest flag and perform a left-mouse button click. This will action should be repeated until all flags are gone.

I am wondering how to go about this. How do I "look" at the screen and find the location of something.

Any help would be appreciated.

[Calculator]

Implement a genetic algorithm that would submit a sort of brain like 'onlooker' to a 'life experience' so that it might construct a schema for what a flag is. Then you can have it look at the screen and pick out flags pretty easily. This isn't your app that you're going to be clicking is it? Is there any other way you can interface with it rather than just 'looking' at the output?