Machine vision
Studio Pro activities > GUI Automation > Machine vision. Includes "Click on image", "Find image", "Take a screenshot" and "Wait for image".
Activities
| Click on image | Find image |
|---|---|
| Find an image on the screen and click on it | Find an image on the screen and get its coordinate |
| Take a screenshot | Wait for image |
| Capture the image of the entire screen | Define a time limit to wait for a specific image to appear on the screen |
Click on image
Description
Finds an image on the screen and clicks on it. In practice, this activity is most often used as an alternative to such activities as Click on element or Click on coordinate, in both browser and desktop applications.
Parameters
Image parameters
Create image from screenshot allows you to take a screenshot and crop it to an image.
Screenshots are saved at "C:\Users\<Username>\ElectroNeek\screenshots" by default.
Image path
- Set a value: set the path to an image.
- Save the previous step result: takes the previous activity result as a value.
- Calculate a value: use JS to calculate the value.
Image index
In case of multiple matches are found, only one of these matches should be used to perform a click. 0 is set by default, meaning the robot will click on the first found match.
- Set a value: set the index value.
- Save the previous step result: take the previous activity result as a value.
- Calculate a value: use JS to calculate the value.
Search parameters
Accuracy, %
Sets the accuracy of the search. If the value is 100%, the robot will search for an exact match.
Search inside specific interface element
Search the image in bounds of selected element.
Right click
Simulates a right click.
Double click
Simulates a double click.
Comment
Contains an annotation to the activity. The input text will be displayed above the activity name.
Usage Examples
This activity is useful in cases when it's not possible to use selectors or coordinates to perform a click.
Note
This activity only works on one computer screen. If you have multiple screens, the activity will only work on the first (main) screen.
Find image
Description
Finds an image on the screen and returns it's coordinates.
In practice, this activity is most often used as an alternative to the "Element found?" activity, for both browser and desktop applications.
Note
This activity only works on one computer screen. If you have multiple screens, the activity will only work on the first (main) screen.
Parameters
Image parameters
Create image from screenshot - allows you to take a screenshot and crop it to an image.
Screenshots are saved at C:\Users\<Username>\ElectroNeek\screenshots by default.
Image path
- Set a value: set the path to an image.
- Save the previous step result: takes the previous activity result as a value.
- Calculate a value: use JS to calculate the value.
Search parameters
Accuracy, %
Sets the accuracy of the search. If the value is set to 100%, the robot will search for an exact match.
Search inside specific interface element
Select an element from a list or create new one.
Comment
Contains an annotation to the activity. The input text will be displayed above the activity name.
Result
The found images are stored in the found_images variable by default. The variable represents an array of key-value pairs object where one object corresponds to one image. One object contains the following keys and values
Keys and values of an object:
{
"x": "x coordinate of the image top left corner",
"y": "y coordinate of the image top left corner",
"width": "the image width",
"height": "the image height"
}
Take a screenshot
Description
Saves the entire screen or the active window in a screenshot file.
Note
This activity only works on one computer screen. If you have multiple screens, the activity will only work on the first (main) screen.
Parameters
Save screenshot to file
Allows you to specify the path to the saved image.
- Set a value: Set a path to the file.
- Save the previous step result: take the previous activity result as a path.
- Calculate a value: use JS to calculate a path.
Screenshot active window
Takes a screenshot of the active window.
Comment
Contains an annotation to the activity. The input text will be displayed above the activity name.
Wait for image
Description
Waits for the specified image to appear on the screen for the specified number of seconds. If the image appears, the "Yes" branch is executed, otherwise the "No" branch is executed.
The activity works the same way when multiple images are found.
In practice, this activity is most often used as an alternative to the "Wait for image" activity, for both browser and desktop applications.
Note
This activity only works on one computer screen. If you have multiple screens, the activity will only work on the first (main) screen.
Parameters
Image parameters
Create image from screenshot
Allows you to take a screenshot and crop it to an image.
Screenshots are saved at C:\Users<Username>\ElectroNeek\screenshots by default.
Image path
- Set a value: set the path to an image.
- Save the previous step result: takes the previous activity result as a value.
- Calculate a value: use JS to calculate the value.
Search parameters
Accuracy, %
Sets the accuracy of the search. If the value is set to 100%, the robot will search for an exact match.
Search inside specific interface element
Select an element from a list or create new one.
Wait before, sec
Allows you to set the delay in seconds before the action is executed.
Wait after, sec
Allows you to set the delay in seconds after the action has been performed.
Comment
Contains an annotation to the activity. The input text will be displayed above the activity name.
Updated about 1 year ago