Retrieve element from a screenshot using Vision RPA
Retrieve the coordinates of an element using the element description or a reference image within a given screenshot.Outcomes: Success or no resultThis Wrk Action uses AI-generated content. Like all AI content, use with caution; information may be outdated, incomplete, or inaccurate.
Application
Inputs (what you have)
| Name | Description | Data Type | Required? | Example |
|---|
| Screenshot | Screenshot to search for the element in | File | Yes | |
| Selection type | The method used to identify the element you want to check for | Predefined Choice List | Yes | Element description |
| Search section | The section of the visible screen to search for the element in. | Predefined Choice List | No | |
| Bypass element validation? | This Wrk Action will always validate element reference image or element description match with what was found using AI. Set to true to bypass validation | True/False | No | |
Outputs (what you get)
| Name | Description | Data Type | Required? | Example |
|---|
| Search image | Screenshot of the visible screen with the searched section highlighted in a green box and the found element in a red box | File | No | |
| Found element coordinates | Coordinates of the found element within the visible screen | Text (Short) | No | [0, 0, 0, 0] |
| Match percentage | If reference image provided, the percentage match of the selected element in comparison to the provided reference image | Number with decimals | No | 95.1 |
Outcomes
| Name | Description |
|---|
| Success | This status is selected if the job has successfully completed. |
| No result | This status is selected if the job has successfully completed but no result was produced. |
Requirements