Click on an element using Vision RPA
Check if an element is visible using the element description, a reference image, or text. This Wrk Action uses AI-generated content. Like all AI content, use with caution; information may be outdated, incomplete, or inaccurate.
Application
- Vision RPA
Inputs (what you have)
| Name | Description | Data Type | Required? | Example |
|---|---|---|---|---|
| Session ID | The unique identifier of the session. Can be retrieved from 'Connect and log in to a VM' or 'Open a browser session' Wrk Action | Text (Short) | Yes | fb9bc380-146c-420e-9130-50ce93614e05 |
| Click type | Type of click to execute on the element | Predefined Choice List | Yes | Left |
| Selection type | The method used to identify the element you want to check for | Predefined Choice List | Yes | Element reference image |
| Click offset | The distance in pixels you would like to offset your click by, based on the identified location. Example: (x, y) | Text (Short) | No | (0,0) |
| Maximum wait duration | The number of seconds to wait for | Number | No | 0 |
| Search section | The section of the visible screen to search for the element in. | Predefined Choice List | No | Whole |
| Wait for screen change | The amount of screen change to wait for before proceeding to the next Wrk Action | Predefined Choice List | No | 5 |
| Wait for the change | The number of seconds you would like to wait after clicking for the change to occur | Number | No | 5 |
| Change detection section | The section of the visible screen to search for the change in. WA should also accept a data library item of coords like [0,1080,0,1920] | Predefined Choice List | No | |
| Bypass element validation? | This Wrk Action will always validate element description match with what was found using AI. Set to true to bypass validation | True/False | No | False |
Outputs (what you get)
| Name | Description | Data Type | Required? | Example |
|---|---|---|---|---|
| Search image | Screenshot of the visible screen with the searched section highlighted in a green box and the found element in a red box | File | No | |
| Clicked element image | Image of the element found | File | No | |
| Clicked element coordinates | Coordinates of the found element within the visible screen | Text (Short) | No | [0, 0, 0, 0] |
| Change detection image | Screenshot of the full visible screen with the changes highlighted in a red box | File | No | |
| Match percentage | If reference image provided, the percentage match of the selected element in comparison to the provided reference image | Number with decimals | No | 95.1 |
| Text captured | If Selection type is element text, the complete output of all text found on the screen ordered from top left to bottom right | Text (Long) | No | Get Started |
Outcomes
| Name | Description |
|---|---|
| Success | This status is selected if the job has successfully completed. |
| No result | This status is selected if the job has successfully completed but no result was produced. |
| Unsuccessful | This status is selected if the job has completed unsuccessfully. |
Requirements
- N/A