---
schema_version: "1"
id: cf4d587ffa20ed110d996911aee0cc61ab7cb54e6131e27c2b7089ef20a46c87
title: AI OCR (screen-based)
collection: mulesoft
version: current
locale: en-us
portal_url: https://docs.salesforce.com/mulesoft/current/en-us/rpa-builder/6.6/toolbox-text-recognition-ai-ocr-screen-based.md
canonical_url: https://docs.mulesoft.com/rpa-builder/6.6/toolbox-text-recognition-ai-ocr-screen-based
source_site: docs.mulesoft.com
content_type: documentation
content_hash: 4c706537f77b4095cd731c2b1242869dee117edcf746ff04c8efc09c3a52d952
description: MuleSoft Documentation Site
release: "6.6"
latest: false
---
---
product: RPA Builder
version: 6.6
---

# AI OCR (screen-based)

> For the full documentation index, see: https://docs.mulesoft.com/llms.txt

The _AI OCR (screen-based)_ Action Step is a further development of the existing OCR Action Steps.
In contrast to the other OCR Action Steps, it is based on concepts of neural networks. The available
languages, therefore, are based on trained patterns that take account of the characteristics of the
relevant language. In many cases, therefore, the correct recognition of texts that are, for example,
barely legible or have little contrast or an unusual font, is improved with this Action Step.

In contrast to the AI OCR (file-based) Action Step, which works with existing images, e.g. from
document scans, the _AI OCR (screen-based)_ Action Step works _with_ screenshots of the currently
active desktop_._ This means, it attempts to extract texts from a previously created screen copy.

You should consider the Intelligent OCR 2020 Action Step if more than one language is to be
recognized at once or if you wish to use your own dictionary.

## Properties

**OCR Image Preprocessing**

See also [Properties](https://docs.mulesoft.com/rpa-builder/6.6/toolbox-text-recognition-ai-ocr-file-based#Properties) in the Chapter entitled
**AI OCR (File-based)**.

## Inbound Variables

**Scan Area relative to** (Coordinates) The defined Search Area is moved relative to these
coordinates. The resulting result coordinates are then absolute and are with reference to the left
screen corner.

This variable can only be mapped in the wizard.

## Outbound Variables

**IsSucceeded** (Boolean) Shows whether text recognition has been carried out successfully or not.

## Wizard

You can use **OCR Image Preprocessing** to improve the quality of the image so that the OCR
operation can run optimally. This is always carried out in the specified sequence. Here, you can
also switch the individual steps on or off.

First, a screenshot is made of the currently active desktop. Using **Initial wait time**, you can
delay this operation. This can be very useful if the image takes time to form, e.g. due to
animations.

You can find further explanations in
[Properties](https://docs.mulesoft.com/rpa-builder/6.6/toolbox-text-recognition-ai-ocr-file-based#Properties).