OCR Actions in Power Automate Desktop

Document scanning is a common practice in many organizations and businesses. Although scanned documents may be sufficient for certain tasks, manual extraction is required in most cases.

For example, financial departments often review a certain number of receipts and invoices issued by employees and partners in physical or photographic form.

logo-ocr-actions-power-automate-desktop

The automation of these tasks can increase efficiency across the organization and disconnect employees from repetitive and unproductive data extraction processes.

Power Automate Desktop enables users to read, extract and manage data within various files using the algorithm (OCR). The platform supports Microsoft MODI and Google Tesseract OCR engines while providing a variety of related functions.

You may not get 100% of the text extracted from the image but it will be somewhere about approx. 90%

Using OCR actions, you can deal with the most challenging workflow that would require human intervention. OCR actions initiate OCR engines to perform OCR-related operations.

PDF Automation in Power Automate Desktop

There are three OCR actions in Power Automate Desktop.

ocr-actions-pane-ocr-actions-power-automate-desktop

  • Create Tesseract OCR engine: It is used to create a Tesseract OCR engine
  • Create MODI OCR engine: It is used to create a MODI OCR engine
  • Extract text with OCR: It is used to extract text from a given source using the given OCR engine
  • Open Power Automate Desktop App.
    desktop-app-power-automate-desktop
  • Firstly, we need to create a flow. Click on New flow.
    new-flow-layout-power-automate-desktop
  • Create a flow with the name ocr-actions.
    flow-creation-ocr-actions-power-automate-desktop

To perform any OCR operation, you must start the OCR engine. OCR engines are software tools that are used to convert typed or handwritten content into machine-readable and well-organized formats.

Power Automate Desktop supports Microsoft MODI and Google Tesseract engines with engine Create MODI OCR and Create Tesseract OCR engine actions. Both of these actions have the same structure and function.

If Else Conditions in Power Automate Desktop

Create Tesseract OCR engine

This action is used to create a Tesseract OCR engine. The Create Tesseract OCR engine action provides the Use other language option to use languages. To use another language, you have to provide the language's abbreviation and the respective data file's path.

  • To start the engine, you need to specify its language and set the width and height of the image. Image duplicates increase the image size to make text extraction or search more effective.
Avoid setting more than three values ​​because high values ​​can lead to failed results.
  • From the Actions panel, drag and drop the Create Tesseract OCR engine action into the workspace.
    create-tesseract-lang-ocr-actions-power-automate-desktop
  • Add image multiplier values. The output will be produced in the OCREngine variable. Disable the Use other language option. Click on Save.
    create-tesseract-ocr-actions-power-automate-desktop

Loop Actions in Power Automate Desktop

Create MODI OCR engine

This action is used to create a MODI OCR engine. The Create MODI OCR engine action does not provide the Use other language option to use languages.

From the Actions panel, drag and drop the Create MODI OCR engine actions into the workspace. Select language as English. Add image multiplier values. The output will be produced in the OCREngine2 variable. Click on Save.
create-modi-ocr-actions-power-automate-desktop

Exctract text with OCR

This action is used to extract text from a given source using the given OCR engine.

  • From the Actions panel, drag and drop the Extract text with OCR actions into the workspace. OCR engine variable as type and variable as OCREngine. OCR sources in which you can extract are Screen, Foreground window, and Image on disk.
  • Select OCR source as Screen. Search mode we have three options, Whole of specified source, Specific subregion only, and Subregion relative to the image. Select Whole of specified source and click on Save.
    extract-options-text-ocr-ocr-actions-power-automate-desktop
  • Save and Run the flow. We get output as text extracted from the current screen.
    screen-output-ocr-actions-power-automate-desktop
  • Edit the Extract text with OCR. OCR source as Image on disk and add Image file path. Click on Save.
    ocr-image-ocr-actions-power-automate-desktop
  • From the Actions panel, drag and drop the Write text to file actions into the workspace. Add File path and text to write as OcrText. Click on Save.
    write-text-to-file-ocr-actions-power-automate-desktop
  • This is how the image looks like
    image-ocr-actions-power-automate-desktop
  • Save and Run the flow. We get output as text extracted from the image.
    output2-ocr-actions-power-automate-desktop

Excel Automation in Power Automate Desktop

About Author :

I am Sharvari Raut, having sound knowledge and experience in technical writing. Currently, pursuing my B.Tech in Computer Science and Engineering.

Comment / Suggestion Section
Point our Mistakes and Post Your Suggestions