Home Power PlatformsAI Builder Form processing AI Builder in Power Automate

Form processing AI Builder in Power Automate

by Mo Faheem
Form processing AI Builder in Power Automate

This post will discuss how to include a form processing AI Builder in Power Automate and how to use it after being trained, tested and published. For more information about creating Form processing AI Builder.

the first step, we need to log in to https://flow.microsoft.com/ and choose the right environment to create the canvas app.

Form processing AI Builder in Power Automate control

Click the “+ New step” to add a new action step to the flow, then search for “AI Builder” and select “Process and save information from forms” action control.

Form processing AI Builder in Power Automate
Form processing AI Builder in Power Automate Connector

Action control in Power Automate

Once the Form processing AI Builder in power Automate control is Selected, the form processing control will be added to the Power Automate flow.

The Form processing AI Builder in Power Automate control is ready to use and doesn’t require a lot of development.

Select the published form processing

At this stage, we are required to choose one of the published custom models to be added to the flow or create a new custom form processing model.

Read more about creating Form processing AI Builder. This step is required before adding any form processing models

Form processing AI Builder in Power Automate flow
Form processing AI Builder in Power Automate flow
Form processing AI Builder in Power Automate connector
Form processing AI Builder in Power Automate Connector

Seting the form format type

The action control requires knowing the format of the form which will be processed. If we choose one value then pass other file format types, the process will fail. Therefore, knowing the file format is essential for the process to be completed. Formats are as follows.

  1. PDF Document
  2. JPEG Image
  3. PNG Image
  4. Or, custom value
Form Format type
Form format type

The form that will be analyzed.

This is the actual binary image file that will be analyzed. As mention in the previous step, the file is either PDF, JPEG or PNG. However, this file should be added from a source. In my example, I added a SharePoint Trigger to the Power Automate flow to listen to any newly added files in a specific site folder. Then the flow will process these file using the Form processing AI Builder in Power Automate connetor.

SharePoint Trigger
SharePoint Trigger

Then, in the Form processing AI Builder in Power Automate Connector we will add the SharePoint file content in the form field to be processed.

Using the Dynamic content, we will add SharePoint File Content value.

The form file content

Processing the AI Builder model results

In later steps, after the model gets processed, we can use the outputs of the Form processing AI Builder in Power Automate connector.

In my example, I will create a new table row of data in Excel online and populate the excel cells with the AI Builder model fields.

Alternatively, based on the business requirements, in this stage, we can populate the data in any other data source.

Excel Power Automate connector

Populate the AI Builder model results

We can easily populate the data in the destination data source using the “Dynamic content”.

The data that is available to be included are as follows.

  1. Each field extracted value – String data type
  2. Each field confidence score – a float data type. The score is a value between 0 to 1. The higher the confidence score is, the more accurate the data extract is.
  3. The data extracted and the confidence are also possibly extracted in a table.

For more information about the inputs and outputs of the form processing AI Builder in Power Automate control.

Related Articles

Leave a Comment