Automate OCR with GPT-4o and Power Automate

Welcome to today's tutorial where I will demonstrate how you can learn how to extract values / entities from an image using a single api call and the new ChatGPT-4o Omni model. Using Power Automate I will demo how you can call the API on Azure. You will learn how to deploy the model to Azure and how to fine tune a prompt for a GPT use case. I will then demonstrate how you can run your automation on files uploaded to SharePoint, saving key metadata straight back to the file properties in SharePoint, all using Power Automate.

Whilst there are off the shelf models for OCR extractions in the form of AI Builder and Azure Document Intelligence, this new GPT-4o model is remarkably cheap to run and extremely flexible due to the ability for you to formulate a natural language requirement. By insisting the model returns structured JSON, we have a consistent output and can use this consistently in further stages of our automation.

Timestamps:
00:00 Introduction
00:45 Power Automate Flow and GPT-4o
03:42 Upload a file and trigger the automation
06:00 Deploy a model to Azure
07:25 Azure AI Playground
10:30 Devising a prompt with ChatGPT.com
12:06 Modify the flow to trigger from SharePoint
17:28 Testing the flow from SharePoint
18:40 Outro

By the end of this tutorial, you'll have a comprehensive understanding of how to deploy ChatGPT-4o to Azure and integrate with low code automation tools such as Power Automate. Please do let me know in the comments your ideas for automation.

Want to explore pre-built models? AI Builder or Azure Document Intelligence    • Power Automate Invoice Processing Tut...  

Want to build a canvas app gpt bot? Deploy Mistral Large, Integrate with Power Platform #Mistral #MistralAI #PowerPlatform
   • Canvas App Chat Bot via Mistral Large...  

Got an idea? Or video request? Drop me a note here https://forms.office.com/r/4EqE7VHVfH 👍

Want to buy me a coffee https://www.buymeacoffee.com/DamoBird365 ☕

#PowerAutomate #PowerPlatform #gpt4o #azureopenai