Скачать или смотреть 😲Use Chat GPT to automate your computer | self automating computer🤖

A few weeks ago we discussed it isn't far off that we will use Computer Vision, and Chat GPT, to automate your PC. I saw a video today explaing out an open-source library is doing this. This is just the beginnings! I don't think it wll be long before we use Chat GPT to trigger several of the 19 ways we know how to automate PCs with AutoHotkey.

Wes Roth's Intro video:    • Sam Altman Comments on Q* | Self Operating...  

Github Repository mentioned: https://github.com/OthersideAI/self-o...

TLDR: Chat GPT has the potential to automate computer actions and tasks, but it is currently experiencing high error rates and issues with accuracy.

1. 00:00 🤖 Chat GPT can now control a computer, with potential for huge impact and fast development.

2. 01:32 💻 Python script uses Chat GPT to automate computer actions with structured responses.

3. 02:49 🤖 Chat GPT is experiencing a high error rate in estimating coordinates, causing clicking to fail due to a disconnect between the given coordinates and the actual computer position.

4. 04:17 🤖 Chat GPT has issues with providing correct answers and matching computer coordinates, with 14 reported issues in the code released two weeks ago.

5. 05:54 💻 Chat GPT is advancing to the point where we can talk to the computer and it will perform actions for us, and all the necessary parts are almost working.

6. 07:28 🤖 Using AI for automating programs is more accurate and faster than using image search, and there are 19 ways in AutoHotkey to automate and connect to programs.

7. 08:20 🤖 People can automate their computer programs using Chat GPT, which is a starting point for more reliable and consistent ways to automate.

8. 09:46 💻 Use Chat GPT to automate computer tasks in the browser with amazing speed, especially with the Chrome plug-in, but it's not yet accurate enough to control UIA.
8.1 Automate computer tasks using Chat GPT to perform actions in the browser at amazing speed, especially when using the Chrome plug-in.
8.2 Chat GPT has the potential to control UIA by accessing the Dom of a web page and passing along the UIA Tre, making it more accurate, but it is not there yet.