How to Use LLM Vision to Analyze Camera Images and Video in Home Assistant

How to setup and use LLM Vision in Home Assistant. This can analyze images, videos, live camera feeds, and Frigate events for providing useful (and hilarious) information about your smart home.

🍿 WATCH NEXT
   • AI Took Over My Smart Home (and how y...  
   • Can AI Build Your Smart Home? ChatGPT...  

🔗 LINKS
Video article: https://www.michaelsleen.com/llm-vision/
Doorbell Notification YAML code: https://shop.michaelsleen.com/product...
LLM Vision GitHub: https://github.com/valentinfrlch/ha-l...
Google Gemini API key: https://aistudio.google.com/app/apikey

🛒 SHOP MERCH & DIGITAL DOWNLOADS
Visit my shop to can grab sleek merch, plus the home automation blueprints and code I show in my tech videos. This saves you the time and hassle of figuring it out, and takes your smart home to the next level faster.
https://shop.michaelsleen.com/

💻 BROWSE TECH GEAR
Browse the tech I use everyday, from smart home gadgets, to productivity desk setups, to mobile devices, and more.
https://www.michaelsleen.com/tech/

👏 BECOME A MEMBER
If you enjoy high quality, honest tech reviews and tutorials, become a member today and get special perks.
Become a YouTube Channel Member:    / @michaelsleen  
Become a Fourthwall Member: https://shop.michaelsleen.com/support...
Become a Patreon Member:   / michaelsleen  
Support Me on Ko-Fi: https://ko-fi.com/michaelsleen

🎬 FILMING GEAR
Camera - iPhone 15 Pro Max: https://amzn.to/3tAyAbZ
Mic (Wired) - Rode VideoMic GO II: https://amzn.to/3vnpgc1
Mic (Wireless) - Hollyland Lark M2: https://amzn.to/3wlbmYF
Desk Mount - Elgato Master Mount L: https://amzn.to/3wbGKZH
Desk Mount for Top-Down Camera - Elgato Flex Arm L: https://amzn.to/4a7pG4I
Desk Mount for Prompter and Talking Head Camera - Elgato Solid Arm: https://amzn.to/3UqrQ9N
Desk Mount for Light - ULANZI Camera Desk Mount Stand: https://amzn.to/41LmM3l
Light - RALENO LED Soft Light: https://amzn.to/48v3Ho6
Tripod - Peak Design Travel Tripod (Carbon Fiber): https://amzn.to/3vExGfi
Mini Tripod - Peak Design Mobile Tripod: https://amzn.to/48zoIOI
Gimbal - Hohem iSteady M6 Gimbal for Smartphone - https://amzn.to/3Wqi0r6
Gimbal - Hohem AI Tracking Sensor - https://amzn.to/3y85bYv
Headphone Hanger Mount - EURPMASK: https://amzn.to/3Swl4i4
Headphones - Sony WH-1000XM5: https://amzn.to/3I8Hm4z
Laptop - 2023 14" MacBook Pro, M3 Pro, 18GB Memory, 1TB SSD: https://amzn.to/48sKBzi
Video Editing - DaVinci Resolve (Free Version): http://tinyurl.com/3hksxnxx

👤 ABOUT ME
Hi, I'm Michael Leen. I'm a tech product manager and a YouTube creator. I have worked in big tech and smart home, and am a lifelong tech enthusiast. I produce YouTube content showing how tech can make you more productive – saving you time and money, and making your home more comfortable and secure.

🎵 MUSIC CREDIT
Song: Up Above by Pyrosion   / pyrosion  
Creative Commons — Attribution-ShareAlike 3.0 Unported — CC BY-SA 3.0
Music promoted by Audio Library    • Up Above – Pyrosion (No Copyright Music)  

📘 CHAPTERS
00:00 - Introduction
00:49 - LLM Vision
01:47 - Setup
07:23 - Use cases
10:22 - Home automation
10:47 - Final thoughts
11:45 - Outtakes

ℹ️ AFFILIATE LINKS
When you make a purchase using the links I provide, I may earn a small commission at no additional cost to you.