After the last few years in the industry, I've noticed that we've been speaking about AI on the edge, and there has been a concerted effort to bring the best models onto our handheld devices. However, there are limitations. Memory capacity is the big one, but these models work best when they support built-in acceleration. These are AI accelerators in everything from edge to TV to automotive to smartphone to PC. Time to first token and how many tokens per second are becoming the de facto standard metrics in generative AI. However, the AI and machine learning space is more than just generative. Not only do we have large language models and stable diffusion, but we also have machine learning to do many things on many devices. Even something as simple as power management these days is optimized by machine learning. This is why you need stuff on the device to help with battery life, to help with performance.
In order to find out more, I spoke to MediaTek's Finbarr Moynihan and Amy Guesner about what it takes to enable NPUs from edge to cloud.
https://i.mediatek.com/ai to find out more.
[00:00] - Introduction to AI on the Edge
[01:00] - Limitations of Edge Devices
[02:40] - Importance of Running AI Models on the Edge
[05:00] - Applications of AI Beyond Generative Models
[07:00] - Power Management Optimized by AI
[09:30] - MediaTek’s End-to-End Strategy for AI
[11:00] - MediaTek’s Market Position and AI Portfolio
[13:20] - Generative AI and Its Future Impact
[16:00] - MediaTek's AI Strategy and Cross-Device Integration
[19:00] - The Role of AI in Automotive and Consumer Devices
[22:00] - MediaTek's Partnership with Nvidia
[25:00] - Developer Ecosystem and AI Tools
[28:00] - MediaTek's Future Direction in AI and Custom Silicon
-----------------------
Need POTATO merch? There's a chip for that!
http://merch.techtechpotato.com
http://more-moore.com : Sign up to the More Than Moore Newsletter
/ techtechpotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at / iancutress
Follow TechTechPotato on Twitter at / techtechpotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : https://geni.us/AmazonUS-TTP
Amazon UK : https://geni.us/AmazonUK-TTP
Amazon CAN : https://geni.us/AmazonCAN-TTP
Amazon GER : https://geni.us/AmazonDE-TTP
Amazon Other : https://geni.us/TTPAmazonOther
Ending music: • An Jone - Night Run Away
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #mediatek #machinelearning
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on the More Than Moore newsletter or TechTechPotato YouTube channel and related social media. The companies that fall under this banner include AMD, Applied Materials, Armari, ASM, Ayar Labs, BCG, Baidu, Dialectica, Facebook, GLG, Guidepoint, IBM, Impala, Infineon, Intel, Kuehne+Nagel, Lattice Semi, Linode, MediaTek, NordPass, NVIDIA, ProteanTecs, Qualcomm, SiFive, SIG, SiTime, Supermicro, Synopsys, Tenstorrent, Third Bridge, TSMC, Untether AI, Ventana Micro.
Информация по комментариям в разработке