Скачать или смотреть Limit the amount of requests to your API Gateway. Do it advanced!

Welcome to my video about the AI Rate Limiting plugin for the Kong Gateway. This plugin allows us to control traffic to our AI configuration with the AI proxy configuration. If you missed the AI-Proxy video, and you are figuring out what to do with it or just want to know more, then perhaps one good thing to do is to checkout the first video I made about Kong's AI plugins over here:    • How to and why configure the Kong AI-Proxy...   . This particular vide, the AI Advanced Rate Limiting plugin, makes more sense to use, if we are using multiple LLM models under different routes common services. It allows for a seamless configuration and better cost controls. I tell all the basics in the video. I hope you enjoy the video and be sure to stay tech, keep programming, be kind and have a good on everyone!

---

Chapters:

00:00:00 Start
00:00:33 Introduction
00:03:19 Configuring Mistral AI
00:04:59 The AI Advanced Rate Limiting Plugin in Detail
00:09:19 Interpreting Rate Limiting Headers
00:10:32 Checking out the configuration in Kong Konnect
00:11:07 Talking about Kong Semantic AI Cache
   • Kong AI Semantic Cache plugin makes wonder...  
00:11:31 Checking out the example
00:12:10 Getting back to the AI Semantic Cache plugin
   • Kong AI Semantic Cache plugin makes wonder...  
00:15:02 Launching examples and interpreting results
00:20:39 End notes and conclusion
00:21:22 See you in the next video!
00:22:11 Disclaimer

---

Soundtrack

  / slow-guitar-15-jesprotech  

---

Related videos:

   • Thank you so much Kong Community! 2024!  
   • Managing gRPC Services with Kong Konnect a...  
   • Kong KONNECT, the first steps  
   • Kuma, how it works, what we can configure ...  
   • How to and why configure the Kong AI-Proxy...  
   • Templating with the AI Decorator? Let's de...  
   • What is a vector database?  

--- Source code

https://github.com/jesperancinha/kong...
https://github.com/jesperancinha/jeor...

---

Sources:

https://docs.konghq.com/hub/kong-inc/...

---


As a short disclaimer, I'd like to mention that I'm not associated or affiliated with any of the brands eventually shown, displayed, or mentioned in this video.

---

All my work and personal interests are also discoverable on other different sites:

My Website - https://joaofilipesabinoesperancinha.nl/
Reddit -   / jesperancinha  
Credly - https://www.credly.com/users/joao-esp...
Pinterest -   / jesperancinha  
Facebook -   / joaofisaes  
Spotify - https://open.spotify.com/user/jlnozkc...
Daily Motion - https://www.dailymotion.com/jofisaes
Bluesky - https://bsky.app/profile/jesperancinh...

---

If you have any questions about this video please put a comment in the comment section below and I will be more than happy to help you or discuss any related topic you'd like to discuss.

If you want to discover more about my open-source work please visit me on GitHub at:

GitHub - https://github.com/jesperancinha