2024-04 Building a custom AI chatbot with Spring Boot, React, and LangChain4j

Presented by: Marcus Hellberg

Have you ever wanted to build an intelligent chatbot that understands your specific business context?

This presentation takes a practical engineering approach to AI. You'll learn how to interact with large language models (LLMs) from code and how you can extend their capabilities by giving them access to your own content and selected Java methods through retrieval-augmented generation (RAG).

This talk will feature hands-on coding, where you'll learn to implement a custom AI chatbot with Spring Boot, React, LangChain4j, and Hilla. Walk away with a solid understanding of how you can integrate AI into your own application.

Speaker Bio:
Marcus has spent the past 20 years combining modern web technologies and Java. He's always curious to learn new things and loves helping developers learn new things. He works as the VP of Developer Relations at Vaadin.

Timecodes:
0:00 Intro
0:15 Topic Overview
6:17 LLM Overview
8:26 Tools
9:24 Agent autonomy
12:28 Chatbot
12:40 Context window
15:07 Retrieval-augmented generation
15:50 Teaching an LLM
16:59 Finding and storing the relevant information
21:35 Copilot
22:57 UI Tools
25:27 AI chatbot overview
32:55 AI Assistant implementation
41:28 Chat memory management - ChatMemoryProvider implementation
44:17 Reading files for additional information from embedding store for the bot
54:15 Creating tools for creating, updating and canceling booking
1:03:32 Link to the project