BloombergGPT - an LLM for Finance with David Rosenberg - 639

Today we’re joined by David Rosenberg, head of the machine learning strategy team in the Office of the CTO at Bloomberg. In our conversation with David, we discuss the creation of BloombergGPT, a custom-built LLM focused on financial applications. We explore the model’s architecture, validation process, benchmarks, and its distinction from other language models. David also discussed the evaluation process, performance comparisons, progress, and the future directions of the model. Finally, we discuss the ethical considerations that come with building these types of models, and how they've approached dealing with these issues.

🔔 Subscribe to our channel for more great content just like this: https://youtube.com/twimlai?sub_confi...


🗣️ CONNECT WITH US!
===============================
Subscribe to the TWIML AI Podcast: https://twimlai.com/podcast/twimlai/
Join our Slack Community: https://twimlai.com/community/
Subscribe to our newsletter: https://twimlai.com/newsletter/
Want to get in touch? Send us a message: https://twimlai.com/contact/


📖CHAPTERS
===============================
00:00 - Intro
02:47 - Introducing BloombergGPT
06:20 - Focus on numerical data tokenization
07:57 - Challenges in training large models and improving performance
17:38 - Focusing on experimentation for small changes.
25:30 - For commercial use, to build a model or to fine-tune?
28:49 - Model architecture and infrastructure flexibility
33:47 - Training and instruction tuning
38:34 - Investment in small-scale experiments for models
40:39 - Researching natural language models for varied uses
43:37 - Ethical concerns and considerations


🔗 LINKS & RESOURCES
===============================
Paper: BloombergGPT: A Large Language Model for Finance - https://arxiv.org/abs/2303.17564
BloombergGPT Blog Post - https://www.bloomberg.com/company/pre...

For a complete list of references, head over to https://twimlai.com/go/639.


📸 Camera: https://amzn.to/3TQ3zsg
🎙️Microphone: https://amzn.to/3t5zXeV
🚦Lights: https://amzn.to/3TQlX49
🎛️ Audio Interface: https://amzn.to/3TVFAIq
🎚️ Stream Deck: https://amzn.to/3zzm7F5