Your Job in 2024: Turning Data Into Vectors | Big Data LDN 2023

12:40 - 13:10 | AI & MLOPS THEATRE
YOUR JOB IN 2024: TURNING DATA INTO VECTORS
THURSDAY 21 SEPTEMBER 2023
SPEAKER: DANIEL SVONAVA

Do you remember the time when each domain of Machine Learning had its own feature engineering approaches and model architectures? And then 2017 happened, and ever since across NLP, Vision, RecSys and beyond we standardized around the Transformer models. They also drive the current Generative AI & LLM hype.

But what does this mean for data professionals?

Well, one of the strengths of the Transformer model family is that they can turn pretty much any data into points in high-dimensional space - we call those points vector embeddings. These vectors offer a rich representation of the underlying data structure - they can help you understand your users better, spot fraudulent transactions faster, identify unwanted content at larger scale or relate other pieces of information to each other in completely new ways.

Simply put, the demand for turning data into vectors is exploding across pretty much all industries - let's discuss what this means for your job in data, the roadmap for your company and the overall impact on the industry.