Скачать или смотреть JOTB19 - Big data serving: The last frontier... by Jon Bratseth

The big data world has mature technologies for offline analysis and learning from data, but have lacked options for making decisions in real time. This talk introduces vespa.ai - a mature platform for processing data and making inferences at large scale at end-user request time.

Offline and stream processing of big data sets can be done with tools such as Hadoop, Spark, and Storm, but what if you need to process big data at the time a user is making a request?

This talk introduces Vespa – the open source big data serving engine which targets the serving use cases of big data by providing response times in the tens of milliseconds at high request rates. Vespa allows you to search, organize and evaluate machine-learned models from e.g TensorFlow over large, evolving data sets. Among the applications powered by Vespa is the scoring/serving of ads in the worlds third largest ad exchange (Oath) and the online content selection at Yahoo, handling billions of daily queries over billions of documents. Vespa was recently open sourced at https://vespa.ai.