Скачать или смотреть Macrobase: A Search Engine for Fast Data Streams | Stanford University

Download slides for this talk: https://goo.gl/L6CvCt

MacroBase is a new open source analytics engine designed to prioritize the scarcest resource in large-scale, fast-moving data streams: human attention. In many deployments at scale, an overwhelming proportion of data collected is never read and is instead retained only for reactive failure analysis. In contrast, MacroBase analyzes data as it arrives, providing interpretable, high-level explanations of stream behaviors, enabling real-time, root cause analysis and anomaly detection.

At its core, MacroBase combines cascades of streaming classification and explanation operators to both identify individual points of interest and highlight commonalities across them. For example, the Android device ecosystem comprises over 24,000 distinct device types. How can you determine whether your mobile application is behaving correctly on all of them? MacroBase’s classification operators can identify abnormally behaving devices, while its explanation operators can aggregate many such devices, producing more interpretable outputs. Thus, MacroBase is designed as a set of reconfigurable dataflow operators that are composed to form end-to-end dataflow pipelines, and has already been used to diagnose issues in production streams in mobile, data center, and industrial applications.

In this talk, we will walk through the core concepts behind MacroBase, its architecture, and use cases, as well as key takeaways from the recent research literature for data engineers, data scientists, and DevOps engineers. MacroBase is a core component of the Stanford DAWN project, a new research initiative designed to enable more usable and efficient machine learning infrastructure.

ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups.

FOLLOW DATA COUNCIL:
Twitter:   / datacouncilai  
LinkedIn:   / datacouncil-ai  
Facebook:   / datacouncilai  
Eventbrite: https://www.eventbrite.com/o/data-cou...