Searching for Time Series Patterns at Big Data Scale

Originally aired:

About the Session

Time series patterns are pretty common in everyday life. Extracting patterns on these data sets and providing interactive search responses has immense value across many software systems. This talk presents an overview of how such a search system can be built for very large time series data points.

This talk focuses on the STAMP algorithm (Scalable Time Series Anytime Matrix profile) to showcase how time series patterns can be extracted for big data sets. The talk covers concepts of Matrix profile and how motifs/patterns are detected. Once the patterns are analyzed, the results are converted into a document format that is amenable for indexing via a search engine. The session then proceeds to extend the idea to detecting time series across multiple dimensions. A part of the session also covers the distributed approach to extract these time series patterns to tackle big data sets. Further, you will also learn about mechanisms to calculate time series segmentations, time series chains and discords or anomalies thereby enabling ideas for users to search for anomalies and segments of time series.

Dask, Stumpy and Elasticsearch stack is used to describe a reference implementation.

See Highlights

Hear What Attendees Say

PwC

“Once again Saltmarch has knocked it out of the park with interesting speakers, engaging content and challenging ideas. No jetlag fog at all, which counts for how interesting the whole thing was."

Cybersecurity Lead, PwC

Intuit

“Very much looking forward to next year. I will be keeping my eye out for the date so I can make sure I lock it in my calendar."

Software Engineering Specialist, Intuit

GroupOn

“Best conference I have ever been to with lots of insights and information on next generation technologies and those that are the need of the hour."

Software Architect, GroupOn

Hear What Speakers & Sponsors Say

Scott Davis

“Happy to meet everyone who came from near and far. Glad to know you've discovered some great lessons here, and glad you joined us for all the discoveries great and small."

Web Architect & Principal Engineer, Scott Davis

Dr. Venkat Subramaniam

“Wonderful set of conferences, well organized, fantastic speakers, and an amazingly interactive set of audience. Thanks for having me at the events!"

Founder of Agile Developer Inc., Dr. Venkat Subramaniam

Oracle Corp.

“What a buzz! The events have been instrumental in bringing the whole software community together. There has been something for everyone from developers to architects to business to vendors. Thanks everyone!"

Voltaire Yap, Global Events Manager, Oracle Corp.