How (not) to Scale Elasticsearch for Data Analytics!

Originally aired:

About the Session

Search is ubiquitous - From booking a cab on Ride sharing platforms to searching for a job on LinkedIn, Elasticsearch has emerged as a prominent solution for extensive data analytics and searches. Due it’s distributed nature and ability to offer powerful visualizations, it serves as a key tool for deriving actionable insights. And, the recent advancements in Elasticsearch using ML stands out due to its simplicity in data analytics.

While Elasticsearch’s out of the box defaults works for smaller implementations, the nuances of handling a massive deployment in order to scale for petabytes of data and billions of ingests & searches per day requires a deeper knowledge on Elasticsearch internals.

In this talk, we will cover:

  • Learnings from our experiences in managing and scaling enterprise grade
  • Elasticsearch clusters with specific details around the things that can go wrong and how we could mitigate them.
  • Our inhouse security plugin that saved us 1 Million$ licensing cost.
  • Gaining actionable insights using ML
  • Demo of the features that we built on the top of Elasticsearch for scaling it.

See Highlights

Hear What Attendees Say


“Once again Saltmarch has knocked it out of the park with interesting speakers, engaging content and challenging ideas. No jetlag fog at all, which counts for how interesting the whole thing was."

Cybersecurity Lead, PwC


“Very much looking forward to next year. I will be keeping my eye out for the date so I can make sure I lock it in my calendar."

Software Engineering Specialist, Intuit


“Best conference I have ever been to with lots of insights and information on next generation technologies and those that are the need of the hour."

Software Architect, GroupOn

Hear What Speakers & Sponsors Say

Scott Davis

“Happy to meet everyone who came from near and far. Glad to know you've discovered some great lessons here, and glad you joined us for all the discoveries great and small."

Web Architect & Principal Engineer, Scott Davis

Dr. Venkat Subramaniam

“Wonderful set of conferences, well organized, fantastic speakers, and an amazingly interactive set of audience. Thanks for having me at the events!"

Founder of Agile Developer Inc., Dr. Venkat Subramaniam

Oracle Corp.

“What a buzz! The events have been instrumental in bringing the whole software community together. There has been something for everyone from developers to architects to business to vendors. Thanks everyone!"

Voltaire Yap, Global Events Manager, Oracle Corp.