The talk goes through the basics of centralizing logs in Elasticsearch and all the strategies that make it scale with billions of documents in production. They cover:
- Time-based indices and index templates to efficiently slice your data
- Different node tiers to de-couple reading from writing, heavy traffic from low traffic
- Tuning various Elasticsearch and OS settings to maximize throughput and search performance
- Configuring tools such as logstash and rsyslog to maximize throughput and minimize overhead
Here is part 1 of the Video:
Here is part 2 of the Video:
Here are the slides:
And here are the Commands and Demo used in the presentation: https://github.com/sematext/velocity
Elasticsearch “One-stop Shop”
Log Analysis – We Can Help
If your log analysis and management leave something to be desired, then we’ve got you covered there as well. There’s our centralized logging solution, Logsene, which you can think of as your “Managed ELK Stack in the Cloud or On Premises.” And we also offer Logging Consulting should you require more in-depth support.
Questions or Feedback?