At the end of November, we’ll be migrating the Sematext Logs backend from Elasticsearch to OpenSearch

Logging

Field Stats for Elasticsearch 6.x

We're excited to announce the release of the Field Stats API plugin for Elasticsearch. The Field Stats API used to be present from Elasticsearch 1.6 to 5.6, to provide efficient

Elasticsearch Ingest Node vs Logstash Performance

Unless you are using a very old version of Elasticsearch you’re able to define pipelines within Elasticsearch itself and have those pipelines process your data in the same way you’d

Recipe: How to integrate rsyslog with Kafka and Logstash

This recipe is similar to the previous rsyslog + Redis + Logstash one, except that we’ll use Kafka as a central buffer and connecting point instead of Redis. You’ll have

Handling Multiline Stack Traces with Logstash

Here at Sematext we use Java and rely on Elasticsearch for our hosted ELK logging SaaS, a lot. We like them so much that we regularly share our logging experience

Logtrail + Kibana = Retro Terminal Experience

Logtrail is a popular Kibana plugin that makes Kibana look like Papertrail. Sematext’s Logtrail view in Kibana gives you the terminal-like experience of exploring logs without the pain of needing

Docker Log Driver Alternatives

"Why does the 'docker logs' command fail?", is one of our frequently asked questions. The answer is simple and mentioned in the Docker documentation: "The docker logs command is not available for drivers

GDPR: Top 5 Logging Best Practices

The rather broad definition of personal data in the GDPR requires paying special attention to log data. GDPR and personal data in web server logs is a popular topic in

IoT: Air Pollution Tracking with Node.js, Elastic Stack, and MQTT

What can you do with a couple of IoT devices, Node.js, Elasticsearch, and MQTT?  You can put together your own Internet of Things setup for measuring air pollution, like I

Rsyslog eBook: Centralized Logging with Rsyslog

Centralizing logs to Elasticsearch? Of course, the first log shipper that comes to mind is Logstash. When you get into it, you realize centralizing logs often implies a bunch of

AWS Elasticsearch Service vs. Elasticsearch on EC2

Many of our customers use AWS EC2. In the context of Elasticsearch consulting or support, one question we often get is: should we use AWS Elasticsearch Service instead of deploying Elasticsearch ourselves? The