If you’re working with Elasticsearch, it’s very likely that you’ll need to reindex data at some point. The most popular reason is because you need a mapping change that is incompatible with your current mapping. New fields can be added […]
Author: Radu Gheorghe
Monitoring rsyslog’s Performance with impstats and Elasticsearch
If you’re using rsyslog for processing lots of logs (and, as we’ve shown before, rsyslog is good at processing lots of logs), you’re probably interested in monitoring it. To do that, you can use impstats, which comes from input module […]
Using Elasticsearch Mapping Types to Handle Different JSON Logs
By default, Elasticsearch does a good job of figuring the type of data in each field of your logs. But if you like your logs structured like we do, you probably want more control over how they’re indexed: is time_elapsed […]
Parsing and Centralizing Elasticsearch Logs with Logstash
NOTE: this configuration was tested with Logstash 2.2 on logs generated by Elasticsearch 2.2 No, it’s not an endless loop waiting to happen, the plan here is to use Logstash to parse Elasticsearch logs and send them to another Elasticsearch […]
Encrypting Logs on Their Way to Elasticsearch Part 2: TLS Syslog
In part 1 of the “encrypted logs” series we discussed sending logs to Elasticsearch over HTTPS. This second part is about TLS syslog. If you wonder what this has to do with Elasticsearch, the point is that TLS syslog is […]
Encrypting Logs on Their Way to Elasticsearch
Let’s assume you want to send your logs to Elasticsearch, so you can search or analyze them in realtime. If your Elasticsearch cluster is in a remote location (EC2?) or is our log analytics service, Logsene (which exposes the Elasticsearch […]
Rsyslog 8.1 Elasticsearch Output Performance
Recently, the first rsyslog version 8 release was announced. Major changes in its core should give outputs better performance, and the one for Elasticsearch should benefit a lot. Since we’re using rsyslog and Elasticsearch in Sematext‘s own Logsene, we had […]
5-minute Logstash: Parsing and Sending a Log File
SIDE NOTE: We run Elasticsearch and ELK trainings, which may be of interest to you and your teammates. We like Logstash a lot at Sematext, because it’s a good (if not the) swiss-army knife for logs. Plus, it’s one of […]
Video: Using Solr for Logs with Rsyslog, Flume, Fluentd and Logstash
A while ago we published the slides from our talk at Lucene Revolution about using Solr for indexing and searching logs. This topic is of special interest for us, since we’ve released Logsene and we’re also offering consulting services for […]
Status