Skip to content
share

Ingest parsed logs in Apache Kafka

Output Plugin: Apache Kafka

Acts as producer to ingest parsed messages to Apache Kafka topics. This plugin depends on logagent-output-kakfa, which should be installed first.

Installation

Install @sematext/logagent and logagent-output-kafka npm package:

npm i -g @sematext/logagent 
npm i -g logagent-output-kafka

Configuration

# Global options
options:
  includeOriginalLine: false

input:
  stdin: true

output:
  kafka: 
   module: logagent-output-kafka
   host: localhost
   port: 9092 
   topic: test
   requireAcks: 1
   sslEnable: false
   sslOptions: 
      - rejectUnauthorized: false

Start logagent

logagent --config kafka-input.yaml