Kafka Logs

Site24x7 AppLogs makes Kafka log management simple as the log content is sliced into various appropriate fields such as date & time, log level, thread name, source file name, line number, and message. With this you can quickly pinpoint the required information over several lines of log data.  Learn more about log management with Site24x7.

Getting started

1. Log in to your Site24x7 account.
2. Download and install the Site24x7 Server Monitoring agent (Windows | Linux). 
3. Go to Admin > AppLogs > Log Profile and Add Log Profile.

Logs file path

Each application writes logs in different folders and files. By default, Kafka logs are sourced from the below-mentioned folder path for the respective Operating System. If you have logs in a different folder, you can mention it under the File Path to source them from that particular folder while creating a log profile.

:

/var/log/kafka*/*.log

:

C:\kafka*\kafka-logs\*.log", "C:\kafka*\logs\*.log

Log pattern

$DateTime:date$ - $LogLevel$ [$ThreadName$:$SourceFileName$@$LineNumber:number$] - $Message$

This is the default pattern defined by Site24x7 for parsing Kafka logs based on the sample mentioned below.

Sample log

2017-03-14 18:24:15,495] INFO [Controller 0]: List of topics to be deleted: 143 (kafka.controller.KafkaController)

The above sample log can be separated into 6 fields, each of which will take its respective value from here and will then be uploaded to Site24x7.

Related log types

• Log4j logs
• Other supported log types