Kafka A Journey To Somwher

Recently, I wanted to learn how kafka works internally. so, i cloned official git repo and tried to setup locally. After support from Kafka community folks and nice blog from Manasavi Gupta, i was able to set it up locally.

Machine configuration

1. Mac book pro with 8 GB RAM & 4 Core CPU

Assumption

1. git installed
2. Java8 installed
3. IntelliJ community edition installed
4. Gradle installed

Steps

1. Clone kafka source code

git clone https://github.com/<user-id>/kafka.git

2. Important steps

cd <path-to-kafka-repo>/kafka
gradle
./gradlew clean
./gradlew jar

3. Setup below properties

VM Options in. Run →Edit configuration

VM Options: -Dkafka.logs.dir=/tmp/kafka -Dlog4j.configuration=file:config/log4j.properties

Program arguments in Run → Program Arguments

Program Arguments: config/server.properties

Run/Debug configuration shall look like this