{"id":18969,"date":"2021-11-02T05:07:32","date_gmt":"2021-11-01T22:07:32","guid":{"rendered":"https:\/\/huongdanjava.com\/?p=18969"},"modified":"2025-01-24T11:14:05","modified_gmt":"2025-01-24T04:14:05","slug":"install-apache-kafka-using-docker-compose","status":"publish","type":"post","link":"https:\/\/huongdanjava.com\/install-apache-kafka-using-docker-compose.html","title":{"rendered":"Install Apache Kafka using Docker Compose"},"content":{"rendered":"

In the previous tutorial<\/a>, I showed you how to install Apache Kafka on macOS. Installing Apache Kafka using Docker Compose<\/a> will help us quickly start up an Apache Kafka server without much effort, just install Docker and a docker-compose.yml file. How is it in detail? In this tutorial, I will show you how to install Apache Kafka using Docker Compose!<\/p>\n

I will create a new docker-compose.yml file and declare 2 services, one for Apache Zookeeper and one for Apache Kafka, as follows:<\/p>\n

services:\r\n  zookeeper:\r\n  \r\n  kafka:<\/pre>\n
Because Apache Kafka wants to run, it must have Apache Zookeeper running, so I will declare the zookeeper service first.<\/p>\n
We will use the Apache Kafka and Apache Zookeeper Docker images from the Confluent Platform https:\/\/www.confluent.io\/<\/a> with the Docker Hub address https:\/\/hub.docker.com\/u\/confluentinc<\/a>. In a nutshell, Confluent Platform is an extension of Apache Kafka, built from Apache Kafka along with other useful tools and services that make it easy for us to run and use Apache Kafka! There is no Docker Official Image from Apache Kafka so we can use Docker Images from this Confluent Platform.<\/p>\n
The content of the zookeeper service is as follows:<\/p>\n
zookeeper:\r\n  image: confluentinc\/cp-zookeeper:latest\r\n  environment:\r\n    ZOOKEEPER_CLIENT_PORT: 2181\r\n  volumes:\r\n      - .\/zoo\/data:\/data\r\n  ports:\r\n    - 2181:2181<\/pre>\n
ZOOKEEPER_CLIENT_PORT<\/strong> is a required environment variable to define the port that clients can connect to Apache Zookeeper. In our case, it’s Apache Kafka! Here, I also expose port 2181 which is the default port of Apache Zookeeper.<\/p>\n
And the kafka service has the following content:<\/p>\n
kafka:\r\n  image: confluentinc\/cp-kafka:latest\r\n  depends_on: \r\n    - zookeeper\r\n  environment:\r\n    KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181\r\n    KAFKA_ADVERTISED_LISTENERS: PLAINTEXT:\/\/kafka:29092,PLAINTEXT_HOST:\/\/localhost:9092\r\n    KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT\r\n    KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1\r\n  volumes:\r\n      - .\/kafka\/data:\/var\/lib\/kafka\/data\r\n  ports:\r\n    - 9092:9092<\/pre>\n
The KAFKA_ZOOKEEPER_CONNECT<\/strong> environment variable is used to define the Apache ZooKeeper server that Apache Kafka will connect to, and the variable KAFKA_ADVERTISED_LISTENERS<\/strong> here, I define 2 types of listeners:<\/p>\n