Apache Kafka
Part-1: Kafka EchoSystem
1. Why apache kafka?
2. What is apache kafka?
3. Overview on Kafka API
Kafka Core
Kafka Connect
Kafka Streams
4. Kafka Instalation
Single Node Cluster(Local and AWS Cloud)
Multi Node Cluster( AWS Cloud)
5. Kafka Storage Architecture
Topics
Partitions
Replications
Log Segments
Message offsets and Index
Kafka Basic Operations
6. Kafka Cluster Architecture
Zookeepers and Brokers
KRaft and Brokers
Partition allocation and Fault Tolerance
Leader Vs Follower
Apache Kafka
7. Kafka Producer
Record
Partitioner
Serializers and Deserializers -JSON Schema, AVRO Schema
Multi Thread Kafka Producer
Transactions in Kafka Producer
8. Kafka Consumers
Consumer Groups and Scalability
Consumer Partitions and Offset
9. Error handling, Retry and Recovery
10. Kafka Security Using SSL
11. Fault Tolerance and data recovery
12. Apache Kafka Integration with Spring Boot and Micro services
Part-2:
Kafka Connect Framework
1. Source Connector
Source Connector
Source Task
2. Sink Connector
Sink Connector
Sink Task
Apache Kafka
Kafka Streams
Kafka Streams API
Kafka Streams Architecture
Understanding the States and Stores
KTable
Kstream
Streaming Joins