Learn Apache Kafka using Scala as programming language.
What you'll learn
- Setup Kafka locally
- Understand multi node Kafka cluster setup
- Develop Scala based applications which can produce messages into Kafka topic
- Develop Scala based applications which can consume messages from Kafka topic
- Integration of Flume and Kafka
- Overview of Kafka Connect
- Overview of Kafka Streams and KSQL
Requirements
- Programming Skills using Scala as Programming Language
- Basic Linux Skills
- 64 bit Computer with at least 4 GB RAM, dual core and enough storage
- 64 bit Operating System - Windows 10 or Mac or Linux
Description
In this comprehensive course, you will be learning
- Setting up of development environment using IntelliJ for Kafka based applications
- Setup Kafka locally along with Zookeeper and validate
- Step by step instructions to setup multi broker Kafka setup
- In depth details about Kafka core concepts
- Use Kafka Producer API with Scala to produce messages to Kafka topic from web application
- 3rd party plugins such as Kafka connect and Flume to get data from web server logs into Kafka topic
- Use Kafka Consumer API with Scala to consume messages from Kafka topic
- 3rd party plugins such as Kafka connect and Spark streaming to consume messages from Kafka topic
- Application Developers especially Scala Developers who want to learn Kafka to build streaming pipelines
- Data Engineers who want to build streaming pipelines
