Confluent Stream Processing using Apache Kafka® Streams & ksqlDB
Nov 26, 2020 2020-11-30 16:36Confluent Stream Processing using Apache Kafka® Streams & ksqlDB
Confluent Stream Processing using
Apache Kafka® Streams & ksqlDB
Course Description
During this instructor-led, hands-on course, you will learn how to use Confluent KSQL to transform, enrich, filter and aggregate streams of real-time data using a SQL-like language. You will also learn how to use the Apache Kafka Streams library to build streaming applications. Furthermore, you will learn how to test, monitor, secure and scale those streaming applications. You will learn how these applications integrate with the Confluent Platform powered by Apache Kafka, Kafka Connect, Confluent Schema Registry, Confluent REST Proxy as well as the Confluent Control Center. You will learn the role of streaming in the modern data distribution pipeline, discuss architectural concepts and components of KSQL and Kafka Streams..
This is an official course by Confluent.
What you’ll learn
By the end of the training, you will learn to:
- Identify common patterns and use cases for real-time stream processing
- Understand the high level architecture of Apache Kafka® Streams
- Write real-time applications with the Kafka Streams API to filter, transform, enrich, aggregate, and join data streams
- Describe how ksqlDB combines the elastic, fault-tolerant, high-performance stream processing capabilities of Kafka Streams with the simplicity of a SQL-like syntax
- Author ksqlDB queries that showcase its balance of power and simplicity
- Test, secure, deploy, and monitor Kafka Streams applications and ksqlDB queries
-
1.- Motivation and Concepts for Streams
-
Motivation and Use Cases for Real-Time Streaming
-
High Level Comparison of Kafka Streams and ksqlDB
-
Stream Processing Concepts
-
-
2.- Kafka Streams Architecture
-
Kafka Streams’ Place in the Kafka Ecosystem
-
High Level Architecture Design
-
Kafka Streams Data Types
-
-
3.- Writing Kafka Streams Applications
-
Anatomy of a Kafka Streams Application
-
Kafka Streams DSL — Stateless Operations
-
Kafka Streams DSL — Aggregations
-
Kafka Streams DSL — Windowed aggregations
-
Kafka Streams DSL — Joins
-
Kafka Streams DSL — Summary
-
Processor API
-
Optimizations
-
-
4.- Testing Kafka Streams Applications
-
Get streams of data into and out of Kafka with Kafka Connect and REST Proxy
-
Maintain data formats and ensure compatibility with Schema Registry and Avro
-
Build real-time streaming applications with Confluent ksqlDB & Kafka Streams
-
-
5.- The Confluent Platform
-
Unit Tests
-
Integration Tests
-
Stress Tests
-
End-to-end Tests
-
-
6.- Introduction to ksqlDB
-
Sample Use Cases
-
End-to-end Examples
-
Interacting with ksqlDB
-
-
7.- Using ksqlDB
-
Data Manipulation
-
Aggregations
-
Testing
-
-
9.- Deployment
-
Parallelism
-
Elasticity
-
Fault tolerance
-
Capacity planning
-
Troubleshooting
-
ksqlDB-specific considerations
-
-
10.- Security
-
Security Overview
-
Access Control
-
Examples
-
ksqlDB-specific considerations
-
-
11.- Monitoring
-
JMX
-
Confluent Control Center
-
ksqlDB-specific Considerations
-
