Skip to content

Latest commit

 

History

History
52 lines (47 loc) · 2.59 KB

Setup-Env.md

File metadata and controls

52 lines (47 loc) · 2.59 KB
Raw

Set up the environment for KSQLDB Hands-on Workshop

on your local machine:

git clone https://github.com/ora0600/confluent-ksqldb-hands-on-workshop.git
cd confluent-ksqldb-hands-on-workshop/docker/
docker-compose up -d
docker-compose ps

If you are running in the cloud. Login in via ssh to compute:

ssh -i privkey ec2-user@publicip
cd confluent-ksqldb-hands-on-workshop/docker/
docker-compose up -d
docker-compose ps

All container should be healthy and running.

Check Confluent Control Centeropen C3

Open URL in Browser

You should see in Control Center

  • a running cluster
  • three connectors are running
  • 1 KSQL APP is running
  • three topics AML_Status, Funds_Status, Payment_Instruction are created

Create additiional topics

In the terminal (cloud ssetup to be first login via ssh) create additional topics, we use them later in workshop:

docker exec -it workshop-kafka  kafka-topics --create --topic orders --bootstrap-server localhost:9092 
docker exec -it workshop-kafka  kafka-topics --create --topic shipments --bootstrap-server localhost:9092 
docker exec -it workshop-kafka  kafka-topics --create --topic inventory --bootstrap-server localhost:9092 
docker exec -it workshop-kafka  kafka-topics --create --topic shipment_status --bootstrap-server localhost:9092 
docker exec -it workshop-kafka  kafka-topics --create --topic transactions --bootstrap-server localhost:9092

Load data

For some topics we prepared some data files. These files are used to produce data int our topics. Later we will connectors and INSERT Statements:

# produce data orders
docker exec -it workshop-kafka  cat /produce-data/orders.json | kafka-console-producer --topic orders --broker-list localhost:9092  --property "parse.key=true" --property "key.separator=:" 
# produce data shipments
docker exec -it workshop-kafka  cat /produce-data/shipments.json | kafka-console-producer --topic shipments --broker-list localhost:9092  --property "parse.key=true" --property "key.separator=:" 
# produce data shipment statuses
docker exec -it workshop-kafka  cat /produce-data/shipment_status.json | kafka-console-producer --topic shipment_status --broker-list localhost:9092  --property "parse.key=true" --property "key.separator=:" 
# produce data transactions
docker exec -it workshop-kafka  cat /produce-data/transactions.json | kafka-console-producer --topic transactions --broker-list localhost:9092  --property "parse.key=true" --property "key.separator=:"

go back to Agenda