I am new to confluent-kafka-python i am running kafka using docker-compose from cp-all-in-one. I created a producer producing data to a new topic same as the offical tutorial.
but I can not find any information regarding how to set up the schema or connection to the database in the code.
I am trying to save the produced data into a table in database so later I can load it on the UI. now every time I refresh the Confluent Control Center topic page it seems I lose the data. Is there any tutorial on this? or am I using Kafka incorrectly.
If you send data with the AvroProducer
, a schema gets registered for you.
There is no database in those links, though, so unclear what you mean there.
If by "topic UI", you mean Confluent Control Center, viewing messages is documented here