Search code examples
apache-kafkaprestokafka-producer-apiconnector

How we can Dump kafka topic into presto


I need to pushing a JSON file into a Kafka topic, connecting the topic in presto and structuring the JSON data into a queryable table.

I am following this tutorial https://prestodb.io/docs/current/connector/kafka-tutorial.html#step-2-load-data

I am not able to understand how this command will work.

$ ./kafka-tpch load --brokers localhost:9092 --prefix tpch. --tpch-type tiny

Suppose I have created test topic in kafka using producer. How will tpch file will generate of this topic?


Solution

  • If you already have a topic, you should skip to step 3 where it actually sets up the topics to query via Presto

    kafka-tpch load creates new topics with the specified prefix