Search code examples
hiveapache-kafkahdfsorc

Writting events from kafka to Hive with ORC format


I am trying to use a kafka connector to writte data in Hive with OCR format from a Kafka bus.

The events in the bus are in avro format. I need somethig like this ConvertAvroToORC for NiFi but with Kafka Connectors


Solution

  • It has been released io.confluent.connect.hdfs.orc.OrcFormat included in the HDFS connector io.confluent.connect.hdfs.HdfsSinkConnector https://docs.confluent.io/current/connect/kafka-connect-hdfs/configuration_options.html#hdfs-2-sink-connector-configuration-properties