I try to put a big number of messages (350M) to customer topic (source topic) with value format like this
10957402000||10965746672||2|2756561822|452048703649890|8984048701003649890
and then I make some streams and table on that topic, but the delimited format supported by ksql is just comma separator. I have some questions:
Thanks you.
Edit 26 February 2021 ksqlDB now supports configurable delimiters - use the VALUE_DELIMITER
(or KEY_DELIMITER
) configuration option. For example:
CREATE STREAM (COL1 INT, COL2 VARCHAR)
WITH (KAFKA_TOPIC='test', VALUE_FORMAT='DELIMITED', VALUE_DELIMITER='TAB')
Original answer:
Currently KSQL only supports comma-separated for DELIMITED
value format. So you'll need to use commas, or JSON, or Avro, for your source data.