Search code examples
javamavenapache-flinkflink-sql

In which package is Flink DataGen SQL Connector

In which Maven package is Flink DataGen SQL Connector?

I often find examples like this one with an import statement but it's not specified anywhere in which package, in this particular case searching Maven or search engines didn't yield a result either.

Here is a picture of the error that I get: Cannot resolve symbol datagen

Flink packages in pom.xml are:

flink-java
flink-streaming-java_${scala.binary.version}
flink-clients_${scala.binary.version}
flink-statebackend-rocksdb_2.11
flink-table-api-java
flink-sql-client_2.11
flink-test-utils_2.11

I also tried including:

flink-connector-base
flink-connector-jdbc_2.12
flink-connector-kafka-base_2.11

But it still can't resolve the import and TableDescriptor.forConnector.

Solution

  • Had to do some digging but I found the docs for doing it in a way that works with the version that I have: https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/connectors/table/datagen/

    CREATE TEMPORARY TABLE GenOrders
WITH (
    'connector' = 'datagen',
    'number-of-rows' = '10'
)
LIKE ...

    I'm sorry that I didn't mention the Flink version but it is 1.13.