Search code examples
hadoopsqoopsqoop2

Sqoop: --as-parquetfile is not working


i want save sqoop files as parquet file directly to hdfs. i am trying below command to do so. but facing ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException

sqoop version - 1.4.7

sqoop import --options-file /home/user/optionsfile.txt --query "select * from table where \$CONDITIONS" --target-dir 'hdfs:///user/x/sqoop1' --as-parquetfile -m 1;

when i try same sqoop command without --as-parquetfile job is executing successfully


Solution

  • As this is an open bug in sqoop i would like you to suggest that first import the data into a temporary hive table in text format and then insert into another hive table which is in parquete format.