Search code examples
hadoophiveflume

How to use flume creating a task to load data from HDFS to HIVE automatic by time?


I need to load data from hadoop to hive automatic, but I don't wanna setup an other service to do this thing. I already use flume to collect my logs...... So how should I do? Does flume can exec a command (a query for hive just like LOAD.....)?


Solution

  • You can rather have Flume to store the extracted data under Hive's table directory (typically /user/hive/warehouse/Your_Table_Dierctory). Nothing more needs to be done.