Is there a way to use flume to transmit my Oracle 11g Database data to HDFS? I know flume is made for logs and Sqoop should be use to transmit data from Database. But is there a way to use flume instead of Sqoop? What should I do if I want to use this kind of architecture?
The other way to do is For the present data in oracle you can run sqoop and for the subsequent changes you can use Linked in databus for change data capture(CDC) which can post messages to Kafka. Messages from kafka can be easily consumed by Flume.