I would like to use Azkaban for periodic Hive jobs, I have looked through Azkaban documentation, and it seems like by default it doesn't support Hive jobs, do you know how can I use these two together?
I think, I'll have to run Hive jobs as a "command job" available in Azkaban, but maybe someone has worked it out.
I was using Oozie for some time, but It didn't meet my needs.
Thanks.
Right now we don't have an easy way. You can certainly hack into the HiveCliDriver and do it from there, but it's suboptimal... Alternatively, just run it as a command line job. We're using a different system at LI. I hope to add this ability pretty quickly, but not sure when I'll have the chance.