Oozie Shell action Output data exceeds its limit [2048]

I have shell script like below

ssh  -q -v -i id_rsa -o "StrictHostKeyChecking no" user@remotemachine script > file

hdfs dfs -put -f file hdfspath

When I run this script in oozie shell action with "", file is copied from remote machine to my machine. Actually its more than 2kb file. But when i move it to hdfs using (hdfs dfs -put) command Its thrwing below error

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), Output data exceeds its limit [2048] org.apache.oozie.action.hadoop.LauncherException: Output data exceeds its limit [2048]

Solution

Add the below in the shell action or put it in /etc/oozie/conf/oozie-site.xml and restart the oozie server. This will increase the console output data that can be captured as part of the shell action tag <capture-output/>. The default is 2048 which is Max size in characters for output data.

 <configuration>             
  <property>
    <name>oozie.action.max.output.data</name>
    <value>8192</value>
  </property>        
</configuration>

The <capture-output/> is not required if you not using the console output from the shell action for any decisions in next action. Try just by removing the tag <capture-output/> if not required.