Search code examples
javamavenapache-sparkbuildmaven-plugin

Maven exec plugin passing arguments to external executable


I am trying to configure my app to work with mvn package exec:exec only.

What I want is to build .jar and submit it to an external binary, I can do that manually after mvn package, but I want it to be automatic. I think that maven exec plugin is the way to go.

My current configuration is:

<plugin>
  <groupId>org.codehaus.mojo</groupId>
  <artifactId>exec-maven-plugin</artifactId>
  <version>1.4.0</version>
  <executions>
    <execution>
      <goals>
        <goal>exec</goal>
      </goals>
    </execution>
  </executions>
  <configuration>
    <executable>
      /bin/spark-submit
    </executable>
    <arguments>
      <argument>
         --class "package.Class" --master "local[4]" ${project.build.directory}/${project.build.finalName}.${packaging}                 
      </argument>
    </arguments>
  </configuration>
</plugin>

What this does is it executes (from maven DEBUG info):

/bin/spark-submit, --class "package.Class" --master "local[4]" myApp.jar

I think the problem si that the arguments are meant to be passed to a java executable, so they are divided by commas, which I do not want when executing shell command.

Another thing I have tried was to split the arguments:

<arguments>
  <argument>--class "package.Class"</argument>
  <argument>--master "local[4]"</argument>
  <argument>${project.build.directory}/${project.build.finalName}.${packaging}</argument>
</arguments>

which executes:

/bin/spark-submit, --class "package.Class", --master "local[4]", myApp.jar

(more commas, not what I want either)

I want maven to execute:

/bin/spark-submit --class "package.Class" --master "local[4]" myApp.jar

I hope what I want can be done using maven exec plugin and my problem can be well understood. I would greatly appreciate any help you can give me.


Solution

  • I found that there is an optional configuration parameter <commandlineArgs> which does exactly what I need.

    So the correct configuration for me is:

    ...
    <configuration>
      <executable>
        /bin/spark-submit
      </executable>
      <commandlineArgs>
        --class "package.Class" --master "local[4]" ${project.build.directory}/${project.build.finalName}.${packaging}
      </commandlineArgs>
    </configuration>
    ...