adam-submit Error: Number of executors must be a positive number on EMR 5.13.0/Spark 2.3.0

[heuermh]

$ adam-submit --version
Using ADAM_MAIN=org.bdgenomics.adam.cli.ADAMMain
Using spark-submit=/usr/lib/spark/bin/spark-submit
Error: Number of executors must be a positive number

Something seems off with the default value for numExecutors

$ adam-submit --master yarn  --num-executors 2 --
Using ADAM_MAIN=org.bdgenomics.adam.cli.ADAMMain
Using spark-submit=/usr/lib/spark/bin/spark-submit
18/05/24 15:52:03 INFO ADAMMain: ADAM invoked with args:

       e        888~-_         e            e    e
      d8b       888   \       d8b          d8b  d8b
     /Y88b      888    |     /Y88b        d888bdY88b
    /  Y88b     888    |    /  Y88b      / Y88Y Y888b
   /____Y88b    888   /    /____Y88b    /   YY   Y888b
  /      Y88b   888_-~    /      Y88b  /          Y888b

Usage: adam-submit [<spark-args> --] <adam-args>

...

$ adam-submit --master yarn --conf spark.executor.instances=2 --
Using ADAM_MAIN=org.bdgenomics.adam.cli.ADAMMain
Using spark-submit=/usr/lib/spark/bin/spark-submit
18/05/24 15:52:25 INFO ADAMMain: ADAM invoked with args:

       e        888~-_         e            e    e
      d8b       888   \       d8b          d8b  d8b
     /Y88b      888    |     /Y88b        d888bdY88b
    /  Y88b     888    |    /  Y88b      / Y88Y Y888b
   /____Y88b    888   /    /____Y88b    /   YY   Y888b
  /      Y88b   888_-~    /      Y88b  /          Y888b

Usage: adam-submit [<spark-args> --] <adam-args>
...

[fnothaft]

This isn't an ADAM issue, no? This would be a Spark issue.

[heuermh]

spark-submit worked fine in that environment, I'll have to test locally with 2.3.0 and 2.3.1 to see if I can replicate.

[heuermh]

Cannot replicate anywhere but on EMR, there must be something off with their Spark installation or default Spark configuration.