Some instances have been observed where Kylo cannot determine the spark version and the error returned 'Failed to start system Spark Shell process
java.lang.IllegalStateException: Unable to determine Spark version. Set the app resource explicitly.' is too generic. This can be alleviated some by setting log level to debug, so that the result from executing `spark-submit --version` can be seen.
Problems that led to the issue:
1) incorrect javaHome
2) sparkHome containing spaces (invisible)
3) stack traces thrown in start up fool parsing
To ease the burden on the user of figuring out what is wrong:
if sparkVersion cannot be determined log, at the error level, pertinent env, quoted values of properties used and output of executing spark-submit