reasons for failing to determine spark-version should be more specific and helpful

Description

Some instances have been observed where Kylo cannot determine the spark version and the error returned 'Failed to start system Spark Shell process
java.lang.IllegalStateException: Unable to determine Spark version. Set the app resource explicitly.' is too generic. This can be alleviated some by setting log level to debug, so that the result from executing `spark-submit --version` can be seen.

Problems that led to the issue:
1) incorrect javaHome
2) sparkHome containing spaces (invisible)
3) stack traces thrown in start up fool parsing

To ease the burden on the user of figuring out what is wrong:
if sparkVersion cannot be determined log, at the error level, pertinent env, quoted values of properties used and output of executing spark-submit

Environment

None

Assignee

Unassigned

Reporter

Tim Harsch

Labels

None

Reviewer

None

Story point estimate

None

Components

Affects versions

Priority

Medium
Configure