spark shell should append to classpath defined in spark configs, instead of overriding

Description

the spark shell currently overrides any spark.driver.extraClassPath set in a config file because it specifies a --driver-class-path on the command line to spark submit. Cluster environments may need to specify additional jars, and the spark.driver.extraClassPath should not be overridden but rather prepended to.

Activity

Show:
Done

Assignee

Tim Harsch

Reporter

Tim Harsch

Labels

None

Reviewer

None

Components

Sprint

None

Fix versions

Priority

Medium