Validator throws error on getting a storage level parameter

Description

The validator allows a command line parameter to specify the RDD persistence level. When this parameter is provided, an error is being thrown:

com.beust.jcommander.ParameterException: Unkown option: --storageLevel=MEMORY_ONLY

Identify the cause and fix.

Environment

None

Activity

Show:
Jagrut Sharma
April 5, 2017, 8:13 PM
Jagrut Sharma
April 5, 2017, 7:41 PM

To specify storage level for Validate and cleanse step in the standard ingest flow, perform these steps:
1) Stop the Validate And Split Records processor

2) Add two arguments to the MainArgs property
<existing arguments>,--storageLevel,your_value

3) Start the Validate And Split Records processor

Now, all the feeds using the standard ingest flow will use the specified persistence level for the Validator.

Done

Assignee

Jagrut Sharma

Reporter

Jagrut Sharma

Labels

None

Reviewer

None

Story point estimate

None

Sprint

None

Fix versions

Priority

High