reference to hive-hcatalog-core.jar, in Validate and Split records processor, is specific to HortonWorks

Description

The standard ingest template was changed as part of to include a reference to "/usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar" in the Validate and Split records processor. The jar reference is specific to Hortornworks configuration, and is not found when using other distributions.

Something should be documented about the issue to help the community.

One solution to the problem may be to locate the jar with the help of a property.

Environment

None

Activity

Show:
Jeremy Merrifield
April 3, 2017, 2:59 PM

I think having the externalized config now will address this issue. If we want we can provide an example for each environment in the application.properties file and comment them out. If not it shouldn't be an issue for someone to find the file.

Tim Harsch
March 27, 2017, 5:53 PM

a commit was done for to expose extraJars via a config property in application.properties. It may be enough to address this issue and should be looked at to verify it as a solution.

Note that EMR has the needed jar at the location: /usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-2.1.1-amzn-0.jar

Scott Reisdorf
March 27, 2017, 4:58 PM

Reassigning to Jeremy as I think he started this already

Done

Assignee

Jeremy Merrifield

Reporter

Tim Harsch

Labels

None

Reviewer

None

Story point estimate

None

Sprint

None

Fix versions

Priority

High