Thrift Connection Pool incorrectly merges hive properties with each execution

Description

The issue is that MergeTable gets a connection from a connection pool, and then assumes it is safe to set hive properties on the connection's session. With enough runs of many connected processors, this would create a merge of the properties from all processors in the connection.

In MergeTable.java line 191, onTrigger() method (407ee9246f68):

In TableMergeSyncSupport.java setHiveConf() method:

Environment

None

Activity

Show:
Scott Reisdorf
October 27, 2017, 1:58 PM

we now support reset in the MergeTable.
Another enhancement would be to add this reset to the Thrift Service itself to ensure every user gets sessions reset upon getting the connection.

Scott Reisdorf
October 27, 2017, 1:59 PM

Add property in controller service to 'reset' hive session upon new connection

Done

Assignee

Scott Reisdorf

Reporter

Tim Harsch

Labels

None

Reviewer

None

Story point estimate

None

Components

Sprint

None

Fix versions

Affects versions

Priority

Medium