Kylo UI can't render Hive table correctly due to embedded new line

Description

We deployed Kylo 0.7.1 on on Cloudera cluster and successfully ingested some data set from customer, however when open the Kylo UI, the Table page in "Feed Manager", in preview, the data can't be displayed correctly. However, same Hive table can be displayed correctly in Squirrel SQL Client, so we believe the data in Hive table is correct.
We suspect that this is due to there are embedded new line in one of the column "CODE" in some of rows. Further trouble shooting required to confirm this.

For further information, please contact Keven.Wang@thinkbiganalytics.com

Environment

Kylo 0.7.1 on Cloudera cluster

Activity

Show:
Scott Reisdorf
May 23, 2017, 11:10 PM

The issue appears to be with how Kylo's JDBC interface is working.
We do a inner query which appears to be affecting the results.

This query
SELECT * FROM `system`.`parquet2` limit 15

will result in:

SELECT kylo_.* FROM (SELECT * FROM `system`.`parquet2` limit 15) kylo_ LIMIT 1000;

That causes issues and can be seen both in the hive client and in Kylo.

Still investigating.

Keven Wang
May 24, 2017, 1:03 AM

great to see the status of this case is done, so when can we expect a delivery? We had some difficult today to decide if we shall upgrade to kylo 0.8.0.1 for some important bug fixes which are required for one customised kylo/nifi template. Shall make a decision tonight, so will you be able to make a fix on either kylo 0.7.1 or 0.8.0.1? Thank you very much!

Keven Wang
May 25, 2017, 10:05 PM

I have some new finding today. With the latest fix, it works with preview page also when you execute SQL select statement without where clause. For example if i execute "SELECT * FROM xxx WHERE xxxxx", then the result is again messed up. Is it the same in your env?

BR/Keven

Scott Reisdorf
May 27, 2017, 2:09 AM

I cannot reproduce your issue.
Queries with/without the where clause all work.

What where clause are you trying?

I tried your sample file with numerous where clauses and all seem to be fine.

Keven Wang
May 29, 2017, 9:42 PM

, I just did "SELECT * FROM use_case_two.demo jewelbox_ingest WHERE CODE IS NOT NULL", then the result is displayed incorrectly. I start to fully work in another project from today and my work has been handovered to and . Thank you!

BR/Keven

Done

Assignee

Scott Reisdorf

Reporter

Keven Wang

Labels

Reviewer

None

Story point estimate

None

Components

Sprint

None

Fix versions

Priority

Highest