Update visual Query to support input__file__name when processing from flat files

Description

the data transformation feed allows input_file_name to be used when transforming from hive. The visual query also needs to be updated to support this from a file based ingest.

Environment

None

Activity

Show:
Greg Hart
June 28, 2018, 5:14 PM

, do you have an example of when you use this? How does this compare to the current input_file_name() function in Data Transformation?

Mike Merritt-Holmes
June 29, 2018, 10:05 AM

basically the current input_file_name() doesn't work if the source is not hive. So for instance when the XML ingest template is used this function doesn't work as we are getting the record from elsewhere (say a file on the file system or from s3)

Assignee

Unassigned

Reporter

Mike Merritt-Holmes

Labels

None

Reviewer

None

Story point estimate

None

Sprint

None

Priority

High
Configure