Update visual Query to support input__file__name when processing from flat files
Description
the data transformation feed allows input_file_name to be used when transforming from hive. The visual query also needs to be updated to support this from a file based ingest.
Environment
None
Activity
Show:
Greg Hart
June 28, 2018, 5:14 PM
, do you have an example of when you use this? How does this compare to the current input_file_name() function in Data Transformation?
Mike Merritt-Holmes
June 29, 2018, 10:05 AM
basically the current input_file_name() doesn't work if the source is not hive. So for instance when the XML ingest template is used this function doesn't work as we are getting the record from elsewhere (say a file on the file system or from s3)
Assignee
Unassigned
Reporter
Mike Merritt-Holmes
Labels
None
Reviewer
None
Story point estimate
None
Sprint
None
Priority
Configure