NEWBIE End of Line Characters NL vs CR vs CRLF

CloverDX Platform
1

Greetings,

I am new to Clover ETL. I am learning the Endeca version. I am trying a simple graph consisting of universal reader, an edge and trash. I have created three data files, all the same data except for the line termination character. Line Feed (\n), Carriage Return (\r) and Carriage Return Line feed (\r\n). All I’m am trying to do is read file to trash. CRLF works, however LF or CR does not. Once I figure out what is wrong with the way I am doing this, I will apply the method to the real file of some 45G of data. This file contains three record types and terminates in LF. I have preprocessed this file in C and Perl but would like to use the “one tool” approach and do everything via CloverEtl.

Any suggestions would greatly reduce my current ignorance!!!

Thanks in advance
Jerry Coppa

BTW: I’m a seasoned programmer learning a new tool.

2

Hi gcoppa

You can set the delimiter for every field in a record as well as for the record itself, by editing its metadata. If you wan to change the record (line) delimiter just open the metadata editor by double-clicking the appropriate metadata item in the Outline window and select the desired record delimiter. Please see the picture below for more detail.

delimiter.png

Hope this helps