Loading complete text file content, store filename

CloverDX Platform
1

I need to load the content of all files in a directory. These files are non-delimited raw text files. I need to store the content of each file in one single cell of a table.
Additionally I need to store the source file name for each file in a second column in the same row.

The output would look similar to this:

----------------------------------------------------------------
|This is the content of \n the first file | /path/to/file1.txt |
----------------------------------------------------------------
|This is the \n content of the second one | /path/to/file2.txt |
----------------------------------------------------------------
|......                                   |.....               |

Is there a way to accomplish this in CloverETL? Can I use the UniversalDataReader?

Thanks a lot!
Greetings
Al

2

Hi Al,

Yes, UniversalDataReader will do the work. To read whole content in one field, you might want to choose end of file as delimiter:

1. Metadata editor.
2. Remove records and field delimiter.
3. Click on the first row in the left panel.
4. Scroll down in the Details panel to Advanced properties.
5. Set “EOF as delimiter” to true.

autofill.jpg

3

Very nice! That does the trick! Thank you a lot!

Greetings Al