Merging flows from different csv files

CloverDX Platform
1

Hi I’m trying to merge flows from different CSV files that look like this…

CSV_A
-----

Titles: Foo, Bar, Baz, Etch, Meh
Rows: 1, , , , 6

CSV_B
-----

Titles: Foo, Bar, Baz, Etch, Meh
ROws: 1, 2, ,4, ,

CSV_C
-----

Titles: Foo, Bar, Baz, Etch, Meh
Rows, 1, , 3, , 5,

Desired Output

Titles: Foo, Bar, Baz, Etch, Meh
Rows: 1, 2, 3, 4, 5, 6

How would one go about this with Clover? What component or component(s) to use?

Thanks,

Rasputin.

2

Hello,
I see two scenarios to achieve the aim:

  • DataReader → ExtSort → Denormalizer - Data Reader reads all the files using wild-cards, if the key doesn’t exist it can be created by source_row_count auto filling function

  • Data Readers ==> MergeJoin - each reader reads its own file, key can be also generated by source_row_count or global_row_count auto filling function

3

Right on! Went with the denormalize option.

CloverETL is so righteous…!!! :slight_smile: