I am new to CloverETL and we have a scenario that we are still not sure how to address it.
We have to upload to data on a weekly basis to a Oracle database.
Data is related to orders, which some of them can have status open the first week and have status closed the second week.
Currently, we are inserting records with the timestamp to prevent conflict with primary key.
One of the ideas that came up was to have one more box in CloverETL to purge duplicated records with old timestamp, but I am not quite sure if that is possible.
If it is possible, could someone guide me on how to accomplish this?