Page 1 of 1

CloverETL Engine, graph edges

Posted: Thu Dec 13, 2018 6:54 pm
by rifttech
Hello.
Is there any way to get set of data records that passing through edge between component when the graph is executing, like in clover designer, without code instrumentation?

Re: CloverETL Engine, graph edges

Posted: Wed Jan 09, 2019 11:32 am
by jandikovae
Hi,

This functionality in the Designer is called "debug mode" and it is set to "true" by default in case you run the graph from the Designer. If you want the debug data to be saved even though you have not started the graph directly from the Designer, you have to set a property debug_mode to "true" explicitly.

In the Server console, this can be handled by using configuration properties available for a job or the whole sandbox (see Job Config Properties chapter in the documentation).

The data are then stored by default in <java.io.tmpdir>/clover_temp_node01 directory in the folder named after Run ID (the exact path can be viewed and updated in the Server console -> Configuration -> Temp Spaces). Or you can review the data back in the Designer by connecting to the specified Run ID:

connecttojob.PNG
connecttojob.PNG (17.25 KiB) Viewed 16 times


Have a nice day, Eva