CloverETL is now CloverDX - Learn Why

CloverETL Engine, graph edges

Discussion on developing CloverDX engine, transformation components etc.

rifttech
Posts: 1
Joined: Thu Dec 13, 2018 6:30 pm

CloverETL Engine, graph edges

Postby rifttech » Thu Dec 13, 2018 6:54 pm

Hello.
Is there any way to get set of data records that passing through edge between component when the graph is executing, like in clover designer, without code instrumentation?

jandikovae
Posts: 41
Joined: Fri Nov 04, 2016 8:51 am

Re: CloverETL Engine, graph edges

Postby jandikovae » Wed Jan 09, 2019 11:32 am

Hi,

This functionality in the Designer is called "debug mode" and it is set to "true" by default in case you run the graph from the Designer. If you want the debug data to be saved even though you have not started the graph directly from the Designer, you have to set a property debug_mode to "true" explicitly.

In the Server console, this can be handled by using configuration properties available for a job or the whole sandbox (see Job Config Properties chapter in the documentation).

The data are then stored by default in <java.io.tmpdir>/clover_temp_node01 directory in the folder named after Run ID (the exact path can be viewed and updated in the Server console -> Configuration -> Temp Spaces). Or you can review the data back in the Designer by connecting to the specified Run ID:

connecttojob.PNG
connecttojob.PNG (17.25 KiB) Viewed 19 times


Have a nice day, Eva
---
Eva Jandikova
CloverCARE Support
CloverDX

Visit us online at http://www.cloverdx.com