Search found 6 matches

by Bea95
Fri Jul 09, 2021 4:06 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: How to do dynamic data profiling
Replies: 1
Views: 3055

How to do dynamic data profiling

Hi I am trying to make a more general purpose data profiling graph that get the Sum, Count, Distinct Count,Null,Not null, Min Value Max Value,Min Lengh,Max Lengh for each field that is present in the metadata. We have managed to dynamically generate the metadata for the input files but can't find a ...
by Bea95
Mon May 17, 2021 2:45 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Passing message content to graph when using the Kafka Event Listener
Replies: 1
Views: 3137

Passing message content to graph when using the Kafka Event Listener

Hi there I'm trying to create a workflow that is triggered when a message is written to a kakfa topic and depending whether an id is present in the message, run the rest of the graph. When using the Kafka event listener, is it possible to also pass the message that triggered the event to the graph a...
by Bea95
Fri May 14, 2021 10:14 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Errors When Reading From Kafka Topics
Replies: 1
Views: 3172

Errors When Reading From Kafka Topics

Hi there, I have been trying to use both the Kafka event listener in the server and the Kafka reader in the designer to read from some Kafka topics. It works well for reading from some of the topics but for others I get errors like this Received exception when fetching the next record from <Kafka-To...
by Bea95
Thu May 06, 2021 4:37 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Best way to merge records with a common field into a list
Replies: 1
Views: 3048

Best way to merge records with a common field into a list

Hi there, I have some data that looks like this where there are duplicate values in field 1 and different values in field 2. Field_1 Field_2 95791982 4558330929 95791982 6811305815 95791982 2077056935 75612428 7349717965 75612428 9718912488 75612428 7376005892 Would be very grateful if someone could...
by Bea95
Tue Mar 16, 2021 3:40 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Using the Json writer to create a Json for each record
Replies: 2
Views: 3699

Re: Using the Json writer to create a Json for each record

Hi there, I believe that you can indeed achieve your goal by using the JSONWriter component. The component, however, assumes that it is intended to create one JSON file from all records (from the whole data flow). In order to tell the component that you need one result for each row, you might want ...
by Bea95
Mon Mar 15, 2021 5:03 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Using the Json writer to create a Json for each record
Replies: 2
Views: 3699

Using the Json writer to create a Json for each record

Hi there, Is there a way to loop the Json Writer so it creates a json structure for each input record that is passed to it? I want to create multiple Jsons as an input to the HTTP connector so I can send a request for each each record. So far I have been able to do it by manually creating the Json s...

cron