Search found 64 matches

by jandikovae
Tue Jul 27, 2021 12:47 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: How to do dynamic data profiling
Replies: 1
Views: 3411

Re: How to do dynamic data profiling

Hi there, The Aggregate component does not create metadata dynamically based on the function used for the given field. Unfortunately, you have to define those prior to using the component, therefore it is not a suitable component for some general purpose. Based on your question, however, I believe t...
by jandikovae
Fri Jul 02, 2021 2:58 pm
Forum: CloverDX Server
Topic: Linux soft link stopped working for ListFiles on CloverDX 5.11.0
Replies: 1
Views: 7316

Re: Linux soft link stopped working for ListFiles on CloverDX 5.11.0

Hi there, You are right. I could also see that the soft link is not working properly in 5.11 version. This only happens in case you are using it from the sandbox project structure. I have logged a ticket to our internal development tracking system and you can check the status at the following link: ...
by jandikovae
Mon Jun 14, 2021 9:55 am
Forum: CloverDX (formerly CloverETL) Support
Topic: MysqlBulkWriter issue with multiline DB column
Replies: 2
Views: 3719

Re: MysqlBulkWriter issue with multiline DB column

Hi there, You were right, your solution works like a charm. Let me just add to this topic, that in the replace function we might need to be aware of the right linefeed character based on the OS used. In my case, for example, I was working on a Windows machine and the linefeed is "\r\n" the...
by jandikovae
Wed May 26, 2021 9:15 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8579

Re: Pass Metadata and Filename as Parameter in Designer

Hi Paul, Your project is quite challenging and we don't have many options in case we would like to rely on the Designer only. I think it is safe to say, that you should keep the solution as it is right now (as long as it works with the "Algorithm" property). I am aware that the RunGraph co...
by jandikovae
Tue May 18, 2021 2:06 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: MySQLBulkWriter to return newly generated ids
Replies: 2
Views: 3946

Re: MySQLBulkWriter to return newly generated ids

Hi there, Although I am aware of the fact that you are mainly interested in the MySQLBulkWriter, I have realized that I have misled you regarding the usual DatabaseWriter. The function that you are describing is, in fact, available when writing to the database using the DatabaseWriter. Therefore in ...
by jandikovae
Thu May 13, 2021 6:56 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8579

Re: Pass Metadata and Filename as Parameter in Designer

Hi Paul, The Secure Parameter functionality is available only in the Server Environment. It requires setting the Master Password in the Server console and the Secure parameters are then automatically decrypted by the Server in graph runtime. Regarding your other issue, I would appreciate some detail...
by jandikovae
Mon May 10, 2021 11:07 am
Forum: CloverDX (formerly CloverETL) Support
Topic: MySQLBulkWriter to return newly generated ids
Replies: 2
Views: 3946

Re: MySQLBulkWriter to return newly generated ids

Hi, The way the MySQLBulkWriter and DatabaseWriter are designed, the components can only send to the output the values that have not been loaded correctly to the database. Also, as I understand your situation, the ID column here is being produced by the database itself (auto-increment field or so), ...
by jandikovae
Thu Apr 22, 2021 2:22 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: MySQLBulkWriter empty rows
Replies: 2
Views: 3903

Re: MySQLBulkWriter empty rows

Hi, From my perspective, I can't see any reason for the behavior you have described. In my testing graph (attached), I am generating 713 records, loading them to my local database using MySQLBulkWriter and I can see in the database that there is the same number of records then. Therefore I believe t...
by jandikovae
Tue Mar 16, 2021 2:34 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Using the Json writer to create a Json for each record
Replies: 2
Views: 4060

Re: Using the Json writer to create a Json for each record

Hi there, I believe that you can indeed achieve your goal by using the JSONWriter component. The component, however, assumes that it is intended to create one JSON file from all records (from the whole data flow). In order to tell the component that you need one result for each row, you might want t...
by jandikovae
Tue Mar 02, 2021 10:27 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Using Field Locations Instead of Field Name In The Pivot Component
Replies: 1
Views: 3706

Re: Using Field Locations Instead of Field Name In The Pivot Component

Hi, I believe that the most straightforward solution in a situation like this is to use a Reformat component ahead of the Pivot transformation process. I mean, the Reformat component can be also used to arrange metadata to the desired order: you can define metadata before Reformat and after Reformat...
by jandikovae
Mon Jan 25, 2021 9:34 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Custom Java Components - Accessing Workspace Directory
Replies: 2
Views: 4045

Re: Custom Java Components - Accessing Workspace Directory

Hi Paul, Yes, the SANDBOX_ROOT parameter is exactly what I would suggest in your case. You can find the list of parameters on the following page: https://doc.cloverdx.com/latest/server/graph-parameters.html Please don't get confused by the fact that this documentation page points to the Server relat...
by jandikovae
Thu Nov 19, 2020 1:19 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: BufferUnderflowException while transforming json data
Replies: 1
Views: 3991

Re: BufferUnderflowException while transforming json data

Hi, This seems to be an already discovered data issue that has been dealt with in newer versions of CloverDX. However, the improvement has been released with version 5.6.1 and this version doesn't come with the Open Source engine anymore. If you are interested in testing your data on the newer versi...
by jandikovae
Mon Nov 16, 2020 11:38 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: How Do I Return Text at the End of a String?
Replies: 1
Views: 3905

Re: How Do I Return Text at the End of a String?

Hi, When dealing with string fields, you might want to take a look at String Functions in the Documentation. In a situation like yours, I prefer the function called SPLIT. The split() function splits a string from the first argument, based on a regular expression given as the second argument (the fu...
by jandikovae
Sun Nov 08, 2020 12:22 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Logging to external syslog server
Replies: 1
Views: 4025

Re: Logging to external syslog server

Hi Morris, In fact, the CloverDX is already using the log4j2 apache logging platform. Therefore, the Designer is by default using the original log4j2.xml file stored on the workspace level. In order to use a customized version, you have to tell the system to use a different configuration file instea...
by jandikovae
Fri Oct 23, 2020 1:24 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Graph name as Parameter in Designer
Replies: 3
Views: 4623

Re: Graph name as Parameter in Designer

Hi Paul, The parameters available are indeed listed in the documentation ( https://doc.cloverdx.com/latest/server/graph-parameters.html ). However, please don't get confused that the link is from Server-related documentation. These parameters are used in the Designer runtime as well. You might have ...

cron