Search found 192 matches

by slechtaj
Fri Nov 20, 2015 8:29 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Preprocessing a file to remove invalid characters
Replies: 3
Views: 3372

Re: Preprocessing a file to remove invalid characters

Hi Phil, You have basically two options: ⋅ First is what you have already mentioned - parsing the record manually using the Reformat transformation. ⋅ The second option, which is from my point of view better solution, is sending the cleaned records to UniversalDataReader directly...
by slechtaj
Thu Nov 19, 2015 11:40 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Automatic rownumber with reset on field
Replies: 1
Views: 2023

Re: Automatic rownumber with reset on field

Hi Daniel, There are multiple ways to do this. ⋅ If the your data is sorted you can use a simple CTL transformation that will assign the sequence numbers to records - you do not even need to use Clover sequences as this could be simply handled by simple integer variables. ⋅ If yo...
by slechtaj
Wed Nov 18, 2015 5:35 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Preprocessing a file to remove invalid characters
Replies: 3
Views: 3372

Re: Preprocessing a file to remove invalid characters

Hi Phil, What you can do is to read the whole records into one field and then parse the record in another component (Reformat). In other words, the output edge connected to the reader should contain just one field (the whole record with field delimiters). The process might look like as follows: &sdo...
by slechtaj
Mon Nov 16, 2015 10:40 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: XML Extract Datamapping Issues.
Replies: 12
Views: 8884

Re: XML Extract Datamapping Issues.

Hi Siddhant, I assume the issue is caused by the fact you use auto-mapping in your XMLExtract mapping. Auto-mapping maps the fields (no matter if it's element or attribute) to output metadata fields with the same name. All you need to do is to turn off the auto mapping and map the elements and attri...
by slechtaj
Tue Sep 22, 2015 10:09 am
Forum: CloverDX Server
Topic: troubleshooting a postgresql JNDI connection
Replies: 4
Views: 5955

Re: troubleshooting a postgresql JNDI connection

I have already sent you the answer via email, but I will post the answer here as well for other users. First of all I would definitely use Redshift JDBC driver instead of PostgreSQL, although it should work in most cases. You can find the Redshift drivers and further information about their usage in...
by slechtaj
Wed Sep 16, 2015 12:46 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: DBExecute graphs not working with JNDI connections
Replies: 2
Views: 2641

Re: DBExecute graphs not working with JNDI connections

Hi Ramiro,

Is this the same issue as troubleshooting a postgresql JNDI connection, or is there another context in this case?
by slechtaj
Tue Sep 15, 2015 4:24 pm
Forum: CloverDX Server
Topic: troubleshooting a postgresql JNDI connection
Replies: 4
Views: 5955

Re: troubleshooting a postgresql JNDI connection

Hi Ramiro, What kind of statements are you running? Can you share the graph and the whole log with us (ideally in debug log level)? In general for DML statement you should use DBInputTable / DBOutputTable. However, this does not apply to Redshift, since another process is recommended – see our blog ...
by slechtaj
Mon Sep 07, 2015 1:25 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Error Creating Hadoop Connection
Replies: 3
Views: 3278

Re: Error Creating Hadoop Connection

Hi Virag,

You can download CDH 4.1.2 from here. Make sure you use all the required libraries mentioned in our documentation.
by slechtaj
Tue Sep 01, 2015 3:44 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: create Password protected excel sheet
Replies: 1
Views: 1742

Re: create Password protected excel sheet

Hi,

Unfortunately password protected files are not supported so far (in the latest production version 4.0.7). However, I have created a new ticket for this improvement: https://bug.javlin.eu/browse/CLO-7180
by slechtaj
Mon Aug 17, 2015 5:32 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Newbie 'Replace' Question
Replies: 4
Views: 3099

Re: Newbie 'Replace' Question

Hi Dave, I think that Lubos wanted to take a look at the GRF file (or even better the whole project including the source CSV file). To me, it doesn't seem there is actually a problem with the replace function. The thing is the issue might have been caused by several other reasons. In order to find t...
by slechtaj
Fri Aug 07, 2015 3:53 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: ExtMergeJoin proble;
Replies: 1
Views: 1797

Re: ExtMergeJoin proble;

Hi Selrahc, I went through your task and I'm not sure I got the idea as it seems you want to use only one key to join three tables. That is strange actually, since it is not clear from it what address is supposed to be joined with a particular phone number. It appears to be joined using the only ID ...
by slechtaj
Fri Aug 07, 2015 3:37 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: System Execute to Move Files?
Replies: 5
Views: 4747

Re: System Execute to Move Files?

Hi Pintail, You can of course use SystemExecute to copy a file to another location. You should, however, keep in mind the Clover is not "in charge" of copying the data - it just invoke a system command (in your case cp, pscp etc.). An example of why you should rather use File Operations co...
by slechtaj
Fri Aug 07, 2015 3:27 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Gnip clover etl sample
Replies: 1
Views: 1928

Re: Gnip clover etl sample

Hi P, From what I've just learned from the Gnip API user guide, it does not return a "file" (or regular response with limited length) but a potentially endless stream of data. I'm afraid this won't be easy with the built-in components in Clover at this moment (ver. 4.0.6), since Clover doe...
by slechtaj
Wed Aug 05, 2015 3:52 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: UniversalDataWriter - Using Metadata Field-String as FIlename
Replies: 2
Views: 2446

Re: UniversalDataWriter - Using Metadata Field-String as FIlename

Hi Tocki, You can use partitioning feature of the UniversalDataWriter. Basically what you need to do is to: ⋅ Set Partition key attribute of the writer to the field you want to use in the filename ⋅ Next you need to define the Filer URL. To the place where the Partition key is su...
by slechtaj
Wed Aug 05, 2015 3:16 pm
Forum: CloverDX Server
Topic: Event Listener and Stop graph if runs to long
Replies: 1
Views: 3770

Re: Event Listener and Stop graph if runs to long

Hi Patrick, CloverETL Server comes with Graph Event Listeners that can easily handle this kind of tasks. The graph event monitored by the listener is called "graph_timeout" and can be used exactly the way you need - that means when a graph execution time reaches predefined limit the listen...

cron