Search found 26 matches

by kasturi
Wed Aug 22, 2012 3:07 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: universal data writer character set
Replies: 2
Views: 3129

universal data writer character set

Hi, I am using universal data writer to create files for exporting to another system. The charater set is the default ISO 8859-1. My graph failed because it could not translate a russian name Лара. What character set should I use so that it can properly read that and create the csv file. Thanks, Kas...
by kasturi
Wed Jul 11, 2012 2:09 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Reading url from email subject
Replies: 1
Views: 2408

Reading url from email subject

I have a scheduled job that runs and sends a report via email. However, the email body contains the link not the actual attachment. I have to click the link to go to the page and download the file to save it to a specific folder and read the file. Is there a way to do this using clover? I need to au...
by kasturi
Wed Jul 11, 2012 2:04 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: How to make a graph fail?
Replies: 2
Views: 3441

Re: How to make a graph fail?

Thanks. It worked .
by kasturi
Fri Jun 08, 2012 3:16 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: How to make a graph fail?
Replies: 2
Views: 3441

How to make a graph fail?

I have a graph that tries to add records in a table where the columns are not null. Null value makes it fail but not null records already got inserted. I don't want that. I would like to have a graph that checks the existence of the values and if there is at least one null value is there, the graph ...
by kasturi
Wed Apr 18, 2012 4:28 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: running a bash script using system execute
Replies: 1
Views: 2484

running a bash script using system execute

I need to run a bash script from clover. The script looks like this #!/bin/bash rm S_D_85252592_*.txt rm S_D_85252592_*.txt.gz java Autoingestion userid password 85252592 Sales Daily Summary gunzip S_D_85252592_*.txt.gz cp S_D_85252592*.txt download.txt.copy mv /download.txt.copy /home/mypub/sandbox...
by kasturi
Mon Apr 02, 2012 6:15 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Dynamically chage the name of the input file.
Replies: 1
Views: 2388

Dynamically chage the name of the input file.

I am trying to read a file from data-in directory and process the data to insert into a table. The files comes from an external vendor and it has a yyyyDDMM at the end of the file. The first 6 letters of the file name will always remain the same, only the last part where it adds the date. How do I d...
by kasturi
Mon Dec 19, 2011 8:44 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: normalizer
Replies: 3
Views: 3381

Re: normalizer

Hi Jan,
Thank you so much for the help. I really appreciate it. It worked . I added the types also along with the values. It woks perfectly.
Thanks again.
Kasturi
by kasturi
Fri Dec 16, 2011 9:57 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: normalizer
Replies: 3
Views: 3381

normalizer

I have a source table that has flattened data fields which I need to store in a normalized table. I have a record which looks like this date,event_id,field1,field2,field3,session,token For each row, date, event_id and session,token are populated but field1 and field2 and field 3 may not be populated...
by kasturi
Tue Nov 22, 2011 4:40 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: dealing with duplicate records.
Replies: 1
Views: 2514

dealing with duplicate records.

I am working with large amount of data ( web data). When I load into fact table, I would like to check if the row is already there before I insert. I use incremental load so there is no chance of having duplicates. Only when the graph fails for some other reason and I need to rerun , I should be abl...
by kasturi
Tue Nov 22, 2011 4:34 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: dbjoin
Replies: 2
Views: 2852

Re: dbjoin

Thank you for your reply. Here is the graph.

For the initial load, rows were about 3 million.

It is not bad for incremental load. I take the max(event_id) from the fact and get the records which are >max(event_id) .

Thanks,
Kasturi
by kasturi
Tue Nov 15, 2011 11:17 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: dbjoin
Replies: 2
Views: 2852

dbjoin

I am trying to use dbjoin instead of incremental file in one oof my graphs. I am selecting max(event_id) from the fact table ( where I am storing the source event_id) in DBINPUT transformation and passing that through the metadata to DBJOIN transformation. DBJoin is selecting rows from the source da...
by kasturi
Tue Aug 09, 2011 9:37 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: incremental file
Replies: 1
Views: 2093

incremental file

Hello Agata, Incremental key is working fine for most of my graphs with the exception of one scenario. I am getting this error Mixing of GROUP columns (MIN(),MAX(),COUNT(),...) with no GROUP columns is illegal if there is no GROUP BY clause when I try to use the incremental key in this sql SELECT lo...
by kasturi
Thu Jul 28, 2011 9:29 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Error capture in clover etl
Replies: 1
Views: 2504

Error capture in clover etl

Hello Agata, I am using 'Data intersecion' to check whether the records are new or existing in table. I am getting error in update because of the violation of key constraint. I want the process to continue and store the rejected records in a file. I am trying the output port but the process fails be...
by kasturi
Thu Jul 28, 2011 8:51 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: temp file error
Replies: 2
Views: 2882

Re: temp file error

Agata,
As always, thank you for your response. I really appreciate it.
Regards,
Kasturi
by kasturi
Tue Jul 26, 2011 4:04 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: temp file error
Replies: 2
Views: 2882

temp file error

I am trying to run a graph simply to extarct three columns from a table in MySql. The table has little over 4 million rows. I am getting this error. If I limit in 100000

Error writing file '/tmp/MYfS3dok' (Errcode: 28).

Thanks,
Kasturi