Search found 192 matches

by slechtaj
Mon Jul 27, 2015 3:32 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: In files with generic names, only one at a time
Replies: 14
Views: 8285

Re: In files with generic names, only one at a time

Hi Heather, That is actually the thing. The tiny file has to be uploaded by the same party right after the big file is uploaded. Let me give you an example: Using CloverETL we produce a large file that is written directly to a remote location. On the given location we expect to receive this file, bu...
by slechtaj
Fri Jul 17, 2015 10:51 am
Forum: CloverDX (formerly CloverETL) Support
Topic: In files with generic names, only one at a time
Replies: 14
Views: 8285

Re: In files with generic names, only one at a time

Hi Heather, The idea behind the trigger file is that the actual event is triggered not by the large file, but the tiny one. The tine file however, must be always created after the large file is fully loaded. It's just fine to add another (next) phase into a graph that loads data to FTP and in this p...
by slechtaj
Wed Jul 15, 2015 2:52 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Batch data read from XLSDataReader
Replies: 2
Views: 2570

Re: Batch data read from XLSDataReader

Hi Kalpana, There is no need to read data from the XLS file in batches (in fact nothing like that would solve your situation) - this can be simply done by using "Records per file" attribute (set to 5000 in your case) of JSONWriter, which tells the component to use that amount of incoming r...
by slechtaj
Wed Jul 15, 2015 12:41 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Reading and Writing to Cassandra Database
Replies: 3
Views: 5389

Re: Reading and Writing to Cassandra Database

Hi Bhavin, In order to work with Cassandra DB, you will just need to use external Cassandra JDBC driver, since the driver does not come with the Clover. After you get the driver, you may simply create a new DB connection and use it in standard DB componets (DBInputTable, DBOutputTable, DBExecute). H...
by slechtaj
Thu Jul 02, 2015 5:53 pm
Forum: CloverDX Server
Topic: File Event Listener
Replies: 1
Views: 3932

Re: File Event Listener

Hi, The most common reason why users do not have access to File Event Listeners is license limitation. File Event Listeners are available as part of the CloverETL Corporate server and Cluster. Therefore, if you have license for CloverETL Standard Server, File Event Listeners are not included. Differ...
by slechtaj
Tue Jun 30, 2015 4:36 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: if statement in trasformation of ExtMergeJoin
Replies: 1
Views: 2287

Re: if statement in trasformation of ExtMergeJoin

Hi, First of all you should keep in mind that mapping cannot be done in return statement, which is used for output port selection. Your example might look like this (of course I don't know your metadata on output port): function integer transform() { // If $in.1.Amt is null then put NULL into output...
by slechtaj
Thu Jun 18, 2015 3:03 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Incremental Data Load
Replies: 7
Views: 5569

Re: Incremental Data Load

Hi,

regarding your question on Slowly Changing Dimension, I have created a new thread in the Cookbook section that deals with this topic. The article describes an example of ETL processes with SCD Type 1 and Type 2 designs.

Hope this helps.
by slechtaj
Thu Jun 18, 2015 12:24 am
Forum: Cookbook
Topic: Data Warehouse – Slowly Changing Dimensions SCD (Type 1 vs Type 2)
Replies: 0
Views: 39426

Data Warehouse – Slowly Changing Dimensions SCD (Type 1 vs Type 2)

Data warehouse (DW) structure may differ depending on what Slowly Changing Dimension (SCD) model we choose. Among all SCD approaches there are two that are the most frequent: so called SCD type 1 and SCD type 2 . I will discuss how to implement these two SCD types from ETL perspective in CloverETL. ...
by slechtaj
Mon Apr 20, 2015 5:33 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Output with no metadata
Replies: 3
Views: 2896

Re: Output with no metadata

Hi Jason, DBExecute does not need to have any input / output port connected. Especially for TRUNCATE statements. I’m not familiar with the scenario you are working on but in general you do not need to have any edge between the DBExecute and another component. Of course SimpleCopy does not produce an...
by slechtaj
Tue Apr 14, 2015 2:51 pm
Forum: CloverDX Server
Topic: How do you export server configuration from 3.3.0.183M3?
Replies: 2
Views: 3704

Re: How do you export server configuration from 3.3.0.183M3?

Hi Jus, Unfortunately the configuration migration feature has been introduced in version 3.5 , so you will have to do this manually. Now, before you start the migration, note that your CloverETL Server is of milestone (M3 suffix) version and thus potential issues may occur during the migration proce...
by slechtaj
Thu Apr 09, 2015 5:54 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: TRUNCATE TABLE and Transactions
Replies: 1
Views: 2460

Re: TRUNCATE TABLE and Transactions

Hi Andrew, In order to wrap statements in DBExecute with DBOutputTable DML statements into one transaction, you will need to do the following: ⋅ Set threadSafeConnection attribute to false - in Database connection dialog go to Advanced tab and uncheck Thread-safe connection check-box. See ...
by slechtaj
Mon Mar 30, 2015 4:21 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: String Function
Replies: 3
Views: 4224

Re: String Function

Hi Perri, There are multiple ways how to do this. Basically it depends on the rest of your data. At first you might use the split function which can split the string into an array. So for example this function: myArray = split($in.0.yourString, "_"); will produce the following list (for th...
by slechtaj
Tue Mar 24, 2015 2:45 pm
Forum: CloverDX Server
Topic: Actual server path of project directories on Linux
Replies: 1
Views: 2882

Re: Actual server path of project directories on Linux

Hi,

You may use a CTL function toAbsolutePath().

Code: Select all

$out.0.yourOutputField = toAbsolutePath(getParamValue("DATAIN_DIR"));


Hope this helps.
by slechtaj
Fri Mar 20, 2015 3:54 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Cloveretl designer does not react to clicks until attempted closed
Replies: 3
Views: 2388

Re: Cloveretl designer does not react to clicks until attempted closed

There are two major applications that serve different purposes – CloverETL Designer, CloverETL Server. While CloverETL Designer ( http://www.cloveretl.com/products/designer ) is designed as a local client application using which you can design your graphs and run single instances, CloverETL Server i...
by slechtaj
Fri Mar 20, 2015 3:40 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Normalizer
Replies: 1
Views: 1920

Re: Normalizer

Hi, I am not sure if Normalizer is what you are looking for. If you want to create a new output file where each line will be placed on a separate line you may only need to update the metadata used on the edge that is connected to the writer component (most likely UniversalDataWriter). However, if I ...