Search found 134 matches

by cholastal
Fri Oct 21, 2016 6:34 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Geeting error while writing csv file to FTP server
Replies: 3
Views: 4112

Re: Geeting error while writing csv file to FTP server

Hi, I've consulted your issue with our developers and it is most probably in settings of the FTP server itself. The FlatFileWriter (or UniversalDataWriter) is using just a bare implementation of the java.net.URLConnection class to save the file to the FTP server. Also, while you're creating the file...
by cholastal
Mon Oct 17, 2016 12:18 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Geeting error while writing csv file to FTP server
Replies: 3
Views: 4112

Re: Geeting error while writing csv file to FTP server

Hi jagan, This issue may be caused by several reasons. 1. The port is not opened. 2. There is a user limit set on the FTP server. 3. You are using SFTP protocol instead of plain FTP. 4. There is a firewall on the FTP server or on your machine that is blocking the communication. Please try the follow...
by cholastal
Wed Oct 12, 2016 3:17 pm
Forum: CloverDX for Java Programmers
Topic: Writing raw data to an output port
Replies: 2
Views: 3012

Re: Writing raw data to an output port

Hi, The data you want to write to an output port has to have the form of a DataRecord. Every data flowing through a CloverETL graph has to be mapped to some metadata. This is the way you do it in a custom Java transformation. You don't have to parse the data yourself, you can create a metadata conta...
by cholastal
Wed Sep 14, 2016 2:39 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: In files with generic names, only one at a time
Replies: 14
Views: 7376

Re: In files with generic names, only one at a time

Hi, I was solving this use case with Heather via email but in case anyone else is interested in a solution, here it is. In case you don't control the transfer process, you need to setup a jobflow that will periodically check the size of the file and compare it to the size the file had during the las...
by cholastal
Wed Sep 07, 2016 2:58 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Escape single quote
Replies: 2
Views: 2464

Re: Escape single quote

Hi, I just tested a similar usage with no issues. In order to resolve your issue please provide me with the following. 1. Version of your Designer. 2. Version of your MS-SQL database. 3. Your graph file without any sensitive information. 4. Your console output when the error occurs. Just copy-paste ...
by cholastal
Tue Aug 30, 2016 2:57 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Metadata extraction failed
Replies: 2
Views: 2351

Re: Metadata extraction failed

Hi, Graphs in the Designer are running in an environment called Runtime. This Runtime runs as a separate Java process and communicates with the Designer via a port. The error message says that this port is blocked for some reason. The Runtime is needed to extract the metadata as it is the process wh...
by cholastal
Tue Aug 30, 2016 1:42 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Generate Dynamic Metadata from files
Replies: 5
Views: 6628

Re: Generate Dynamic Metadata from files

Hi Jigar, Please see the attached graph. It is using a Normalizer component with some CTL2 functions to create the metadata from the input record. After the metadata is created it is converted into a XML format and written to the HDD by the XMLWriter component. Using this file is as easy as using an...
by cholastal
Fri Aug 12, 2016 3:13 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: What comes out of the two ports on the DBOutputTable component?
Replies: 1
Views: 1780

Re: What comes out of the two ports on the DBOutputTable component?

Hi pintail, The DBoutputTable is autopropagating the metadata that is on input port to the error output port. There is no need to explicitly setting the error output metadata. So to answer your questions. 1. The ErrCode and ErrText fields are automatically added to the metadata coming through the in...
by cholastal
Wed Aug 03, 2016 12:54 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Http Connector Issue
Replies: 4
Views: 3861

Re: Http Connector Issue

Hi, It looks like you are mixing two different approaches together. 1. Passing CloverETL parameters as request parameters - If you have some CloverETL parameters defined (Designer -> Outline window -> Parameters), then you can pass them via ${PARAM} syntax. 2. Passing data from an edge as request pa...
by cholastal
Tue Aug 02, 2016 2:38 pm
Forum: CloverDX Server
Topic: How to increase CPU load on DBInputTable components
Replies: 1
Views: 2217

Re: How to increase CPU load on DBInputTable components

Hi, Here are some options how to possibly increase the CPU load: 1. Increase the value of the Fetch size property of the DBInputTable component. 2. Use more DBInputTable components (in single graph) and load only some part of the table in each of them (parallel loading). When the loading is done, yo...
by cholastal
Mon Jul 04, 2016 9:26 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Apache Kafka reader component.
Replies: 7
Views: 5375

Re: Apache Kafka reader component.

Hi, We have spent some time creating the example components and now they are finally here. The archive contains whole CloverETL project with everything that is needed to do a basic read and write from/to a Kafka topic. There are two subgraphs and one testing graph (among other things) in the project...
by cholastal
Tue Jun 28, 2016 1:19 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: How to use Json Extractor when records don't have all the same attributes
Replies: 3
Views: 2973

Re: How to use Json Extractor when records don't have all the same attributes

Hi mcomsto, You can parse the 'features' by a component called Normalizer and dynamic field access CTL functions. I attached a simple example graph which utilizes this approach. You mentioned that you cannot see the 'features' in the visual mapper of the JSONExtract component. I just copied your sam...
by cholastal
Tue Jun 14, 2016 11:38 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Apache Kafka reader component.
Replies: 7
Views: 5375

Re: Apache Kafka reader component.

Hi,

We are working on example components capable of writing and reading to/from the Kafka topics. We are going to release them as soon as possible.

Best regards,
by cholastal
Tue Jun 07, 2016 12:47 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: DBOutputTable error
Replies: 3
Views: 2732

Re: DBOutputTable error

The DBExecute is being used basically for every other operation besides select (DBInputTable), insert, update and delete (DBOutputTable). For example create table, manual begin and commit/rollback transaction, select and insert inside a database (not for (un)loading data from/to DB), etc. Best regar...
by cholastal
Thu Jun 02, 2016 3:26 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: DBOutputTable error
Replies: 3
Views: 2732

Re: DBOutputTable error

Hi Loris89, This is actually not an error it's just a warning and as such won't cause the graph failure. However, the graph (or the component) cannot inform you whether the fields in the DBOutputTable are compatible with the fields in the database and that may cause an error (if they don't match). T...