Search found 145 matches

by bartonv
Tue Jul 18, 2017 8:08 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Performance issue with processing large csv files with joins
Replies: 1
Views: 2198

Re: Performance issue with processing large csv files with joins

Hi Eric, there is no easy way to force the FlatFileReader component to break records down and process them in batches. However, from looking at your graph I would like to suggest a few tips that might help you resolve the memory overflow issue caused by the ExtHashJoin component. ⋅ As you ...
by bartonv
Thu Jul 13, 2017 12:06 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Flat File Reader Error - Bad Quote Format?
Replies: 2
Views: 2791

Re: Flat File Reader Error - Bad Quote Format?

Hi Heather, thank you for the detailed explanation of the issue. When it comes to matching your example with the examples in our documentation, however, I beg to differ. The string that causes the parsing error in your graph ("Coaching in the Moment" Workshop/Lunch) looks a lot like the &q...
by bartonv
Wed Jul 12, 2017 3:16 pm
Forum: CloverDX for Java Programmers
Topic: How to parse large XML file using custom XMLExtract in Java and store it in database
Replies: 4
Views: 4868

Re: How to parse large XML file using custom XMLExtract in Java and store it in database

Hello Sai, there are many sources of information on how to create graphs that would read and parse the content of a XML file such as the one you reported. To name a few: • The Help documents describing the basics of creating and running graphs in CloverETL Designer are available here and here . • Th...
by bartonv
Mon Jul 10, 2017 12:17 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: move/copy files very slow when overwriting
Replies: 3
Views: 4675

Re: move/copy files very slow when overwriting

Hi wills__aperio, thank you for the provided details. After a close inspection, it appears that Clover keeps listing the entire target directory content every time there is a file that is supposed to be overwritten. Such behavior, however, does not seem to be correct. I have logged the following iss...
by bartonv
Fri Jun 30, 2017 3:27 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: move/copy files very slow when overwriting
Replies: 3
Views: 4675

Re: move/copy files very slow when overwriting

Hello Will, the way how the MoveFiles component actually moves files to a remote location via SFTP heavily depends on the SFTP utility and CloverETL version that you are using. Could you please get back to us with more details so that we can suggest the most suitable resolution? 1. What is your SFTP...
by bartonv
Tue Jun 20, 2017 8:08 am
Forum: CloverDX Server
Topic: Query Jobs on Server
Replies: 1
Views: 3389

Re: Query Jobs on Server

Hello hneff1, querying the CloverETL Server database for a list of all enabled scheduled jobs heavily depends on the type of the database you are taking advantage of (Microsoft SQL Server, MySQL, Derby etc.) Nevertheless, the database structure for storing this information, such as server scheduled ...
by bartonv
Thu Jun 15, 2017 10:06 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Partition Component
Replies: 3
Views: 3252

Re: Partition Component

Hello pintail, as you rightly said, the Partition component does assign the filtered records to the output ports randomly when using the Partition key as the only property definition. This is, in fact, the easiest way how this component can be used to get the data forked into multiple output ports. ...
by bartonv
Mon Jun 05, 2017 12:14 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: XMLExtract V 4.4 issue in reading elements
Replies: 1
Views: 2062

Re: XMLExtract V 4.4 issue in reading elements

Hello Sriram, From the snippet of the XML input file and from your description of the situation I understand that you mapped the output of the <Person_Education> element to populate the parent record (the “ABC” person). Since the <Person_Education> element has multiple instances within the parent el...
by bartonv
Mon May 29, 2017 2:12 pm
Forum: CloverDX for Java Programmers
Topic: Read dynamic xml data and store it in databse using CloverETL
Replies: 2
Views: 4326

Re: Read dynamic xml data and store it in databse using CloverETL

Hello Sai, let’s break this down into 2 separate topics based on your question: reading data from XML files and writing the data into databases. A. Reading XML files There are several options how you can read the XML files using the CloverETL Designer. It can be done either by using the XMLExtract, ...
by bartonv
Fri May 26, 2017 1:28 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: skip graph initialization
Replies: 1
Views: 2193

Re: skip graph initialization

Hello Hewills, unfortunately, it is not possible to force CloverETL Designer to skip the initialization phase which is by design. In other words, it is not possible to make the graph start running if the connection to a database cannot be established. Although there is no workaround within the Clove...