Search found 26 matches

by madan_clover3
Sun Oct 18, 2020 11:25 am
Forum: CloverDX (formerly CloverETL) Support
Topic: BufferUnderflowException while transforming json data
Replies: 1
Views: 3608

BufferUnderflowException while transforming json data

Hi, I am trying to transform json source data into app specific format. The transformation is working fine for many json files. But for one particular json file(json is simple, but data file is about 16MB), I am seeing java.nio.BufferUnderflowException. I have seen this issue was reported in previou...
by madan_clover3
Tue Dec 03, 2019 11:04 am
Forum: CloverDX (formerly CloverETL) Support
Topic: How to write custom aggregate function
Replies: 1
Views: 2498

How to write custom aggregate function

Hi, I am trying to implement custom aggregation logic, something like "concatinate string values of a field from all the records". I did not find a provision to write custom aggregate functions. AggregateProcessor has FunctionRegistry, it registers aggregate functions supported by clover b...
by madan_clover3
Wed Feb 13, 2019 8:13 am
Forum: CloverDX for Java Programmers
Topic: JsonExtract could not read second record of root array
Replies: 2
Views: 5435

Re: JsonExtract could not read second record of root array

Thank you. With the above changes working as expected.
by madan_clover3
Thu Jan 31, 2019 10:42 am
Forum: CloverDX for Java Programmers
Topic: JsonExtract could not read second record of root array
Replies: 2
Views: 5435

JsonExtract could not read second record of root array

Hi, JsonExtract is not able to read second record of root array element. Below is data and extraction mapping, Data : [{ "id": "1", "name": "emp1" },{ "id": "2", "name": "emp2" }] Extraction Mapping : <Mappings> <Mapping...
by madan_clover3
Tue Jan 29, 2019 11:14 am
Forum: CloverDX for Java Programmers
Topic: XMLExtract - copying parent fields to child when parent fields are present after child element
Replies: 1
Views: 4889

XMLExtract - copying parent fields to child when parent fields are present after child element

Hi, I am using XMLExtract for reading xml files. I have a doubt regarding parentKey&generatedKey feature to copy parent data to child. Consider below data and extraction mapping : Data : <department> <employee> <id>E001</id> <name>emp1</name> <deptRef></detpRef> </employee> <id>D001</id> <name>D...
by madan_clover3
Sun Dec 02, 2018 7:15 am
Forum: CloverDX for Java Programmers
Topic: JsonExtract could not read elements having SPACE
Replies: 6
Views: 12376

Re: JsonExtract could not read elements having SPACE

What if json source file contains two elements like 'abc xyz'(with space) and 'abc_xyz'(with underscore) and these 2 source elements are mapped to 2 different target elements. How it behaves in the above case, please clarify.
by madan_clover3
Fri Jun 15, 2018 6:44 am
Forum: CloverDX for Java Programmers
Topic: JsonExtract could not read elements having SPACE
Replies: 6
Views: 12376

Re: JsonExtract could not read elements having SPACE

please replace “phone numbers” in your mapping with “phone_numbers” : 'phone numbers' represents element in json data file. Replacing in mapping file is enough? We might need to change in data file as well. Data file is not in our control, it is user uploaded file. Yeah space is invalid in xml elem...
by madan_clover3
Tue Jun 05, 2018 6:34 am
Forum: CloverDX for Java Programmers
Topic: JsonExtract could not read elements having SPACE
Replies: 6
Views: 12376

JsonExtract could not read elements having SPACE

Json data : { "id": "1", "name": "emp1", "addresses": [ { "area": "area1", "city": "city1", "state": "state1", "pin": "pinxyz" } ], "phone numbers": [ { "t...
by madan_clover3
Thu May 17, 2018 10:05 am
Forum: CloverDX for Java Programmers
Topic: JsonExtract could not read json starting with array
Replies: 3
Views: 6673

Re: JsonExtract could not read json starting with array

Hi, Thanks for response. After using 'json_array' it is working as expected. Regarding mapping - not used any editor. I am using clover open source engine in my java application, generated mapping using custom code. I could not find any documentation about 'json_array'. Your response is helpful to m...
by madan_clover3
Thu May 03, 2018 8:30 am
Forum: CloverDX for Java Programmers
Topic: JsonExtract could not read json starting with array
Replies: 3
Views: 6673

JsonExtract could not read json starting with array

If json is starting with array, JsonExtract is not reading any data. Json starting with array : [ { "id": "1", "name": "emp1", "addresses": [ { "area": "area1", "city": "city1", "state": "state1&...
by madan_clover3
Mon Feb 13, 2017 7:03 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Any component to read data from web service
Replies: 1
Views: 2830

Any component to read data from web service

Hi,

Is there any component to read data from a web service?
SOAP based or REST based?
Available in community edition or not ?

I could not find anything in docs,
http://doc.cloveretl.com/documentation/ ... /index.jsp

Please suggest available options and alternates,

Thanks in advance,
Madan
by madan_clover3
Mon Feb 06, 2017 7:58 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Clover script validation
Replies: 5
Views: 4843

Re: Clover script validation

Found some solution. String prefix = "//#CTL2 \n function integer transform() {"; String postfix = " return 0; }"; String expressionValidateFunction = prefix + expression + postfix; ITLCompilerFactory compilerFactory = new TransformFactory.DefaultCompilerFactory(); final ITLCompi...
by madan_clover3
Mon Feb 06, 2017 7:40 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Clover script validation
Replies: 5
Views: 4843

Re: Clover script validation

Tried below options : Option 1 : String expression = "$field1=$field/2; $field3=str2date($field4, "dd.MM.yyyy");"; ITLCompilerFactory compilerFactory = new TransformFactory.DefaultCompilerFactory(); final ITLCompiler compiler = compilerFactory.createCompiler(getGraph(), recordMet...
by madan_clover3
Mon Feb 06, 2017 5:11 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Clover script validation
Replies: 5
Views: 4843

Re: Clover script validation

Hi, I am executing transformation in java, not using transform editor. I need to validate clover script as and when user submits to some xyz api so that I can warn user to correct the script then and there. Validating in transformation process is too late to intimate user about script errors. I am l...
by madan_clover3
Tue Jan 31, 2017 9:59 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Clover script validation
Replies: 5
Views: 4843

Clover script validation

Hi I am trying to validate clover script, For ex., $field1=$field/2; $field3=str2date($field4, "dd.MM.yyyy"); I need to validate the above script for compilations and data type mismatch problems. Is there any way I can do this before even transformation graph is executed. Thanks in advance.

cron