Batch data read from XLSDataReader

CloverDX Platform
1

Hi ,

I am just started working on CloverETL.Could any one help me the better approach for below requirement.

- From excel file(75000 records) data should read as batches(5000 records at time)
- Transformer component to parse 5000 records to JSON list
- above JSON list should pass to HTTPConnector
- HTTP response success to CSV failure to CSV file

Appreciate your help.

Thanks,
Kalpana.

2

Hi Kalpana,

There is no need to read data from the XLS file in batches (in fact nothing like that would solve your situation) - this can be simply done by using “Records per file” attribute (set to 5000 in your case) of JSONWriter, which tells the component to use that amount of incoming records to compose the output JSON structure.

For more information about JSONWriter please refer to our documentation.

Hope it helps.

3

Thank you so much for your reply.I will try the option you suggested.

Thanks,
Kalpana.