Multi XML HTTP GET requests

CloverDX Platform
1

Hi again,

Following my previous post, we are currently trying to get Exchange Rates from a HTTP GET request, where the date is a parameter.
Those rates are provided under XML form.

For the current day date, it’s plain and simple because the date parameter is not needed.
But the expected final process would be to get the rates for the last 7 days, each end of week.
For performance/security/changing XML structure issues, the best would be to store one XML for each day, allowing us to then process XML files without the pressure of getting it right at the time of the request. In few terms, 1 date = 1 XML.

The thing is, since HTTP Connector cannot use Output File URL when multi HTTP requests are made, we would have to flow the results into a next component.
I suppose that this next component would be an XML extract and/or writer if we wanted to store the XML file.
But it’s not clear as to how to handle an input XML format flowed to an “output field” that seems to expect a string output ?

Thank you for your help.

2

Hi,

thinking about your use case, I think best solution is to use UniversalDataWriter for writing XML files. It is possible to use it for writing content of record. And you can have one file for each record.

I have created graph example which:
- performs 7 HTTP requests
- response for each of them is XML content
- uses UniversalDataWriter to write 7 files (one for each XML response)
( there is also example how to parse XML files for its data, but I think it is not needed here)

See attached graph if it does what you need.

3

Hi,

OK i see better the use of UniversalDataWriter, it’s exactly what I was asking for, the possibility to just read and write, as some input files may require asynchronous processing (due to low reliability on structure).

Thank you very much for your help

Bart