Clover is not able to parse file remotely

CloverDX Platform
1

Hi,

I am using universal data reader for reading csv files and transforming the same to database.
When I am giiving path of local file system things are working fine but when I am giving path of remote location, I am getting exception…

ERROR [WatchDog] - Node DATA_READER0 finished with status: ERROR caused by: Parse error: The size of data buffer for data record is only 12288. Set appropriate parameter in defautProperties file. when parsing record #1 field field21
DEBUG [WatchDog] - Node DATA_READER0 error details:
java.lang.RuntimeException: Parse error: The size of data buffer for data record is only 12288. Set appropriate parameter in defautProperties file. when parsing record #1 field field21
at org.jetel.data.parser.DataParser.parseNext(DataParser.java:428)
at org.jetel.data.parser.DataParser.getNext(DataParser.java:153)
at org.jetel.util.MultiFileReader.getNext(MultiFileReader.java:307)
at org.jetel.component.DataReader.execute(DataReader.java:197)
at org.jetel.graph.Node.run(Node.java:383)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.RuntimeException: Parse error: The size of data buffer for data record is only 12288. Set appropriate parameter in defautProperties file.
at org.jetel.data.parser.DataParser.readChar(DataParser.java:528)
at org.jetel.data.parser.DataParser.findFirstRecordDelimiter(DataParser.java:658)
at org.jetel.data.parser.DataParser.parseNext(DataParser.java:417)
… 5 more
Caused by: java.nio.BufferOverflowException
at java.nio.Buffer.nextPutIndex(Buffer.java:495)
at java.nio.HeapCharBuffer.put(HeapCharBuffer.java:145)
at org.jetel.data.parser.DataParser.readChar(DataParser.java:526)
… 7 more
ERROR [WatchDog] - !!! Phase finished with error - stopping graph run !!!

I thing something is going wrong in the clover while it is parsing file remotely. Please sugggest some way to resolve this issue.

Thanks
Pushpendra

2

Hello,
this error means, that record, you are trying too parse, is too long. You need to increase value of Record.MAX_RECORD_SIZE property (see CloverETL framework run time constants). And if this error occurs with remote file only, this means that the two files are different.