Page 1 of 1

Linux soft link stopped working for ListFiles on CloverDX 5.11.0

Posted: Tue Jun 29, 2021 11:00 am
by jzhu
Linux soft link works for ListFiles on CloverETL 4.3.0, but does not work on CloverDX 5.11.0 (not work on 5.10.1 either).

The use case is to change data-in etc. in project sandbox to point to RAM disk with soft link. Error message:

2021-06-29 10:25:18,117 ERROR 3004 [WatchDog_3004] Component [ListFiles:LIST_FILES] finished with status ERROR. (Out0: 0 recs)
Sandbox path resolution failed: file:/Users/xxx/dev/data/ramdisk/in/yyy/20190417
2021-06-29 10:25:18,118 ERROR 3004 [WatchDog_3004] Error details:
org.jetel.exception.JetelRuntimeException: Component [ListFiles:LIST_FILES] finished with status ERROR. (Out0: 0 recs)
at org.jetel.graph.Node.createNodeException(
at java.util.concurrent.ThreadPoolExecutor.runWorker(
at java.util.concurrent.ThreadPoolExecutor$
Caused by: java.lang.RuntimeException: Sandbox path resolution failed: file:/Users/jianzhu/dev/data/ramdisk/in/ebilling_real_bill_20190417_34075_01/20190417/
at com.cloveretl.server.commons.a.a.b(Main:99)
at com.cloveretl.server.commons.a.a.getURI(Main:54)
at com.opensys.cloveretl.component.ListFiles.populateResultRecord(Main:205)
at com.opensys.cloveretl.component.AbstractFileOperation.processStandardOutputMapping(Main:577)
at com.opensys.cloveretl.component.AbstractFileOperation.processSuccess(Main:509)
at com.opensys.cloveretl.component.ListFiles.processResult(Main:266)
at com.opensys.cloveretl.component.ListFiles.mainExecuteOperation(Main:314)
at com.opensys.cloveretl.component.AbstractFileOperation.execute(Main:383)
... 3 more

The issue has nothing to do with RAM disk. In the example above, data-in is softlink pointing to the directory /Users/xxx/dev/data/ramdisk/in on the same SSD drive as the sandbox, no actual RAM disk is used.
Any soft link does not work for ListFiles in the latest CloverDX release.
The component ListFiles was changed since 4.6.0-M1. Both new and old version has the same issue on CloverDX 5.11.0 (or 5.10.1) server.

Without softlink, the jobflow (and graph) works fine with CloverDX 5.11.0.
With or without softlink, the same jobflow works fine with CloverETL 4.3.0.

Re: Linux soft link stopped working for ListFiles on CloverDX 5.11.0

Posted: Fri Jul 02, 2021 2:58 pm
by jandikovae
Hi there,

You are right. I could also see that the soft link is not working properly in 5.11 version. This only happens in case you are using it from the sandbox project structure. I have logged a ticket to our internal development tracking system and you can check the status at the following link:

Thank you very much for reporting this issue, we are glad to know about it. If you have any follow-up questions or concerns don't hesitate to ask here or contact our CloverCARE Support.

Best Regards,