Posts: 20
Joined: Tue Jul 19, 2016 12:34 pm

Linux soft link stopped working for ListFiles on CloverDX 5.11.0

Postby jzhu » Tue Jun 29, 2021 11:00 am

Linux soft link works for ListFiles on CloverETL 4.3.0, but does not work on CloverDX 5.11.0 (not work on 5.10.1 either).

The use case is to change data-in etc. in project sandbox to point to RAM disk with soft link. Error message:

2021-06-29 10:25:18,117 ERROR 3004 [WatchDog_3004] Component [ListFiles:LIST_FILES] finished with status ERROR. (Out0: 0 recs)
Sandbox path resolution failed: file:/Users/xxx/dev/data/ramdisk/in/yyy/20190417
2021-06-29 10:25:18,118 ERROR 3004 [WatchDog_3004] Error details:
org.jetel.exception.JetelRuntimeException: Component [ListFiles:LIST_FILES] finished with status ERROR. (Out0: 0 recs)
at org.jetel.graph.Node.createNodeException(Node.java:673)
at org.jetel.graph.Node.run(Node.java:638)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Sandbox path resolution failed: file:/Users/jianzhu/dev/data/ramdisk/in/ebilling_real_bill_20190417_34075_01/20190417/
at com.cloveretl.server.commons.a.a.b(Main:99)
at com.cloveretl.server.commons.a.a.getURI(Main:54)
at com.opensys.cloveretl.component.ListFiles.populateResultRecord(Main:205)
at com.opensys.cloveretl.component.AbstractFileOperation.processStandardOutputMapping(Main:577)
at com.opensys.cloveretl.component.AbstractFileOperation.processSuccess(Main:509)
at com.opensys.cloveretl.component.ListFiles.processResult(Main:266)
at com.opensys.cloveretl.component.ListFiles.mainExecuteOperation(Main:314)
at com.opensys.cloveretl.component.AbstractFileOperation.execute(Main:383)
at org.jetel.graph.Node.run(Node.java:585)
... 3 more

The issue has nothing to do with RAM disk. In the example above, data-in is softlink pointing to the directory /Users/xxx/dev/data/ramdisk/in on the same SSD drive as the sandbox, no actual RAM disk is used.
Any soft link does not work for ListFiles in the latest CloverDX release.
The component ListFiles was changed since 4.6.0-M1. Both new and old version has the same issue on CloverDX 5.11.0 (or 5.10.1) server.

Without softlink, the jobflow (and graph) works fine with CloverDX 5.11.0.
With or without softlink, the same jobflow works fine with CloverETL 4.3.0.

Posts: 64
Joined: Fri Nov 04, 2016 8:51 am

Re: Linux soft link stopped working for ListFiles on CloverDX 5.11.0

Postby jandikovae » Fri Jul 02, 2021 2:58 pm

Hi there,

You are right. I could also see that the soft link is not working properly in 5.11 version. This only happens in case you are using it from the sandbox project structure. I have logged a ticket to our internal development tracking system and you can check the status at the following link:


Thank you very much for reporting this issue, we are glad to know about it. If you have any follow-up questions or concerns don't hesitate to ask here or contact our CloverCARE Support.

Best Regards,
Eva Jandikova
CloverCARE Support

Visit us online at http://www.cloverdx.com