Linux soft link works for ListFiles on CloverETL 4.3.0, but does not work on CloverDX 5.11.0 (not work on 5.10.1 either).
The use case is to change data-in etc. in project sandbox to point to RAM disk with soft link. Error message:
2021-06-29 10:25:18,117 ERROR 3004 [WatchDog_3004] Component [ListFiles:LIST_FILES] finished with status ERROR. (Out0: 0 recs)
Sandbox path resolution failed: file:/Users/xxx/dev/data/ramdisk/in/yyy/20190417
2021-06-29 10:25:18,118 ERROR 3004 [WatchDog_3004] Error details:
org.jetel.exception.JetelRuntimeException: Component [ListFiles:LIST_FILES] finished with status ERROR. (Out0: 0 recs)
at org.jetel.graph.Node.createNodeException(Node.java:673)
at org.jetel.graph.Node.run(Node.java:638)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Sandbox path resolution failed: file:/Users/jianzhu/dev/data/ramdisk/in/ebilling_real_bill_20190417_34075_01/20190417/
at com.cloveretl.server.commons.a.a.b(Main:99)
at com.cloveretl.server.commons.a.a.getURI(Main:54)
at com.opensys.cloveretl.component.ListFiles.populateResultRecord(Main:205)
at com.opensys.cloveretl.component.AbstractFileOperation.processStandardOutputMapping(Main:577)
at com.opensys.cloveretl.component.AbstractFileOperation.processSuccess(Main:509)
at com.opensys.cloveretl.component.ListFiles.processResult(Main:266)
at com.opensys.cloveretl.component.ListFiles.mainExecuteOperation(Main:314)
at com.opensys.cloveretl.component.AbstractFileOperation.execute(Main:383)
at org.jetel.graph.Node.run(Node.java:585)
… 3 more
The issue has nothing to do with RAM disk. In the example above, data-in is softlink pointing to the directory /Users/xxx/dev/data/ramdisk/in on the same SSD drive as the sandbox, no actual RAM disk is used.
Any soft link does not work for ListFiles in the latest CloverDX release.
The component ListFiles was changed since 4.6.0-M1. Both new and old version has the same issue on CloverDX 5.11.0 (or 5.10.1) server.
Without softlink, the jobflow (and graph) works fine with CloverDX 5.11.0.
With or without softlink, the same jobflow works fine with CloverETL 4.3.0.