Complex Data Reader error

CloverDX Platform
1

Hello,

I am using a wildcard to read all the files in a directory. The files used to be stored in subdirectories, but they now are all up one level in the same folder.

I forgot to remove the subdirectories, so after 14 hours of processing, the graph aborted with the following error:
File is unreachable: … (is a directory)

I have already changed the wildcard from * to *.* and removed the subdirectories, but my question is, does the data reader read all files first then directories? If so, I can use the files that were already generated and not have to rerun this graph.

Thank you for your time and input,

Cory

2

Hi cvnation,

I take a look into code. Data are sorted by alphabetical order, case sensitive.

(http://docs.oracle.com/javase/6/docs/api/java/util/Arrays.html#sort(java.lang.Object[]) with String as parameter)

So for example my test folder is sorted like:


A.txt
NewFile.xml
NewFile.xsd
a
b
c
d
test.txt
test_nan.txt
z
3

Thank you! I had to rerun my process yesterday, but that is good to know for future reference.

Cheers,
Cory