# Split large data set when extracting data from source

**URL:** <https://forum.cloverdx.com/t/split-large-data-set-when-extracting-data-from-source/1715>\
**Category:** CloverDX Platform\
**Created:** [February 1, 2016, 12:00am UTC](https://forum.cloverdx.com/t/split-large-data-set-when-extracting-data-from-source/1715 "2016-02-01T00:00:00Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![marcosnels](https://avatars.discourse-cdn.com/v4/letter/m/a4c791/32.png) [@marcosnels](https://forum.cloverdx.com/u/marcosnels)\
**Post date:** [February 1, 2016, 12:00am UTC](https://forum.cloverdx.com/t/split-large-data-set-when-extracting-data-from-source/1715/1 "2016-02-01T00:00:00Z")

</div>

Hi,

We have a folder with a lot of files. We cannot run a graph and extract all the files at once, because our temp folder is not that big. Is it in the UniversalDataReader possible to split the incoming data in sets? So that the temp folder is deleted after every set.

Thnx.

Marco

---

<div class="post-metadata">

**Author:** ![slechtaj](https://avatars.discourse-cdn.com/v4/letter/s/59ef9b/32.png) [@slechtaj](https://forum.cloverdx.com/u/slechtaj)\
**Post date:** [February 3, 2016, 7:00pm UTC](https://forum.cloverdx.com/t/split-large-data-set-when-extracting-data-from-source/1715/2 "2016-02-03T19:00:25Z")

</div>

Hi Marco,

You should use [Jobflows](http://doc.cloveretl.com/documentation/UserGuide/index.jsp?topic=/com.cloveretl.gui.docs/docs/part-jobflow.html) (comes with CloverETL Corporate Server) and [File operations](http://doc.cloveretl.com/documentation/UserGuide/index.jsp?topic=/com.cloveretl.gui.docs/docs/file-operations.html) components ([ListFiles](http://doc.cloveretl.com/documentation/UserGuide/index.jsp?topic=/com.cloveretl.gui.docs/docs/listfiles.html)) for this.  
ListFiles component can produce the list of files available for data transformation and then using ExecuteGraph, you can execute the graph for every single of the files from the list - this way you will get always one graph processed at a time.
