# hashJoin in community edition

**URL:** <https://forum.cloverdx.com/t/hashjoin-in-community-edition/972>\
**Category:** CloverDX Platform\
**Created:** [December 6, 2011, 12:00am UTC](https://forum.cloverdx.com/t/hashjoin-in-community-edition/972 "2011-12-06T00:00:00Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![stargazer](https://avatars.discourse-cdn.com/v4/letter/s/eb8c5e/32.png) [@stargazer](https://forum.cloverdx.com/u/stargazer)\
**Post date:** [December 6, 2011, 12:00am UTC](https://forum.cloverdx.com/t/hashjoin-in-community-edition/972/1 "2011-12-06T00:00:00Z")

</div>

So I have two files with 10 million+ records, couple of hundred columns each… both sorted by a common key. Slave file may have instances where key is not populated (if possible using outer join, otherwise i’ll just not carry those). I get the impression that the hashJoin is very memory intensive, it’s failing with a heap error … is there any way I can ‘leverage’ my files pre-sorted status to optimize this (seems like it would run very fast with that assumption in mind) ? or is that another Join in the non-community edition?

If the answer is the latter… if I were to buy the Desktop edition… can I still use the runGraph feature using graphs I create with the Desktop edition? or is that an enterprise function?

Thanks for your help.

Jeff

---

<div class="post-metadata">

**Author:** ![jurban](https://avatars.discourse-cdn.com/v4/letter/j/cc9497/32.png) [@jurban](https://forum.cloverdx.com/u/jurban)\
**Post date:** [December 12, 2011, 9:57am UTC](https://forum.cloverdx.com/t/hashjoin-in-community-edition/972/2 "2011-12-12T09:57:34Z")

</div>

Hi Jeff,

you’re correct that HashJoin can be very memory intensive - it caches slave records in memory. To join large data, you need to use MergeJoin component that would leverage the pre-sorted status of your data. Please see [Joining Data](http://www.cloveretl.com/products/designer/joining-data) for more info on joiners. However, the MergeJoin component is not available in CloverETL Community - it contains only the HashJoin joiner component.

CloverETL Desktop contains the RunGraph component - is this the runGraph feature you meant?

Best regards,  
Jaro

---

<div class="post-metadata">

**Author:** ![stargazer](https://avatars.discourse-cdn.com/v4/letter/s/eb8c5e/32.png) [@stargazer](https://forum.cloverdx.com/u/stargazer)\
**Post date:** [December 16, 2011, 11:53pm UTC](https://forum.cloverdx.com/t/hashjoin-in-community-edition/972/3 "2011-12-16T23:53:13Z")

</div>

I just want to verify… that if I buy the desktop edition for windows, can I take my graph over to my linux box and run it via command line? (as I’ve been able to do with the community edition). I don’t have any kind of GUI desktop setup to hit my more powerful linux box with.

Thanks!

---

<div class="post-metadata">

**Author:** ![jurban](https://avatars.discourse-cdn.com/v4/letter/j/cc9497/32.png) [@jurban](https://forum.cloverdx.com/u/jurban)\
**Post date:** [December 20, 2011, 12:57pm UTC](https://forum.cloverdx.com/t/hashjoin-in-community-edition/972/4 "2011-12-20T12:57:19Z")

</div>

Hi Jeff,

to be able to answer your question - how exactly were you running the graphs in Linux?

Best regards,  
Jaro