I’m looking into improving performance in CloverETL Server when running graphs. Can you tell me if CloverETL Server is installed on a Server with 24 physical CPUs, will it default to the maximum number of CPUs available or is there a default number of CPUs it will use which would need to be changed to take advantage of the additional CPUs available?
Also, if there is a default, where specifically can this be set and are there components that will take advantage of multiple CPUs?
I’ve run through the documentation a few times but I am unable to find a this answer. Thanks for your help!
Dear Bkursar,
first, take a look into your Server license: it may be, there is limit of CPU cores. That may be a first limitation.
Regarding scaling itself:
Each component of each running graph on Server owns own thread. So you can scale up to running_components_cnt==CPU_cores_cnt
There are exceptions like WebServiceClient, JMSReader or FastSort, which can use more threads in one component.
Scaling is great until all components of graph are running same time. If one component of graph longs much longer than others, adding new cores does not help.
Dear Bkursar,
first, take a look into your Server license: it may be, there is limit of CPU cores. That may be a first limitation.
Regarding scaling itself:
Each component of each running graph on Server owns own thread. So you can scale up to running_components_cnt==CPU_cores_cnt
There are exceptions like WebServiceClient, JMSReader or FastSort, which can use more threads in one component.
Scaling is great until all components of graph are running same time. If one component of graph longs much longer than others, adding new cores does not help.
“kubosj”
Can you confirm location of license and also if license is allowing 24 cpu, where I would check for components are not set to utilize less?
Can you confirm the various files /locations and areas which can be verified for number of CPUs allocated to CloverETL Server?
Hi,
in Server management web console there is tab “Monitoring” and on it tab “License”. There is field “Max allowed CPUs”.
(the “Monitoring tab” is visible here: http://server-demo-ec2.cloveretl.com/cl … _nodes.png)
Regarding components, usable cores depends on:
* number of graphs running in parallel on Server
* number of components in each phase
So usable cores at defined moment = sum of all components in currently running phases of all running graphs
