GoodData ETL

Dear Srs,

I’m trying to run a graph from CloudConnect (Version 113.0.0.0) to ETL a GoodData Project. On the application it runs fine, no problems at all. So, we need to schedule these runs and I’ve read that CloverEtl (on which CloudConnect is based) has a CL batch to run them.

I tried some arguments in Clover.bat but it stops on Unkwnown Component … And I included -plugins to all jar directories on CC instalation.

Here is my CL

clover.bat runGraph -plugins "C:\Pessoal\CC\plugins" -contexturl "C:\Pessoal\CC\workspace\p1" graph\manutencao_ETL.grf 

And the answer:


CLOVER_HOME=C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\..
CLOVER_CMD_LINE_ARGS=runGraph -plugins "C:\Pessoal\CC\plugins" -contexturl "C:\Pessoal\CC\workspace\p1" graph\manutencao_ETL.grf
JAVA_CMD_LINE_ARGS=
USER_CLASSPATH=
"C:\Program Files\Java\jdk1.8.0_92\bin\java.exe"   -classpath ";;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\;C:\Program Files\Java\jdk1.8.0_92\lib\tools.jar;;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/annotations.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/cloveretl.component.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/cloveretl.engine.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/cloveretl.license.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/com.ning.async-http-client_1.6.5.20130531-2315.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-cli-1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-codec-1.4.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-httpclient-3.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-io-1.4.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-io-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-logging-1.1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-net-2.0.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-pool-1.6.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/dom4j-1.6.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/ftp4j-1.4.3.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/ftp4j-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpclient-4.2.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpclient-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpcore-4.2.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpcore-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpmime-4.2.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpmime-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/icu4j-LICENSE.html;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/icu4j-normalizer_transliterator-4.8.1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/icu4j-unicode-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jakarta-oro-2.0.8.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/javolution.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jaxen-1.1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jets3t-0.8.0.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jms.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/joda-time-2.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jsch-0.1.50.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jxl.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/log4j-1.2.15.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.batik.xml_1.6.0.v201011041432.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.commons.httpclient_3.1.0.v201012070820.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.httpcomponents.httpclient_4.1.3.v201209201135.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.httpcomponents.httpcore_4.1.4.v201203221030.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.ecf.provider.filetransfer.httpclient4.ssl_1.0.0.v20130604-1622.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.ecf.provider.filetransfer.httpclient4_1.0.300.v20130604-1622.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.equinox.http.jetty_3.0.100.v20130327-1442.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.equinox.http.registry_1.1.300.v20130402-1529.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.equinox.http.servlet_1.1.400.v20130418-1354.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.jetty.http_8.1.14.v20131031.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.m2e.editor.xml_1.4.0.20130601-0317.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.mylyn.commons.repositories.http.core_1.1.2.v20140211-0100.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.mylyn.commons.xmlrpc_3.9.2.v20140211-0100.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/poi-3.8-20120326.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/poi-ooxml-3.8-20120326.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/poi-ooxml-schemas-3.8-20120326.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/sardine.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/signpost-commonshttp4-1.2.1.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/signpost-core-1.2.1.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/slf4j-api-1.7.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/slf4j-log4j12-1.7.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/tar.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/truezip-6.8.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/xmlbeans-2.5.0-modified-for-WSC.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/XmlSchema-1.4.7-modified-for-WSC.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/XmlSchema-LICENSE.txt" "-Dclover.home=C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\.." org.jetel.main.runGraph -plugins "C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\..\plugins" runGraph -plugins "C:\Pessoal\CC\plugins" -contexturl "C:\Pessoal\CC\workspace\p1" graph\manutencao_ETL.grf
INFO  [main] - ***  CloverETL framework/transformation graph, (c) 2002-2016 Javlin a.s, released under GNU Lesser General Public License  ***
INFO  [main] - Running with CloverETL library version 3.4.4 build#234 compiled 25/11/2016 17:05:02
INFO  [main] - Running on 4 CPU(s), OS Windows 10, architecture amd64, Java version 1.8.0_92, max available memory for JVM 1842688 KB
INFO  [main] - Loading default properties from: defaultProperties
DEBUG [main] - No authority proxy registered. Using PrimitiveAuthorityProxy.
INFO  [main] - Graph definition file: graph\manutencao_ETL.grf
DEBUG [main] - No authority proxy registered. Using PrimitiveAuthorityProxy.
ERROR [main] - Error in reading graph from XML !
 Unknown component: HTTP_CONNECTOR class: HTTP_CONNECTOR
ERROR [main] - Error details:
org.jetel.exception.XMLConfigurationException
        at org.jetel.graph.TransformationGraphXMLReaderWriter.throwXMLConfigurationException(TransformationGraphXMLReaderWriter.java:927)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiatePhases(TransformationGraphXMLReaderWriter.java:497)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.read(TransformationGraphXMLReaderWriter.java:396)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.read(TransformationGraphXMLReaderWriter.java:306)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.loadGraph(TransformationGraphXMLReaderWriter.java:234)
        at org.jetel.main.runGraph.main(runGraph.java:376)
Caused by: org.jetel.exception.XMLConfigurationException
        at org.jetel.graph.TransformationGraphXMLReaderWriter.throwXMLConfigurationException(TransformationGraphXMLReaderWriter.java:927)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.throwXMLConfigurationException(TransformationGraphXMLReaderWriter.java:922)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiateNodes(TransformationGraphXMLReaderWriter.java:550)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiatePhases(TransformationGraphXMLReaderWriter.java:491)
        ... 4 more
Caused by: java.lang.RuntimeException: Unknown component: HTTP_CONNECTOR class: HTTP_CONNECTOR
        at org.jetel.component.ComponentFactory.getComponentClass(ComponentFactory.java:111)
        at org.jetel.component.ComponentFactory.createComponent(ComponentFactory.java:128)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiateNodes(TransformationGraphXMLReaderWriter.java:535)
        ... 5 more
Caused by: java.lang.ClassNotFoundException: HTTP_CONNECTOR
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.jetel.component.ComponentFactory.getComponentClass(ComponentFactory.java:101)
        ... 7 more

ERROR [main] -
--------------------------------- Error details ----------------------------------
  Error in reading graph from XML !
   Unknown component: HTTP_CONNECTOR class: HTTP_CONNECTOR
----------------------------------------------------------------------------------


If I drop -plugins I have the same error but with another component …

Any suggestions?

Tks,
Gunther

Hello Gunther,
as this issue relates to GoodData CloudConnect please do contact GoodData support in this matter directly. They need to be informed about this issue and will work with us directly if needed. Thank you for your cooperation!
Best regards,