CloverETL is now CloverDX - Learn Why

GoodData ETL

Support/help with CloverETL (4.9) and CloverDX (5.0 or newer) implementation problems

GuntherSeibert
Posts: 1
Joined: Mon Dec 03, 2018 6:06 pm

GoodData ETL

Postby GuntherSeibert » Mon Dec 03, 2018 6:20 pm

Dear Srs,

I'm trying to run a graph from CloudConnect (Version 113.0.0.0) to ETL a GoodData Project. On the application it runs fine, no problems at all. So, we need to schedule these runs and I've read that CloverEtl (on which CloudConnect is based) has a CL batch to run them.

I tried some arguments in Clover.bat but it stops on Unkwnown Component ... And I included -plugins to all jar directories on CC instalation.

Here is my CL

Code: Select all

clover.bat runGraph -plugins "C:\Pessoal\CC\plugins" -contexturl "C:\Pessoal\CC\workspace\p1" graph\manutencao_ETL.grf


And the answer:

Code: Select all

CLOVER_HOME=C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\..
CLOVER_CMD_LINE_ARGS=runGraph -plugins "C:\Pessoal\CC\plugins" -contexturl "C:\Pessoal\CC\workspace\p1" graph\manutencao_ETL.grf
JAVA_CMD_LINE_ARGS=
USER_CLASSPATH=
"C:\Program Files\Java\jdk1.8.0_92\bin\java.exe"   -classpath ";;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\;C:\Program Files\Java\jdk1.8.0_92\lib\tools.jar;;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/annotations.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/cloveretl.component.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/cloveretl.engine.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/cloveretl.license.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/com.ning.async-http-client_1.6.5.20130531-2315.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-cli-1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-codec-1.4.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-httpclient-3.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-io-1.4.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-io-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-logging-1.1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-net-2.0.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/commons-pool-1.6.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/dom4j-1.6.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/ftp4j-1.4.3.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/ftp4j-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpclient-4.2.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpclient-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpcore-4.2.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpcore-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpmime-4.2.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/httpmime-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/icu4j-LICENSE.html;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/icu4j-normalizer_transliterator-4.8.1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/icu4j-unicode-LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jakarta-oro-2.0.8.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/javolution.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jaxen-1.1.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jets3t-0.8.0.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jms.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/joda-time-2.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jsch-0.1.50.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/jxl.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/LICENSE.txt;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/log4j-1.2.15.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.batik.xml_1.6.0.v201011041432.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.commons.httpclient_3.1.0.v201012070820.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.httpcomponents.httpclient_4.1.3.v201209201135.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.apache.httpcomponents.httpcore_4.1.4.v201203221030.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.ecf.provider.filetransfer.httpclient4.ssl_1.0.0.v20130604-1622.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.ecf.provider.filetransfer.httpclient4_1.0.300.v20130604-1622.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.equinox.http.jetty_3.0.100.v20130327-1442.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.equinox.http.registry_1.1.300.v20130402-1529.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.equinox.http.servlet_1.1.400.v20130418-1354.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.jetty.http_8.1.14.v20131031.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.m2e.editor.xml_1.4.0.20130601-0317.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.mylyn.commons.repositories.http.core_1.1.2.v20140211-0100.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/org.eclipse.mylyn.commons.xmlrpc_3.9.2.v20140211-0100.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/poi-3.8-20120326.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/poi-ooxml-3.8-20120326.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/poi-ooxml-schemas-3.8-20120326.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/sardine.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/signpost-commonshttp4-1.2.1.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/signpost-core-1.2.1.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/slf4j-api-1.7.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/slf4j-log4j12-1.7.2.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/tar.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/truezip-6.8.1.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/xmlbeans-2.5.0-modified-for-WSC.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/XmlSchema-1.4.7-modified-for-WSC.jar;C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\../lib/XmlSchema-LICENSE.txt" "-Dclover.home=C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\.." org.jetel.main.runGraph -plugins "C:\Pessoal\CC\plugins\com.cloveretl.gui_3.4.4.20161130-0444-b27-jb234P\lib\bin\.\..\plugins" runGraph -plugins "C:\Pessoal\CC\plugins" -contexturl "C:\Pessoal\CC\workspace\p1" graph\manutencao_ETL.grf
INFO  [main] - ***  CloverETL framework/transformation graph, (c) 2002-2016 Javlin a.s, released under GNU Lesser General Public License  ***
INFO  [main] - Running with CloverETL library version 3.4.4 build#234 compiled 25/11/2016 17:05:02
INFO  [main] - Running on 4 CPU(s), OS Windows 10, architecture amd64, Java version 1.8.0_92, max available memory for JVM 1842688 KB
INFO  [main] - Loading default properties from: defaultProperties
DEBUG [main] - No authority proxy registered. Using PrimitiveAuthorityProxy.
INFO  [main] - Graph definition file: graph\manutencao_ETL.grf
DEBUG [main] - No authority proxy registered. Using PrimitiveAuthorityProxy.
ERROR [main] - Error in reading graph from XML !
 Unknown component: HTTP_CONNECTOR class: HTTP_CONNECTOR
ERROR [main] - Error details:
org.jetel.exception.XMLConfigurationException
        at org.jetel.graph.TransformationGraphXMLReaderWriter.throwXMLConfigurationException(TransformationGraphXMLReaderWriter.java:927)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiatePhases(TransformationGraphXMLReaderWriter.java:497)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.read(TransformationGraphXMLReaderWriter.java:396)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.read(TransformationGraphXMLReaderWriter.java:306)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.loadGraph(TransformationGraphXMLReaderWriter.java:234)
        at org.jetel.main.runGraph.main(runGraph.java:376)
Caused by: org.jetel.exception.XMLConfigurationException
        at org.jetel.graph.TransformationGraphXMLReaderWriter.throwXMLConfigurationException(TransformationGraphXMLReaderWriter.java:927)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.throwXMLConfigurationException(TransformationGraphXMLReaderWriter.java:922)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiateNodes(TransformationGraphXMLReaderWriter.java:550)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiatePhases(TransformationGraphXMLReaderWriter.java:491)
        ... 4 more
Caused by: java.lang.RuntimeException: Unknown component: HTTP_CONNECTOR class: HTTP_CONNECTOR
        at org.jetel.component.ComponentFactory.getComponentClass(ComponentFactory.java:111)
        at org.jetel.component.ComponentFactory.createComponent(ComponentFactory.java:128)
        at org.jetel.graph.TransformationGraphXMLReaderWriter.instantiateNodes(TransformationGraphXMLReaderWriter.java:535)
        ... 5 more
Caused by: java.lang.ClassNotFoundException: HTTP_CONNECTOR
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.jetel.component.ComponentFactory.getComponentClass(ComponentFactory.java:101)
        ... 7 more

ERROR [main] -
--------------------------------- Error details ----------------------------------
  Error in reading graph from XML !
   Unknown component: HTTP_CONNECTOR class: HTTP_CONNECTOR
----------------------------------------------------------------------------------



If I drop -plugins I have the same error but with another component ...

Any suggestions?

Tks,
Gunther

bartonv
Posts: 96
Joined: Wed May 03, 2017 12:10 pm

Re: GoodData ETL

Postby bartonv » Tue Dec 04, 2018 9:36 am

Hello Gunther,
as this issue relates to GoodData CloudConnect please do contact GoodData support in this matter directly. They need to be informed about this issue and will work with us directly if needed. Thank you for your cooperation!
Best regards,
---
Vladimir Barton
CloverCARE Support
CloverDX

Visit us online at http://www.cloverdx.com