Search found 20 matches

by pfield
Thu May 13, 2021 6:43 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8929

Re: Pass Metadata and Filename as Parameter in Designer

Hi Eva, Your recommendation of using the "Algorithm" property worked great - THANK YOU! Regarding my use-case, let me explain as best I can and keen to hear if there is a better approach... I have a graph which collects files from a large directory (100GB+) and converts them into base64 be...
by pfield
Mon Apr 26, 2021 10:58 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8929

Re: Pass Metadata and Filename as Parameter in Designer

Hi, Shortly after my prior post I observed in the documentation for RunGraph that you cannot run a graph with a subgraph when using a separate JVM. This would explain my issue. However, when removing the subgraph, I got some more errors: Secure parameters are supported only in CloverDX Server enviro...
by pfield
Sun Apr 25, 2021 9:07 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8929

Re: Pass Metadata and Filename as Parameter in Designer

Hi David, I have a follow up question relevant to this thread... When passing parameters into a RunGraph (via Command line arguments) calling a graph using a subgraph, I am getting the following error on the Log file: CloverDX license for subgraphs is expired or not available My question is, when no...
by pfield
Thu Jan 21, 2021 1:46 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8929

Re: Pass Metadata and Filename as Parameter in Designer

Hi David, Thank you for the response - this is helpful. When I launch a graph via RunGraph using the same JVM I can track all graphs executed in the Execution Tab, click into them, see what data passed through the edge etc. When using a different JVM I cannot; The Execution Tab only shows the "...
by pfield
Wed Jan 20, 2021 12:04 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Custom Java Components - Accessing Workspace Directory
Replies: 2
Views: 4293

Re: Custom Java Components - Accessing Workspace Directory

Hi,

After some more exploration of the graph parameters I found SANDBOX_ROOT which gives me the path I was looking for.

Code: Select all

String WorkingFolder = getGraph().getGraphParameters().getGraphParameter("SANDBOX_ROOT").getValue();


Paul
by pfield
Tue Jan 19, 2021 6:32 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Custom Java Components - Accessing Workspace Directory
Replies: 2
Views: 4293

Custom Java Components - Accessing Workspace Directory

Hi, I have a Custom Java Component that collects a file from my project workspace for processing based on an input port field value. Everything works fine, however, in order to access the file I need to provide the full file path from my C Drive despite the file sitting in a project directory. This ...
by pfield
Mon Jan 18, 2021 1:58 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8929

Re: Pass Metadata and Filename as Parameter in Designer

Hi David, Using a different JVM works well as I can pass different values through "cloverCmdLineArgs" on RunGraph input. One drawback I can see is that because it's in a different JVM I can follow the process in the execution log. Is there a way to navigate to the graph in the execution lo...
by pfield
Thu Oct 08, 2020 1:54 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Graph name as Parameter in Designer
Replies: 3
Views: 4877

Re: Graph name as Parameter in Designer

Thanks Eva!

That's exactly what I needed. I did not see the GRAPH_FILE parameter listed in workspace.prm - is there a place all the parameters available are documented?

Kind Regards,
Paul
by pfield
Thu Sep 10, 2020 11:18 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Clear Persistent Lookup
Replies: 6
Views: 7316

Re: Clear Persistent Lookup

HI Eva,

Just wanted to acknowledge and thank you for this reply.

I opted for a similar approach, though used a CustomJava component to clear files from that directory at the start each execution - though I like your solution better as it's less coding!

Paul
by pfield
Thu Sep 10, 2020 11:08 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Graph name as Parameter in Designer
Replies: 3
Views: 4877

Graph name as Parameter in Designer

Hi, Is it possible to have the name of the graph that is currently executing available as a parameter available in CTL? My use case is that I have many graphs running synchronously (via RunGraph) doing various data checks. If an issue is found the graph will write this to a log and I'd like to inclu...
by pfield
Tue Aug 11, 2020 6:23 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Http Connector Issue
Replies: 7
Views: 6614

Re: Http Connector Issue

Hi Eva,

Thank you for this. Yes your solution works great - only just got round to testing now!

Kind Regards,
Paul
by pfield
Mon Jun 29, 2020 12:57 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Http Connector Issue
Replies: 7
Views: 6614

Re: Http Connector Issue

Hi, I found this thread whilst trying to configure my HTTPConnector for a REST API call. One issue with the "Add input fields as parameters" function is that Clover metadata only allows certain characters. In my case the API parameter contained an exclamation mark (!) which meant I could n...
by pfield
Wed Jun 17, 2020 4:28 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Clear Persistent Lookup
Replies: 6
Views: 7316

Re: Clear Persistent Lookup

Hi, Use case is more at the beginning of the execution I want to repopulate the mappings. So if you imagine i run the graph (which in turn executes a series of other graphs synchronously) and i check the output, then decide I want to change something and run it again. In this scenario If I want to r...
by pfield
Wed Apr 01, 2020 12:22 am
Forum: CloverDX (formerly CloverETL) Support
Topic: Handling str2date() Error
Replies: 3
Views: 2452

Re: Handling str2date() Error

Thanks David! This worked for me.

Out of interest, what was it about this type of error which meant TransformOnError() or similar wasn't possible?

Paul
by pfield
Thu Mar 26, 2020 8:14 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: Pass Metadata and Filename as Parameter in Designer
Replies: 12
Views: 8929

Re: Pass Metadata and Filename as Parameter in Designer

Thanks for the reply David. Would there be anyway of passing a parameter via RunGraph using command line arguments? See related post below. This would allow for some form of synchronous execution. https://urldefense.proofpoint.com/v2/url?u=https-3A__forum.cloverdx.com_viewtopic.php-3Ft-3D4576&d=...

cron