Search found 19 matches

by ramiro
Wed Oct 24, 2018 6:05 pm
Forum: CloverDX Server
Topic: create schedules dynamically
Replies: 4
Views: 1441

Re: create schedules dynamically

Thanks for the suggestions Vladimir

We will keep event listeners in mind for the refactoring

Ramiro
by ramiro
Fri Oct 19, 2018 5:22 pm
Forum: CloverDX Server
Topic: create schedules dynamically
Replies: 4
Views: 1441

Re: create schedules dynamically

Thanks for the response! I'll try to explain our process in a nutshell, and our need for dynamic schedules. We have a bunch of customers, and we have an ETL flow that process their data. But we process the data per customer, not as a whole. Each customer has custom needs, for some we run a schedule ...
by ramiro
Tue Oct 16, 2018 6:51 pm
Forum: CloverDX Server
Topic: create schedules dynamically
Replies: 4
Views: 1441

create schedules dynamically

is it possible to create schedules via API calls, instead of using the manual interface at the server admin UI?

we are using clover 4.2, let us know, thanks!
by ramiro
Fri Sep 07, 2018 10:45 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: how to externalize a db connection with environmental variables?
Replies: 2
Views: 1337

Re: how to externalize a db connection with environmental variables?

Thanks Lukas, It is possible indeed! We have the connection working now. The problem was that we were caching the docker image that run cloverETL. We run everything in containers, and I was using the old cached version (without the new env variables set) by mistake. All good, not a cloverETL issue, ...
by ramiro
Wed Sep 05, 2018 2:11 am
Forum: CloverDX (formerly CloverETL) Support
Topic: how to externalize a db connection with environmental variables?
Replies: 2
Views: 1337

how to externalize a db connection with environmental variables?

Hello, We've been using externalized connections for db access, and we were able to apply params in there via config files, so we don't have to hardcode the actual db connection values. We want to go a step further, and take those params from env variables, instead of from the XML config files, our ...
by ramiro
Fri Feb 02, 2018 12:38 am
Forum: CloverDX (formerly CloverETL) Support
Topic: https over UniversalFileWriter
Replies: 2
Views: 1644

Re: https over UniversalFileWriter

Perfect, I will update the url protocol to use s3 instead. We are using clover 4.2 at the moment, so this will work well for us.

Thank you
by ramiro
Sat Jan 20, 2018 12:54 am
Forum: CloverDX (formerly CloverETL) Support
Topic: UniversalDataWriter and data encryption for AWS s3 services
Replies: 2
Views: 1771

UniversalDataWriter and data encryption for AWS s3 services

We are using an UniversalDataWriter to put data into AWS S3 service. We have a request to encrypt the data we store. I am suspecting cloverETL uses AWS CLI toolkit, or the AWS java toolkit to upload the files to s3. Somehow we need to pass extra headers to signal AWS we want the data server side enc...
by ramiro
Sat Jan 20, 2018 12:11 am
Forum: CloverDX (formerly CloverETL) Support
Topic: https over UniversalFileWriter
Replies: 2
Views: 1644

https over UniversalFileWriter

Hello, We are using the following for the File URL field, on a UniversalDataWriter component: gzip:(https://${S3_ACCESS_KEY}:${S3_SECRET_KEY}@${S3_BUCKET}.s3.amazonaws.com/${S3_FILE}) by using https:, does that guarantee the connection is over SSL? or the http: vs https: is ignored and all are just ...
by ramiro
Fri Sep 01, 2017 7:37 pm
Forum: CloverDX Server
Topic: How to turn off direct memory
Replies: 1
Views: 2526

How to turn off direct memory

Hello, We are using cloverETL 4.2.0.9/9, and we hit the following issue in our production servers: https://bug.javlin.eu/browse/CLO-5651 We tried to disable Direct Memory, by putting "USE_DIRECT_MEMORY = false" into a new file in tomcat_dir/conf/engine.config Then adding a line to our clov...
by ramiro
Wed Sep 16, 2015 6:29 pm
Forum: CloverDX Server
Topic: troubleshooting a postgresql JNDI connection
Replies: 4
Views: 4853

Re: troubleshooting a postgresql JNDI connection

Thanks for the RedshiftWriter Subgraph recommendation Jan, it will be worth exploring, unfortunately we are stuck on version 3.5 of CloverETL for the moment, hopefully we can make DBEXEC graphs to work with JNDI instead. This is the particular SQL statement I am running (but in fact, it can be any s...
by ramiro
Wed Sep 16, 2015 4:53 pm
Forum: CloverDX (formerly CloverETL) Support
Topic: DBExecute graphs not working with JNDI connections
Replies: 2
Views: 2521

Re: DBExecute graphs not working with JNDI connections

Hi Jan, Same issue. The reason I posted there first was because I though my JNDI setup was wrong. Later I realize the problem was the combination of a DBExecute graph and a JNDI connection that didn't work (all other graphs that involve db connections seem to be ok). So I was thinking I may have a b...
by ramiro
Sat Sep 12, 2015 12:06 am
Forum: CloverDX (formerly CloverETL) Support
Topic: DBExecute graphs not working with JNDI connections
Replies: 2
Views: 2521

DBExecute graphs not working with JNDI connections

I am using CloverETL Server 3.5.2.12/12 When I link a DBExecute graph to a JNDI pool connection resource, the sql query doesn't get executed, and it just times out. If I switch to regular postgresql driver connections, the same sql works just fine. Looks like DBInputTable works just fine (with the s...
by ramiro
Sat Sep 12, 2015 12:02 am
Forum: CloverDX Server
Topic: troubleshooting a postgresql JNDI connection
Replies: 4
Views: 4853

Re: troubleshooting a postgresql JNDI connection

update on this issue: the JNDI setup is actually working, the problem is that the DBExecute clover graphs don't work with JNDI connections, they just timeout (CloverETL Server 3.5.2.12/12)

Does anybody know why?
by ramiro
Thu Sep 10, 2015 7:12 pm
Forum: CloverDX Server
Topic: troubleshooting a postgresql JNDI connection
Replies: 4
Views: 4853

troubleshooting a postgresql JNDI connection

Hello, I am trying to setup a new JNDI connection in my cloverETL server, I am running into some issues and I am not sure how to troubleshoot from there. I modified my tomcat/config/context.xml file as follows: <Resource name="redshift" auth="Container" type="javax.sql.DataS...