Hello,
We are using the following for the File URL field, on a UniversalDataWriter component:
gzip:(https://${S3_ACCESS_KEY}:${S3_SECRET_KEY}@${S3_BUCKET}.s3.amazonaws.com/${S3_FILE})
by using https:, does that guarantee the connection is over SSL? or the http: vs https: is ignored and all are just using the standard not SSL protocol?
Please let us know, thanks!
Hello Ramiro,
a recommended way of reading data from Amazon S3 in CloverETL is by using the “s3://” prefix in the particular reader component URL. By modifying your submitted URL as an example, it would look like this:
gzip:(s3://${S3_ACCESS_KEY}:${S3_SECRET_KEY}@s3.amazonaws.com/${S3_BUCKET}/${S3_FILE})
More information can be found in our documentation. Please note that the communication with Amazon S3 is always secured. In other words, using the “s3://” prefix guarantees the connection over SSL.
If you are using an older version of CloverETL where this option does not yet exist, please let me know which version of CloverETL it is. Note: we have replaced JetS3t with Amazon SDK for connecting to S3 in version 4.2.
Regards,
Perfect, I will update the url protocol to use s3 instead. We are using clover 4.2 at the moment, so this will work well for us.
Thank you