Serverless SQL (Oracle)

CloverDX Platform
1

Dear Forum Members,

I have few questions, please do let me know whether this is possible using CloverDX:

  1. Can we use Serverless SQL within CloverDX Designer?
  2. How will the connections work for E2E ETL jobs?
  3. Serverless SQL will be using Oracle.

Kind regards,

2

Hi there,

Let me try to answer your questions:

1. Can we use Serverless SQL within CloverDX Designer?

CloverDX Designer does not natively support direct execution of Serverless SQL queries (such as those from Azure Synapse or AWS Athena) because it typically requires a JDBC driver to connect to databases. However, if Serverless SQL provides a JDBC-compatible interface, you can configure a Database Connection in Designer to interact with it. You will need to obtain and configure the appropriate JDBC driver.

If the service does not provide direct JDBC support, you may need to use API-based integration via REST or another supported protocol.

2. How will the connections work for E2E ETL jobs?

There is basically no difference between server based SQL and serverless solution as long as you’re using a JDBC driver but let me break it down a bit. For end-to-end (E2E) ETL jobs in CloverDX, connections to Serverless SQL will depend on the type of service and its authentication method. Generally, the connection workflow follows these steps:

  • JDBC Connection (Preferred if Available)
    • Configure a Database Connection in CloverDX.
    • Set up the JDBC URL, driver, authentication method, and connection parameters.
    • Use DatabaseWriter or DatabaseReader components to interact with the database.
  • REST API-Based Connection (If JDBC is Not Available)
    • If Serverless SQL requires API calls, you can use the HTTPConnector component or from CloverDX version 6.7 up, also a new component called RESTConnector.
    • Transform JSON or XML responses into structured data using JSONExtract or XMLExtract.
  • Authentication Considerations
    • Some forms of authentication are not natively supported in CloverDX yet, such as multifactor authentication (MFA).
    • Some cloud-based serverless databases require firewall or security configurations to allow external connections.

3. Serverless SQL will be using Oracle

I have to admit, I’m not entirely sure what this means exactly. Can you please clarify?

Kind regards,
Lukas