The beta release of the Live Connect API provides the tools to perform multi-table copies from the Snowflake or Databricks warehouses. Using the API you can
access the data warehouse to get a list of databases, tables, and table schemas.
manage a set of input connector configurations as a single data wharehouse integration configuration.
enable a Digdag workflow to organize input connector jobs.
The following video shows an example of how to use the Live Connect API. Here is the high-level flow of the steps shown in the video.
- Using the TD Console, get the ID of your Snowflake authentication.
- Use the Snowflake authentication ID to create a basic configuration and run Guess.
POST /v1/guess with td_authentication_id in request payload
...
Returns: basic configs and advanced configs- Create integration with guessed result and config values.
POST /v1/dwh/ including configs in request payload
...
Returns: {dwh_id} - Check status.
PUT /v1/dwh/{dwh_id}/run_workflow
...
Returns: running status- Check workflow status in console or TD toolbelt.
- View imported job results.
Video Demo of Live Connect API
A Live Connect API Postman collection is available to exercise the Live Connect APIs. To work with this collection you will need to perform the following steps:
- Enable the Live Connect feature on your TD account
- Obtained a Master API key for your account to authenticate the APIs
- Obtain an authentication ID of the authentication you want TD to use to connect to your datawarehouse
- Download the LiveConnectAPI.postman_collection.json file
- Configure the TD Collection for Postman where you specify the current values for {{baseUrl}} and {{ApiKeyAuth}}
- Specify the current value for {{tdAuthenticationId}}, which is the ID of the authentication you are using
- Send one of these two calls to obtain an easy sync ID (or "config ID") to set as the current value for the {{dwhId}} variable:
- Create a new DWH Integration
- List all DWH Integrations for the current user