td_ddl>: Treasure Data operations
td_ddl> operator runs an operational task on Treasure Data.
_export: td: database: www_access
+step1: td_ddl>: create_tables: ["my_table_${session_date_compact}"] +step2: td_ddl>: drop_tables: ["my_table_${session_date_compact}"] +step3: td_ddl>: empty_tables: ["my_table_${session_date_compact}"] +step4: td_ddl>: rename_tables: [{from: "my_table_${session_date_compact}", to: "my_table"}]
If you would like to specify a different database which is not declared with _export, you can specify the database name under the options as below.
_export: td: database: test_db1
+task1: td_ddl>: create_tables: [test_ddl1, test_ddl2] database: test_db2
Secrets
When you don't know how to set secrets, please refer to Managing Workflow Secret
td.apikey: API_KEY
The Treasure Data API key to use when performing Treasure Data operations.
Options
create_tables: [ARRAY OF NAMES]
Create new tables if not exists.
Examples:
create_tables: [my_table1, my_table2]
empty_tables: [ARRAY OF NAME]
Create new tables (drop it first if it exists).
Examples:
empty_tables: [my_table1, my_table2]
drop_tables: [ARRAY OF NAMES]
Drop tables if exists.
Examples:
drop_tables: [my_table1, my_table2]
rename_tables: [ARRAY OF {to:, from:}]
Rename a table to another name (override the destination table if it already exists).
Examples:
rename_tables: [{from: my_table1, to: my_table2}]
create_databases: [ARRAY OF NAMES]
Create new databases if not exists.
Examples:
create_databases: [my_database1, my_database2]
empty_databases: [ARRAY OF NAME]
Create new databases (drop it first if it exists).
Examples:
empty_databases: [my_database1, my_database2]
.. note::
Database permissions for the restricted users are not inherited. You need to grant permission again after ran empty_databases
.
drop_databases: [ARRAY OF NAMES]
Drop databases if exists.
Examples:
drop_databases: [my_database1, my_database2]
endpoint: ADDRESS
API endpoint (default: api.treasuredata.com).
use_ssl: BOOLEAN
Enable SSL (https) to access to the endpoint (default: true).