td_ddl>: Treasure Data operations

td_ddl> operator runs an operational task on Treasure Data.

_export:
  td:
    database: www_access

+step1:
  td_ddl>:
  create_tables: ["my_table_${session_date_compact}"]
+step2:
  td_ddl>:
  drop_tables: ["my_table_${session_date_compact}"]
+step3:
  td_ddl>:
  empty_tables: ["my_table_${session_date_compact}"]
+step4:
  td_ddl>:
  rename_tables: [{from: "my_table_${session_date_compact}", to: "my_table"}]

If you would like to specify a different database which is not declared with _export, you can specify the database name under the options as below.

_export:
  td:
    database: test_db1

+task1:
  td_ddl>:
  create_tables: [test_ddl1, test_ddl2]
  database: test_db2

Secrets

When you don't know how to set secrets, please refer to Managing Workflow Secret

• td.apikey: API_KEY

  The Treasure Data API key to use when performing Treasure Data operations.

Options

• create_tables : [ARRAY OF NAMES]

  Create new tables if not exists.

  Examples:

  Copy

  Copied

  create_tables: [my_table1, my_table2]

• empty_tables : [ARRAY OF NAME]

  Create new tables (drop it first if it exists).

  Examples:

  Copy

  Copied

  empty_tables: [my_table1, my_table2]

• drop_tables : [ARRAY OF NAMES]

  Drop tables if exists.

  Examples:

  Copy

  Copied

  drop_tables: [my_table1, my_table2]

• rename_tables : [ARRAY OF {to:, from:}]

  Rename a table to another name (override the destination table if it already exists).

  Examples:

  Copy

  Copied

  rename_tables: [{from: my_table1, to: my_table2}]

• create_databases : [ARRAY OF NAMES]

  Create new databases if not exists.

  Examples:

  Copy

  Copied

  create_databases: [my_database1, my_database2]

• empty_databases : [ARRAY OF NAME]

  Create new databases (drop it first if it exists).

  Examples:

  Copy

  Copied

  empty_databases: [my_database1, my_database2]

.. note::

Database permissions for the restricted users are not inherited. You need to grant permission again after ran `empty_databases`.

• drop_databases : [ARRAY OF NAMES]

  Drop databases if exists.

  Examples:

  Copy

  Copied

  drop_databases: [my_database1, my_database2]

• endpoint : ADDRESS

  API endpoint (default: api.treasuredata.com).

• use_ssl : BOOLEAN

  Enable SSL (https) to access to the endpoint (default: true).