td_load>: Treasure Data bulk loading

td_load> operator loads data from storages, databases, or services.

Copy
Copied
+step1:
  td_load>: config/guessed.yml
  database: prod
  table: raw

Examples

Secrets

When you don't know how to set secrets, please refer to Managing Workflow Secret

  • td.apikey : API_KEY

    The Treasure Data API key to use when submitting Treasure Data bulk load jobs.

Options

  • td_load> : FILE.yml

    Path to a YAML template file. This configuration needs to be guessed using td command. If you saved DataConnector job on Treasure Data, you can use Unique ID instead of YAML path.

    Examples:

    Copy
    Copied
    td_load>: imports/load.yml
    Copy
    Copied
    td_load>: unique_id
  • database : NAME

    Name of the database load data to.

    Examples:

    Copy
    Copied
    database: my_database
  • table : NAME

    Name of the table load data to.

    Examples:

    Copy
    Copied
    table: my_table
  • endpoint : ADDRESS

    API endpoint (default: api.treasuredata.com).

  • use_ssl : BOOLEAN

    Enable SSL (https) to access to the endpoint (default: true).

Output parameters

  • td.last_job_id or td.last_job.id

    The job id this task executed.

    Examples:

    Copy
    Copied
    52036074
  • td.last_job.num_records

    The number of records of this job output.

    Examples:

    Copy
    Copied
    10