Teradata
This page guides you through the process of setting up the Teradata destination connector.
Prerequisites
To use the Teradata destination connector, you'll need:
-
Access to a Teradata Vantage instance
Note: If you need a new instance of Vantage, you can install a free version called Vantage Express in the cloud on Google Cloud, Azure, and AWS. You can also run Vantage Express on your local machine using VMware, VirtualBox, or UTM.
You'll need the following information to configure the Teradata destination:
- Host - The host name of the Teradata Vantage instance.
- Authorization Mechanism - Specifies the Logon Mechanism, which determines the connection's authentication and encryption capabilities. The default value is
TD2. This connector supports TD2, LDAP and BROWSER authentication mechanisms. - User - The username to use to connect to the Teradata Vantage instance. The user must have the necessary permissions to create tables and write data.
- Password - The password to use to connect to the Teradata Vantage instance.
- SSL modes - Specifies the mode for connections to the database. Refer to the Teradata JDBC documentation for more information. Enable SSL Connection option to use SSL mode.
- Default Schema Name - Specify the schema (or several schemas separated by commas) to be set in the search-path. These schemas will be used to resolve unqualified object names used in statements executed over this connection.
- JDBC URL Params (optional)
- Query Band (optional) - The query band is a set of name-value pairs that can be assigned to a Teradata database session. It helps identify the source of SQL requests originating from Airbyte. You can customize the query band to include relevant information such as application name, organization, and user identifiers.
Each entry should be formatted as key=value, separated by semicolons (;).
Example:
appname=myApp;org=myOrganization;
Refer to this guide for more details
Sync overview
Output schema (Raw Tables)
Each stream will be mapped to a separate raw table in Teradata. The default schema in which the raw
tables are created is airbyte_internal. This can be overridden in the configuration. Each table
will contain below columns:
_airbyte_raw_id: a unique uuid assigned by Airbyte to each event that is processed. This is the primary index column. The column type in Teradata isVARCHAR(256)._airbyte_extracted_at: a timestamp representing when the event was pulled from the data source. The column type in Teradata isTIMESTAMP WITH TIME ZONE._airbyte_loaded_at: a timestamp representing when the row was processed into final table. The column type in Teradata isTIMESTAMP WITH TIME ZONE._airbyte_data: a json blob representing with the event data. The column type in Teradata isJSON._airbyte_meta: a json blob representing per-row error/change handling. The column type in Teradata isJSON._airbyte_generation_id: This is one of metadata field and incremented each time you execute a refresh. The column type in Teradata isBIGINT.
Refer to this guide for more details
Final Tables Data type mapping
| Airbyte Type | Teradata Type |
|---|---|
| string | VARCHAR |
| number | FLOAT |
| integer | BIGINT |
| boolean | SMALLINT |
| object | JSON |
| array | JSON |
| timestamp_with_timezone | TIMESTAMP WITH TIME ZONE |
| timestamp_without_timezone | TIMESTAMP |
| time_with_timezone | TIME WITH TIME ZONE |
| time_without_timezone | TIME |
| date | DATE |
Features
The Teradata destination connector supports the following sync modes:
| Feature | Supported?(Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental - Append Sync | Yes | |
| Incremental - Append + Deduped | Yes | |
| Namespaces | Yes |
Schema map
Performance considerations
Getting started
Requirements
You need a Teradata user with the following permissions:
- can create tables and write permission.
- can create schemas e.g:
You can create such a user by running:
CREATE USER airbyte_user as perm=10e6, PASSWORD=<password>;
GRANT ALL on dbc to airbyte_user;
You can also use a pre-existing user but we highly recommend creating a dedicated user for Airbyte.
Setup guide
Set up the Teradata Destination connector
-
Log into your Airbyte Open Source account.
-
Click Destinations and then click + New destination.
-
On the Set up the destination page, select Teradata from the Destination type dropdown.
-
Enter the Name for the Teradata connector.
-
For Host, enter the host domain of the Teradata instance
-
For Default Schema, enter the Default Schema name. The default value is public.
-
For User and Password, enter the database username and password.
-
To customize the JDBC connection beyond common options, specify additional supported JDBC URL parameters as key-value pairs separated by the symbol & in the JDBC URL Params field. Example: key1=value1&key2=value2&key3=value3
These parameters will be added at the end of the JDBC URL that the AirByte will use to connect to your Teradata database.
-
To customize the query band, specify set of name-value pairs in the Query Band field that can be set to the current database session.