Teradata Parallel Transporter load/extract from SQL Server, Oracle, DB2, Sybase

I have consulted on several projects to load critical data into the Teradata Data Warehouse from heterogeneous data sources.  These include SQL Server, Oracle, DB2, and Sybase using Progress DataDirect Connect drivers with the Teradata Parallel Transporter (TPT) ODBC operator.  These organizations were capitalizing on their Teradata Data Warehouse investment, and you can hear other TPT success stories at Teradata Partner's Conferences.

What is Teradata Parallel Transporter?

• TPT is a flexible and high performance load/unload tool for the Teradata Database that supports ODBC source operators.
• TPT efficiently transports vast amounts of data using core data warehousing fundamentals of parallelism and scalability.
• From Teradata's website, "Unlike conventional utilities and products in which multiple data sources are usually processed in a serial manner, Teradata Parallel Transporter can access multiple data sources in parallel. This ability can lead to increased throughput. Teradata Parallel Transporter also allows different specifications for different data sources and, if their data is UNION-compatible, merges them together."

When to use the Teradata Parallel Transporter ODBC operator?

• When extracting large amounts of data from external non-Teradata databases.
• ODBC operator is recommended when running TPT scripts and utilities without requirement for a third party ETL/ELT adapter.  TPT does support SQL-like transformations.

Why choose Progress DataDirect to power the Teradata PT?

• DataDirect Connect is the only suite of ODBC drivers supported by Teradata on Unix/Linux (Requirement documented in chapter 15 ODBC Operator).
• Progress DataDirect provides superior ODBC connectivity on all platforms supported by TPT Utilities to SQL Server, Oracle, DB2, Sybase, Informix, MySQL, Postgres, Salesforce, mainframe integration, or custom applications and data sources.
• TPT on Unix/Linux platforms was developed using the DataDirect Unix/Linux Driver Manager, and Teradata's native ODBC driver is compatible with our driver manager.
• The scalability and parallelism is provided by the in memory data stream that moves large amounts of data from ODBC operator consumers into Teradata.  Progress DataDirect drivers consume less CPU and memory than native drivers to increase throughput into Teradata.
• DataDirect Connect drivers thrive in the high throughput parallel world of loading lots of data via ODBC.  And from working with Teradata Data Warehouses, this operator would blow alternate drivers out of the water (see first bullet).
• You have wasted the capabilities of TPT if any part of the architecture does not scale, including the ODBC driver.

How much data can I move using Progress DataDirect + TPT?

• Disclaimer: The answer to this may vary significantly from environment to environment.  Recently, I worked with a Teradata shop running TPT on AIX, and throughput from an Oracle extract was 6 GB/hour using DataDirect Connect for ODBC Oracle Wire Protocol driver.  The project required additional throughput to be a feasible solution.   In working with myself and Teradata, we were able to achieve 30 GB/hour throughput by tuning the ODBC driver, and using parallel processing of the ODBC extract operators.  For additional information, you can read about TPT in the Users, Reference and Programmers guides from Teradata.

Get connected in 15 minutes from your TPT server

1. Download a free DataDirect Connect for ODBC trial to connect an unlimited number of  TPT ODBC producer operators.

2. Test connect using our quick start guide from the Evaluation Help Center.

3. Call us today at 1-800-876-3101 to speak with a live Solutions Consultant to learn how other Teradata shops are making progress with TPT and DataDirect Connect.