Course Content

Overview of Datastage
• Different components of Datastage
• Capabilities and weakness of Datastage
• Datastage Components
• Version differences

Director
• Director User Interface
• Compiling single and multiple jobs
• Validate, Run, Reset , Restart jobs
• Setting Job Parameters
• Scheduling Jobs
• Checking logs
• Performance monitor on designer
• Job sequencer

Manager
• Importing and exporting jobs and projects
• Managing table definitions
• Managing Job Sequences
• Usage Analysis
• Repository
• Lab Exercises
• Questions

Administrator
• Project Administration
• Setting Env Variables
• Managing Logs
• Enabling RCP
• License Administration
• User Roles and Permissions

Designer
• Simple server job
• Understanding the Generic User Interface
• Toolbars, Pages, Tabs
• Projects, Jobs
• Creating a new job with full hands-on with parallel processing, debugging jobs, partition techniques

Server Jobs
• Pros and Cons Server Vs Parallel jobs
• Server jobs to PX Jobs ??
• Architectural differences
• ODBC Stage
• Hashed File Stage
• Sequential File Stage
• Transformer Stage
• Aggregator Stage
• Folder Stage
• Inter Process Stage
• Link Partitioner Stage
• Link Collector Stage
• Plug Ins
• BASIC Programming
• Datastage Development Kit
• Performance Optimization in Server Jobs
• BASIC commands
• Universe and Unidata Stages

Parallel Extender Overview
• Parallel Extender – Its history
• More about Parallel Extender
• Orchestrate – Command Line options

Designing Parallel Jobs
• Parallel Processing
• Pipeline and Partition Parallelism
• Partition

Parallel Job Stages
• Dataset Stage
• Sequential File Stage
• File Set Stage
• Lookup FiIeset Stage
• External Source Stage
• External Target Stage
• Complex Flat File Stage
• Database
o DB2/UDB Enterprise Stage
o Oracle Enterprise Stage
o Teradata Enterprise Stage
• Transformer Stage
• Transformer Expression Editor
• Difference Between Server and PX Transformers
• Aggregator Stage
• Merge Stage
• Lookup Stage
• Lookup Types
• Funnel Stage
• Sort Stage
• Compress Stage
• Expand Stage
• Copy Stage
• Modify Stage
• Filter Stage
• External Filter Stage
• Change Capture Stage
• Change Apply Stage
• Compare Stage
• Difference Stage
• Switch Stage
• Generic Stage
• Surrogate Key Stage
• Column Import Stage
• Column Export Stage
• Combine Records
• Head Stage
• Tail Stage
• Sample Stage
• Peek Stage
• Row Generator Stage
• Column Generator Stage

Write Range Map Stage
Useful Plug-Ins
• DB2/UDB API Stage Guide
• DB2/UDB Load Stage
• FTP Plug-In Stage

• MS SQL Server Load Stage
• Oracle Express Load Stage
• Oracle OCI Stage Guide
• Pivot Stage
• Sort Stage
• Teradata API Stage
• Teradata Load Stage Guide
• Teradata MultiLoad / TPump / FastExport Stage

Advanced Parallel Extender Concepts
• Designer Tips and Best Practices
• Processing Large Data
• Modular Development using templates
• Type conversions
• Database Tips
• Partition and performance
• Operator choice
• Combining Operators
• User-Defined Stages
o Custom Stages
o Build Ops
o Wrapped Stages
• Environment Variables
• Datastage API
• Containers
o Local Containers
o Shared Containers

DATA STAGE
Other Advanced Topics
• Reports
• Creating Templates
• Generating Reports of jobs BMP and HTML
• Web services
• Explorer Context Menu
• Data Migration Assistant
• Troubleshooting
• Advanced Configuration File Handling
• BASIC commands
• Stored procedure stages
• Data cleansing
• Parallel Job Configuration Files
• Quality Stage
• Metastage

Best Practices and Tips
• Best Practices
• Templates
• Short cuts and time savers
• Performance Tuning

Live Project Example
• Source to Stage Job development and testing
• Full Load and Incremental Load
• Stage to Presentation Layer – Loading

• Containers
o Local Containers
o Shared Containers
• Buffering
• Stage Variables and Constraints
• Generating quick test data
• Handling flat files
• Handling files using XML
• Reusability
• Filtered repository
• Column propagation
• Dangling links
• Mass column definition
• Templates
• Copy/paste from jobs
• Managing Datasets
• Orchestrate Commands for datasets
• SQL Builder
• Performance Tuning

Running Jobs
• Job properties and Parameters
• Job Sequences
• Performance Monitoring
• Print Messages
• JOB Monitor
• Debugging
• Dsrun – Command-Line Options
• Parameter Files
• Automating using scripts
• Debugging, restart ability and Exception Handling
• Checkpoint/Restart
• Automatically Handling Aborts
• WaitForFile Stage
• Notify Stage
• Loops in sequencer
• User Variable Activity
• Exception handling and clean abort in Sequencer
• Notification can send an email with attachments
• Scheduling and running jobs from UNIX
• API Calls