Designing an ETL Solution Architecture Using Microsoft SQL Server 2005 Integration Services

This course is intended for experienced Business Intelligence (BI) professionals. The target students for this course already have experience of using the SQL Server 2005 tools to implement ETL functionality, but need to develop their understanding of design principles and best practices when planning, implementing, and deploying an ETL solution.

After completing this course, students will be able to:

• Plan data transfer and staging solutions for an ETL operation.
• Plan an SSIS Solution.
• Design and implement data flows.
• Incorporate logging, error handling, and reliability into a package.
• Optimize an SSIS solution.
• Deploy and operate an SSIS solution.

MODULE 1: Planning for ETL

In this module, Students will learn how to plan the way in which data will be transferred and staged in an ETL solution.

Lessons

• Identifying Data Sources and Destinations
• Evaluating Source DataIdentifying Staging Requirements

Lab 1: Planning an ETL Solution

• Identifying ETL RequirementsExamining Source Data

MODULE 2: Planning an SSIS Solution

In this module, students will learn how to plan an SSIS-based ETL solution. Specifically, they will learn how to plan SSIS packages, how to plan an effective package development process, and how to design the control flow within the packages.

Lessons

• Planning Packages
• Planning Package Development
• Designing Package Control Flow

Lab 2: Implementing SSIS Packages

• Designing an SSIS Solution
• Creating a Package Template
• Implementing SSIS Packages

MODULE 3: Designing Data Flow

In this module, students will learn how to design data flows that extract, transform, and load data. They will also learn about factors to consider when working with slowly changing dimensions (SCDs) and when implementing custom SCD transformations.

Lessons

• Understanding Data Flow
• Designing Data Flow Operations
• Handling Data Changes

Lab 3: Implementing Data Flow

• Designing Data Flow
• Implementing Data Flow

MODULE 4: Logging, Error Handling, and Reliability

In this module, students will learn how to incorporate logging, error handling, and reliability into your SSIS package designs. The module covers standard logging, custom logging, and log reporting. The module also teaches students how to implement error handling and how to handle bad data. Finally, the module shows students how to implement a transaction strategy, use checkpoints, and handle restarts and rollbacks.

Lessons

• Logging ETL Operations
• Handling Errors in SSIS
• Implementing Reliable ETL Processes with SSIS

Lab 4: Implementing Reliable Packages

• Implementing Logging
• Implementing Error Handling
• Implementing Transactions and Checkpoints

MODULE 5: Optimizing an SSIS Solution

In this module students will learn how to monitor and optimize SSIS performance. They will also learn how to scale-out SSIS packages

Lessons

• Monitoring SSIS Performance
• Optimizing SSIS Packages Scaling Out SSIS Packages

Lab 5: Optimizing Packages

• Monitoring SSIS Optimizing an SSIS Package

MODULE 6: Deploying and Operating an SSIS Solution

This module describes considerations for deploying an SSIS solution into a production environment. It also discusses some of the issues related to operations and management that you must consider when planning an SSIS solution.

Lessons

• Deploying SSIS Packages
• Operating an SSIS Solution

Lab 6: Deploying and Managing Packages

• Deploying an SSIS Solution
• Backing Up an SSIS Package