Cleaning Up Dirty Data with SSIS
Dirty data is everywhere, and it's headed for a database near you. Extraction, transformation, and loading (ETL) can be difficult, but often the most challenging component of that process is the validation and clean up of data. Information must be cleansed in such a way that it retains its original message and business value, while conforming to the expectations of the destination system(s).
In this session, we'll discuss some design patterns for addressing different types of dirty data using SQL Server Integration Services. We will review the various cleansing tools accessible from within SSIS including native Integration Services components, T-SQL, and SSIS scripting. In addition, we'll briefly review the new SQL Server Data Quality Services and its integration with SSIS. We'll cap off the discussion with demonstrations of several methods for data cleansing.
Tim Mitchell is a business intelligence consultant, database developer, speaker, and trainer. He has been working with SQL Server for over 10 years, working primarily in business intelligence, ETL/SSIS, database development, and reporting. He has earned a number of industry certifications and holds a Bachelor's Degree in Computer Science from Texas A&M at Commerce, and is a Microsoft SQL Server MVP. Tim is an independent business intelligence consultant and a group principal with Linchpin People.
As an active member of the community, Tim has spoken at national, regional, and local venues including the SQL PASS summit, SQL Connections, numerous SQL Saturday events, and various user groups and PASS virtual chapters. He is active in the North Texas SQL Server User Group in Dallas, and is a volunteer for PASS. Tim is an author and forum contributor on SQLServerCentral.com and has published dozens of SQL Server training videos on SQLShare.com.
Tim is a contributing author on the charity book project MVP Deep Dives 2, and is coauthor of SSIS Design Patterns.
You can visit his website and blog at TimMitchell.net or follow him on Twitter at twitter.com/Tim_Mitchell.