Instrumenting, Monitoring and Auditing of SSIS ETL Solutions

2009

TL; DR

Come to this session to see how you can create a logging, monitoring and profiling solution for your existing or new SSIS packages overcoming all usual problems that a typical solution brings: increasing package complexity, longer development times and so on. The session will propose a standard, out-of-the-box solution for all of these challenges.

Session Details

Have you ever been struck by the lack of detailed logging available within SQL Server Integration Services (SSIS) packages?

If the answer to this question is yes, then you are probably a seasoned Business Intelligence solutions builder. The packages that make up your solutions probably contain extra code to facilitate effective monitoring, control and profileing. However, increasingly, SSIS is being used to unify data found on disparate yet related transactional systems. The batch processes that perform this activity thus become a vital part of the information processing ecosystem. These need to be monitored and profiled in the same way as formal BI solutions but often the resources available are much more meager. What do you do when something goes wrong and the functionality of the packages is not transparent via internal state reporting.

This session will introduce you to an improved version of DTExec. By passing the appropriate state flags it can reveal the internal activity of packages without having to make any changes to the packages themselves.

3 things you'll get out of this session

Davide Mauri's previous sessions

The 10 things every developer must absolutely know about Azure SQL

The engine powering Azure SQL and SQL Server databases has been around for 30 years and has evolved a lot during that time. In this session we'll see many of this "little" but yet incredibly useful features and knowledge bits, with a lot of demos and a lot of lateral thinking.

My application is fully concurrent and async. What about the database?

Let's look at how concurrency works inside the database. If you want to create a truly scalable solution, this knowledge is needed as much as knowledge about threads and synchronization mechanisms in your favorite language.

Jamstack Foundations: Building Scalable API from the Ground Up

In this session, we'll see an end-to-end demo of how we can build a Jamstack site in Azure, using Azure Static Web Apps and Azure Functions, and taking advantage of well-known and less known features of Azure SQL that will make you – the developer – productive and efficient as never before. From Graph Models to JSON, from REST to GraphQL, this code-heavy demo packed session will show all you need to build end-to-end modern, scalable, solutions. CI/CD included.

Practical Azure SQL for the Modern Developer

Come learn how to take advantage of everything Azure SQL can offer to a developer

Temporal Snapshot Fact Table

Snapshots without snapshots...is that possible? Take a "Classic" snapshot fact table, add some temporal data theory and you'll get a new fact table than can store snapshot data without doing snapshots. A life saver when you have a lot of data.