For a data load, which is faster: a regular table or temp table? My client asked, and I answered with proof and a working demo you can run yourself.
Zip Files in SSIS With a Script Task and ZipFile
To zip files in SSIS you don’t need a third-party tool. This guest post by Kevin Hazzard shows how a Script Task and the .NET ZipFile class zip a whole folder in a few lines of C#, and which errors to expect.
SQL SERVER – Data Lineage Tracking in ETL Processes – Notes from the Field #124
Tim Mitchell answers the question every ETL developer hears, ‘Where did this data come from?’, and shows how to add data lineage tracking to ETL processes.
BULK INSERT With FORMAT CSV and FIELDQUOTE for Quoted Files
A comma inside a quoted name can break a CSV load without any error. Here is how FIELDQUOTE fixes it, and how to validate what arrives.
Why Use Biml to Build SSIS Packages Faster
Why use Biml when SSIS already has a designer? This guest post by Reeves Smith shows how one XML file and a single variable can generate many near-identical SSIS packages, and when the extra effort pays off.
Batch vs Stream Processing: When Data Cannot Wait
Batch vs Stream Processing is a choice about how long an answer can wait. This post compares an hourly batch job with a 5-minute stream window on the same six orders, covers the cost of real time and shows how to choose.
Data Ingestion: Batch Loads, Change Data Capture and Streams
Data Ingestion is how data moves from the systems that create it into the platform that analyzes it. This post compares batch loads, change data capture and event streams, and shows the captured rows from a small SQL Server table.