What is more optimal for the data load – Temp Table or Regular table? Why? The question was very simple but interesting one and I have decided to answer.
SQL SERVER – Data Lineage Tracking in ETL Processes – Notes from the Field #124
[Notes from Pinal]: Everybody knows about ETL Processes. It is a simple process where data is extracted, transformed and loaded into an application or database. However, still today, not many people know about how to do data lineage tracking in ETL processes.
SQL SERVER – Who needs ETL Version Control?
While making some changes (read: mistakes) to my ETL business logic the other day, it occurred to me much too late that those unfortunate changes had replaced the once properly working logic with now very flawed logic. The good news was that I remembered what the working logic was supposed…
Read MoreSQL SERVER – Introduction to Adaptive ETL Tool – How adaptive is your ETL?
I am often reminded by the fact that BI/data warehousing infrastructure is very brittle and not very adaptive to change. There are lots of basic use cases where data needs to be frequently loaded into SQL Server or another database. What I have found is that as long as the sources…
Read MoreSQL SERVER – 4 Tips for ETL Software IDE Developers
In a previous blog, I introduced the notion of Semantic Types. To an end-user, a seamlessly integrated semantic typing engine significantly increases the ease of use of an ETL IDE (integrated development environment, or developer studio). This led me to think about other ease-of-use issues I have encountered while building ETL…
Read More