This month's discount Comprehensive Database Performance Health Check · Testimonials
SQLAuthority with Pinal Dave
Home
  • Consulting
    • Health Check
  • Free Videos
  • All Articles
    • AI
    • SQL Performance
    • SQL Tips and Tricks
    • Interview Questions and Answers
    • SQL Puzzle
    • SQL Video
    • SQLAuthority News
    • Personal
  • Books
  • Consulting
Gouache painting of a wooden ladder with four rungs leaning against a tall window, with a small brass telescope on the sill at the top looking out over a wide landscape, the top rung painted vermilion.

Big Data Analytics: Descriptive, Diagnostic, Predictive and Prescriptive

October 24, 2013
Pinal Dave
SQL Tips and Tricks
Business Intelligence, Data Warehousing, Mathematical Function, SQL Function

Big Data Analytics answers four kinds of questions: what happened, why it happened, what will happen next and what to do about it. This post climbs that ladder with one small business and shows each step in T-SQL window functions.

Read More
Gouache painting of a small reservoir fed three ways: a steady stream from a hillside, a slow pipe on the left, and a wooden cart of barrels with vermilion wheels waiting at the edge.

Data Ingestion: Batch Loads, Change Data Capture and Streams

October 23, 2013
Pinal Dave
SQL Tips and Tricks
Batch, Change Data Capture, Data Warehousing, ETL, Transaction Log

Data Ingestion is how data moves from the systems that create it into the platform that analyzes it. This post compares batch loads, change data capture and event streams, and shows the captured rows from a small SQL Server table.

Read More
Gouache painting of a stack of loose blank pages being clipped into a sturdy ring binder with colored tabs along the edge and a vermilion ribbon bookmark, with older loose pages lying beside it.

Open Table Formats: Delta Lake and Apache Iceberg Explained

October 21, 2013
Pinal Dave
SQL Tips and Tricks
Cloud Computing, Data Warehousing, Database, File format

Open Table Formats turn a folder of Parquet files into a real table with transactions, history and safe schema changes. This post shows how Delta Lake and Apache Iceberg do it with a metadata layer, how a commit stays atomic, and what time travel means.

Read More
Gouache painting of three objects on a table: tall columns of stacked colored tiles, a corkboard with pins joined by threads in a network with one vermilion thread, and a small globe on a stand.

Columnar, Graph and Spatial Databases: Three Shapes of Data

October 18, 2013
Pinal Dave
SQL Tips and Tricks
ColumnStore Index, Data Warehousing, Database, Spatial Database

Columnar, Graph and Spatial Databases are three data models built for three kinds of questions: totals over many rows, paths through relationships, and distances between places. This post explains each one and builds all three in SQL Server 2025 with columnstore, graph tables and the geography type.

Read More
Gouache painting of a room split in two: on the left a busy shop counter with a small wooden cash box, a vermilion bell and a stack of paper bags, on the right a quiet study corner with a large table covered in charts drawn as plain colored shapes under a reading lamp.

OLTP vs OLAP: Why Transactions and Analytics Need Different Designs

October 16, 2013
Pinal Dave
SQL Tips and Tricks
ColumnStore Index, Data Warehousing, Database, ETL

OLTP vs OLAP is the difference between recording what’s happening now and studying what’s already happened. This post compares the two designs, tests the same 500,000 orders as a rowstore and a columnstore table on SQL Server 2025, and shows how data moves from one side to the other.

Read More
Gouache painting of two boxes of colored pencils side by side, one wide box with all colors mixed together in rows and the other with the same pencils standing in tall separate cups, one color to a cup, with one vermilion cup.

Columnar File Formats: Why Parquet Changed Big Data

October 10, 2013
Pinal Dave
SQL Tips and Tricks
ColumnStore Index, Compression, Data Warehousing, File format

Columnar file formats store a table one column at a time, so a report reads and compresses only the columns it needs. This post compares rows and columns on a tiny table, explains how a Parquet file is laid out, and measures the size difference in SQL Server 2025.

Read More
Gouache painting of a wooden mail sorting rack where blank envelopes in three colors are sorted into their own columns, with three bundles tied with string at the end of the counter, one tied in vermilion.

MapReduce Explained: Map, Shuffle and Reduce Step by Step

October 9, 2013
Pinal Dave
SQL Tips and Tricks
Data Warehousing, Database, Parallel, SQL Function

MapReduce splits a big job into many small map tasks, moves the results by key in a shuffle, and adds them up in reduce tasks. This post walks one word count through every step, with a recreated diagram and the same idea in T-SQL.

Read More
Previous 1 2 3 4 5 6 … 11 Next
  • Books
  • Testimonials
  • Privacy Policy

© 2006 – 2026 All rights reserved. pinal @ SQLAuthority.com