This month's discount Comprehensive Database Performance Health Check · Testimonials
SQLAuthority with Pinal Dave
Home
  • Consulting
    • Health Check
  • Free Videos
  • All Articles
    • AI
    • SQL Performance
    • SQL Tips and Tricks
    • Interview Questions and Answers
    • SQL Puzzle
    • SQL Video
    • SQLAuthority News
    • Personal
  • Books
  • Consulting
Gouache painting of a wooden mail sorting rack where blank envelopes in three colors are sorted into their own columns, with three bundles tied with string at the end of the counter, one tied in vermilion.

MapReduce Explained: Map, Shuffle and Reduce Step by Step

October 9, 2013
Pinal Dave
SQL Tips and Tricks
Data Warehousing, Database, Parallel, SQL Function

MapReduce splits a big job into many small map tasks, moves the results by key in a shuffle, and adds them up in reduce tasks. This post walks one word count through every step, with a recreated diagram and the same idea in T-SQL.

Read More
One very tall shelf beside a long row of short shelves in a warehouse

Horizontal and Vertical Scaling for Databases

October 8, 2013
Pinal Dave
SQL Tips and Tricks
Database, Hardware, SQL High Availability, SQL Server

Horizontal and vertical scaling solve different SQL Server capacity problems; compare larger machines, additional nodes, and the costs each brings.

Read More
Gouache painting of one lantern on a table sending small sparks of light along thin threads to a ring of candles, each candle lit by its own spark, with one vermilion candle holder, at dusk.

How Apache Spark Works: Driver, Executors and Partitions

October 8, 2013
Pinal Dave
SQL Tips and Tricks
Data Warehousing, Database, ETL, Parallel

How Apache Spark works comes down to a driver that plans the job, executors that run it, and data cut into partitions. This post follows one sales total through two stages and a shuffle, and compares it with a parallel plan in SQL Server.

Read More
Gouache painting of a simple three-legged wooden stool on a wooden floor, one leg noticeably shorter and painted vermilion, the stool still balanced but tilted slightly against a plain wall in soft daylight.

What Is NoSQL? Data Models, the CAP Theorem and Trade-Offs

October 7, 2013
Pinal Dave
SQL Tips and Tricks
ACID, JSON, MongoDB, NoSQL

What Is NoSQL? It is a family of data models other than the classic table, each built for one kind of access pattern. This post covers the four data models, eventual consistency and the CAP theorem in plain words, and how to choose.

Read More
A bulb planter beside separate clusters of shoots and empty planting hollows

Cohort Retention Tables in T-SQL: From Raw Events to a Grid

October 6, 2013
Pinal Dave
SQL Tips and Tricks
Business Intelligence, CTE, SQL DateTime, SQL Group By

Build a retention grid from raw orders with five rows you can check by eye. Includes the DISTINCT rule and why unfinished months show NULL.

Read More
Balloons tied to a garden bench in color groups, with one lone red balloon.

Counting Current Connections by Login, Host and Application

October 5, 2013
Pinal Dave
SQL Tips and Tricks
DBA, SQL Connection, SQL DMV, SQL Monitoring

Try counting current connections by login, host, application and database, then inspect sleeping transactions and save a baseline.

Read More
Gouache painting of a three-stage water filtration stand on a workbench, with muddy water in the top tank, cloudier water in the middle tank, and clear water in a glass jar at the bottom, joined by short pipes and a vermilion valve on the last one.

Big Data Architecture Today: The Lakehouse and Medallion Layers

October 4, 2013
Pinal Dave
SQL Tips and Tricks
Batch, Change Data Capture, Cloud Computing, Data Warehousing, ETL

Big Data Architecture today is a pipeline with four jobs: ingest, store, process and serve, with governance underneath. This post explains the lakehouse, the bronze, silver and gold layers, batch and streaming, and where SQL Server 2025 fits.

Read More
Gouache painting of storage objects in a row showing time passing: a bound paper ledger, a wooden card catalog drawer with a vermilion handle, a metal filing cabinet, a tall server rack with small lights, and a soft cloud floating above an open shelf.

Evolution of Big Data: From Flat Files to the Lakehouse

October 3, 2013
Pinal Dave
SQL Tips and Tricks
Cloud Computing, Data Warehousing, Database, Normalization

Evolution of Big Data follows one pattern: data grew, the old tool strained, and someone built the next one. This post walks from flat files and the relational model through warehouses and the cloud to the lakehouse.

Read More
Gouache painting of five objects in a row on a long wooden table: a huge barrel, a small fast water wheel splashing, a basket of mixed fruits and vegetables, a magnifying glass resting on a balance scale, and one ripe pear tinted vermilion glowing in soft light.

The 5 Vs of Big Data: Volume, Velocity, Variety, Veracity and Value

October 2, 2013
Pinal Dave
SQL Tips and Tricks
Data Observability, Data Warehousing, Database

The 5 Vs of Big Data are volume, velocity, variety, veracity and value. This post walks a grocery chain through each one, so you can ask the same five questions about your own data before you choose a tool.

Read More
Gouache painting split in two: on the left a calm mountain lake with leaves, branches and a small boat floating on its surface; on the right a tidy warehouse shelf of identical plain boxes in straight rows, one box vermilion.

Data Lake vs Data Warehouse: What Each One Is For

October 1, 2013
Pinal Dave
SQL Tips and Tricks
Data Warehousing, Database, ETL, SQL Data Storage

Data Lake vs Data Warehouse is a choice between raw files and cleaned, modeled tables. This post compares schema on read with schema on write, who uses each, and why many teams combine them in a lakehouse.

Read More
Previous 1 … 325 326 327 328 329 330 331 … 593 Next
  • Books
  • Testimonials
  • Privacy Policy

© 2006 – 2026 All rights reserved. pinal @ SQLAuthority.com