This month's discount Comprehensive Database Performance Health Check · Testimonials
SQLAuthority with Pinal Dave
Home
  • Consulting
    • Health Check
  • Free Videos
  • All Articles
    • AI
    • SQL Performance
    • SQL Tips and Tricks
    • Interview Questions and Answers
    • SQL Puzzle
    • SQL Video
    • SQLAuthority News
    • Personal
  • Books
  • Consulting
A tray of seed potatoes in neat rows, a hand removing one spoiled potato into a red bowl

Reading a JSON Lines File Into a Table With OPENROWSET

October 22, 2013
Pinal Dave
SQL Tips and Tricks
ETL, File format, JSON, SQL Server

Load JSON Lines with OPENROWSET BULK, keep UTF-8 text intact, quarantine invalid objects, and insert validated typed rows.

Read More
Gouache painting of a room split in two: on the left a busy shop counter with a small wooden cash box, a vermilion bell and a stack of paper bags, on the right a quiet study corner with a large table covered in charts drawn as plain colored shapes under a reading lamp.

OLTP vs OLAP: Why Transactions and Analytics Need Different Designs

October 16, 2013
Pinal Dave
SQL Tips and Tricks
ColumnStore Index, Data Warehousing, Database, ETL

OLTP vs OLAP is the difference between recording what’s happening now and studying what’s already happened. This post compares the two designs, tests the same 500,000 orders as a rowstore and a columnstore table on SQL Server 2025, and shows how data moves from one side to the other.

Read More
Gouache painting of one lantern on a table sending small sparks of light along thin threads to a ring of candles, each candle lit by its own spark, with one vermilion candle holder, at dusk.

How Apache Spark Works: Driver, Executors and Partitions

October 8, 2013
Pinal Dave
SQL Tips and Tricks
Data Warehousing, Database, ETL, Parallel

How Apache Spark works comes down to a driver that plans the job, executors that run it, and data cut into partitions. This post follows one sales total through two stages and a shuffle, and compares it with a parallel plan in SQL Server.

Read More
Gouache painting of a three-stage water filtration stand on a workbench, with muddy water in the top tank, cloudier water in the middle tank, and clear water in a glass jar at the bottom, joined by short pipes and a vermilion valve on the last one.

Big Data Architecture Today: The Lakehouse and Medallion Layers

October 4, 2013
Pinal Dave
SQL Tips and Tricks
Batch, Change Data Capture, Cloud Computing, Data Warehousing, ETL

Big Data Architecture today is a pipeline with four jobs: ingest, store, process and serve, with governance underneath. This post explains the lakehouse, the bronze, silver and gold layers, batch and streaming, and where SQL Server 2025 fits.

Read More
Gouache painting split in two: on the left a calm mountain lake with leaves, branches and a small boat floating on its surface; on the right a tidy warehouse shelf of identical plain boxes in straight rows, one box vermilion.

Data Lake vs Data Warehouse: What Each One Is For

October 1, 2013
Pinal Dave
SQL Tips and Tricks
Data Warehousing, Database, ETL, SQL Data Storage

Data Lake vs Data Warehouse is a choice between raw files and cleaned, modeled tables. This post compares schema on read with schema on write, who uses each, and why many teams combine them in a lakehouse.

Read More
Gouache painting of a kitchen counter split in two: on the left, chopped vegetables going neatly into small jars; on the right, whole vegetables in a large wooden crate with a knife beside it, and one vermilion bell pepper in the crate.

ETL vs ELT: How Big Data Changed the Way We Load Data

September 30, 2013
Pinal Dave
SQL Tips and Tricks
Data Warehousing, ETL, JSON, SQL Scripts

ETL vs ELT comes down to when you transform: before the load on a separate engine, or after it inside the platform. This post compares the two and runs a small ELT pipeline in T-SQL on JSON orders.

Read More
A brass bell ringing above a shop door as it opens, a tally counter beside it

Change Data Capture or Change Tracking

July 18, 2013
Pinal Dave
SQL Tips and Tricks
Change Data Capture, ETL, SQL Server, SQL Server Agent, Transaction Log

Change data capture or change tracking serves different sync needs; compare captured detail, retention, cleanup, and operating cost before choosing.

Read More
Previous 1 2 3 4 5 6 … 8 Next
  • Books
  • Testimonials
  • Privacy Policy

© 2006 – 2026 All rights reserved. pinal @ SQLAuthority.com