Iceberg PII Lifecycle

Retention policies, partition and snapshot expiration, orphan-file cleanup, and an automated, verifiable PII purge pipeline in Iceberg.

Implement a full PII retention and purge workflow in Iceberg: write data with retention metadata, expire snapshots, drop partitions, clean orphan files, and verify that erased data is truly gone.

Advanced7 chapters· 2h 50m· in PII & Data Governance

Course content

  1. 01Lesson 1: The PII LifecycleFree
  2. 02Lesson 2: Retention Policies🔒
  3. 03Lesson 3: Partition Expiration🔒
  4. 04Lesson 4: Snapshot Expiration🔒
  5. 05Lesson 5: Orphan File Cleanup🔒
  6. 06Lesson 6: Automating the PII Purge Pipeline🔒
  7. 07Lesson 7: Build an End-to-End Retention & Purge Workflow in Iceberg🔒

Prerequisites

What to learn next

Read the first chapter free

Start reading now — no account required for the free chapters.