Tag: Data Engineering

All the articles with the tag "Data Engineering".

• Maintaining Apache Iceberg Tables: Compaction, Snapshot Expiration, and Orphan File Cleanup

  Published:May 22, 2026 |  at 10:00 AM

  An in-depth guide to orchestrating maintenance operations on Apache Iceberg tables, covering bin-packing, sort-based, Z-Order compaction, snapshot expiration, and orphan file removal, with query acceleration details for the Dremio engine.

• Apache Iceberg with Spark: Create, MERGE, Upsert, and Evolve Tables End to End

  Published:May 22, 2026 |  at 10:00 AM

  A comprehensive developer guide to configuring Apache Spark with Apache Iceberg, executing transactional writes, and managing schema evolution.

• Common Misconceptions About Data Lakehouse and Apache Iceberg

  Published:May 22, 2026 |  at 09:00 AM

  Addressing common search queries and reader confusion about Data Lakehouse architectures, Apache Iceberg catalogs, partitions, and lock-in.