Learn how to implement PII masking in dbt on AWS Glue using a metadata-driven approach powered by Jinja macros and post-hooks. This guide shows how to protect sensitive data in non-production environments without modifying model SQL, using Spark SQL and Iceberg tables for scalable, deterministic masking.
In this article, Fabio Ramos explains how you can implement Apache Iceberg in your modern data architecture.
In this article, Fabio Ramos explains how you can implement Apache Iceberg in your modern data architecture.
We’ll discuss how to implement data warehousing ETL using Iceberg for data storage/management and Spark for data processing. A Pyspark ETL app will be used for demonstration in an EMR local environment. Finally the ETL results will be queried by Athena for verification.
