about me
Raniery Pereira
Senior Data Engineer · Tech Lead
Rio de Janeiro, BR
Senior Data Engineer and Tech Lead based in Rio de Janeiro, Brazil. I build and maintain production Lakehouses on Azure — responsible for the full data stack: from CDC ingestion with ADF, PySpark transformations across Bronze/Silver/Gold layers, to data governance with Unity Catalog. I write about what I learn in production because the real lessons rarely make it into the docs.
Experience
Tech Lead — Azure Lakehouse
Leading the data engineering team responsible for the full Medallion Architecture lifecycle: ingestion from 30+ source systems via CDC and batch, PySpark transformations, and Gold tables consumed by BI and ML workloads.
Senior Data Engineer
Designed and implemented incremental MERGE pipelines in Databricks. Migrated legacy batch loads to event-driven CDC with watermark strategy in ADF, reducing reprocessing costs significantly.
Data Engineer
Built first-generation Delta Lake pipelines. Introduced schema enforcement, data quality checks, and automated alerting for pipeline failures across the Lakehouse.
Tech Stack
Azure DatabricksDelta LakePySparkUnity CatalogAzure Data FactoryADLS Gen2PythonSQLTerraformMedallion ArchitectureCDC IngestionData Contracts