about me
Raniery Pereira
Senior Data Engineer · Tech Lead
Rio de Janeiro, BR
Senior Data Engineer and Tech Lead in Rio de Janeiro. I've spent the last few years building Azure Lakehouses in production — the kind where a broken CDC job is your problem to fix at any hour. I write about what I figure out because the real lessons don't make it into the docs.
Experience
Tech Lead — Azure Lakehouse
Leading the data engineering team on a production Azure Lakehouse. We ingest from 30+ source systems — mix of CDC and batch — and Gold layer outputs feed both BI dashboards and ML models.
Senior Data Engineer
Designed incremental MERGE pipelines in Databricks and migrated nightly batch loads to event-driven CDC in ADF. Most tables went from hours of reprocessing to minutes.
Data Engineer
Built the first Delta Lake pipelines. Added schema enforcement and data quality checks — the kind that catch silent source changes before they corrupt the Silver layer.
Tech Stack
Azure DatabricksDelta LakePySparkUnity CatalogAzure Data FactoryADLS Gen2PythonSQLMedallion ArchitectureCDC IngestionData Contracts