Role Overview
- Build scalable data pipelines and transformation frameworks using Azure Synapse, ADF / Microsoft Fabric / Databricks.
- Implement modern medallion architecture and optimize SQL-based data processing.
- Work with architects, modelers, and business SMEs to deliver high-quality cloud data solutions.
-
Key Responsibilities
Data Engineering & Pipelines
- Develop ETL/ELT pipelines using Synapse Pipelines, Mapping Dataflows, ADF, and Fabric Data Pipelines / Databricks.
- Implement complex data transformations and scalable batch/micro-batch ingestion patterns.
Data Warehousing & Modeling
- Build end-to-end data warehouse solutions in Synapse and Fabric Lakehouse.
- Design fact/dimension models; optimize SQL, views, and transformations.
Medallion Architecture
- Implement Bronze / Silver / Gold / Platinum / Copper layers.
- Ensure data lineage, validation, and metadata consistency.
Performance Optimization
- Tune SQL queries, partitions, distributions, and pipeline performance.
- Enhance scalability and fault-tolerance across workloads.
Collaboration & Governance
- Partner with architects, analysts, and SMEs on business logic translation.
- Produce documentation and support data governance processes.
-
Required Skills
- 6–10 years of data engineering experience.
- Strong hands-on expertise with Azure Synapse Analytics/Fabric.
- Advanced SQL (T-SQL, DW optimization).
- Experience with Mapping Dataflows and Medallion architecture.
- Knowledge of Delta Lake (Synapse/Fabric).
-
Preferred Skills
- Azure Databricks, ADLS Gen2.
- CI/CD with Git for Synapse/ADF/Fabric/Databricks.
- Data quality and validation frameworks.
-
Soft Skills
- Strong analytical problem-solving ability.
- Excellent communication and documentation.
- Ability to work independently and cross-functionally.
