Job Description

Role Summary:

Builds, maintains, and optimizes data ingestion pipelines, Lakehouse tables, transformation logic, data quality checks, and operational workflows within Microsoft Fabric. 47

Key Responsibilities:

• Architect and maintain medallion data frameworks.
• Build ingestion pipelines using Data Factory, Spark Notebooks, Dataflows Gen2, Event Streams, and Lakehouse connectors.
• Develop Silver/Gold transformations including cleansing, enrichment, merging, and standardization.
• Implement data quality checks, validation rules, auditing columns, and error-handling patterns.
• Optimize Lakehouse and Delta Lake operations (schema evolution, partitioning, Z-Order, caching, vacuum, compaction).
• Support production operations including monitoring, incident triage, defect resolution, and performance tuning
• Create/Maintain mapping sheets, schema documentation, lineage diagrams, and runbooks.
• Coordinate with analytics teams to prepare model-ready Gold datasets.
• Participate in Agile ceremonies, design reviews, and technical planning.
• Support UAT, test data preparation, and validation activities.

Job Tags

Similar Jobs