As a Data & AI Platform Engineer – Azure Data Engineering you independently design and implement scalable data pipelines on Azure. Use Microsoft Fabric/OneLake, Azure Databricks and Delta Lake technologies to provide reliable data for analytics and AI.
Tasks & Responsibilities:
* Design, development, and maintenance of complex pipelines (batch & streaming) with Data Factory, Databricks, and Delta Lake
* Integration of new Azure features such as mirroring (zero-ETL replication) for continuous synchronization of operational databases with OneLake and Microsoft Fabric for a unified lakehouse architecture
* Implementation of DataOps: CI/CD pipelines with Azure DevOps/GitHub, monitoring via Azure Monitor, and automation with Delta Live Tables or Lakeflow
* Ensuring data quality, governance, and access control (Azure Purview, Unity Catalog)
* Collaboration with cross-functional teams and optimization of the platform in terms of performance and costs
A hybrid/remote setup is possible in Germany (primary residence required)
* Several years of experience in developing data platforms on Azure (Data Factory, Databricks, Microsoft Fabric)
* In-depth knowledge of SQL, Python/Spark, and Delta Lake technologies
* Familiarity with Azure Monitoring, data catalogs (Purview), and CI/CD in DevOps
* Strong problem-solving and communication skills; ability to work independently
* Very good German and English skills