Data Engineer
(m/f/d)
Arbeitnehmerüberlassung Kleinmachnow Start date: asap Reference number: 863942/1
Diesen Job teilen oder drucken
Responsibilities
1. Design, build, and optimize batch data pipelines for internal tool use cases
2. Develop efficient Spark SQL transformations for large-scale datasets
3. Use Python for data processing, orchestration, and automation
4. Create and maintain data models (facts, dimensions, aggregates) with clear grain and metric definitions
5. Ensure data quality and correctness, including handling late data, duplicates, and adjustments
6. Implement validation, data quality checks, and reconciliation logic
7. Work with business stakeholders to gather requirements, define metrics, and translate needs into pipelines
8. Collaborate with infrastructure teams on standards, performance tuning, and best practices
Profile
9. Bachelor oder Master degree in a technical field or an equivalent qualification
10. Experience in data engineering or a related field
11. Strong proficiency in Spark SQL for large-scale data transformations
12. Solid Python skills for data processing and pipeline development
13. Strong understanding of data modeling (fact tables, dimensions, grain, SCDs)
14. Hands-on experience building and maintaining batch pipelines in production
15. High attention to detail with a strong focus on data quality and metric integrity
16. Ability to communicate clearly with non-technical stakeholders and translate business needs into data solutions
Benefits
17. Remuneration in the most attractive collective agreement in the industry
18. Annual leave entitlement of 30 days
19. Generous working time account with the possibility to pay overtime
20. Subsidization of direct insurance (as company pension scheme)