Westhouse is one of the leading international recruitment agencies for the procurement of highly qualified experts in fields such as IT lifecycle management, SAP, engineering, commerce and specialist consultancy.
For our client we are currently looking for a Senior Data Engineer (Python/Databricks) (m/f/d) - Remote, Berlin.
Your tasks
1. Design, building, and optimization of Databricks notebooks and structured workflows, ensuring clear, modular, and reusable code practices for efficient and maintainable data transformation.
2. Management of Databricks tables, optimization of storage layers, and implementation of effective partitioning, indexing, and data compaction strategies for performance, cost-efficiency, and scalability.
3. Deployment of data pipelines and analytics solutions using Databricks best practices, promoting version control, continuous integration, testing, and monitoring.
4. Design and development of data pipelines and automation scripts using python code reviewing in coordination with the development
5. Contribution to delivering a secure and quality code
6. Coordination with various stakeholders to align development with governance, security, and compliance requirements
7. Contribution to technical refinement session to challenge the technical needs for the project
8. Documentation for understanding the technical aspects of the project