Data Engineering Position
We are seeking a highly skilled Data Engineer to join our team. In this role, you will design and implement effective data processing architectures in Python, working closely with our team of data scientists. Our goal is to continuously improve business processes at our company using state-of-the-art machine learning and optimization techniques.
* We are looking for someone who can extract, transform, analyze, clean and model data from different sources.
* Responsibilities also include implementing and operating maintainable and reliable data pipelines using PySpark and Airflow with a strong focus on data quality.
* As a Data Engineer, you will strive to understand how the data is actually generated and what impact this has on data quality and our use cases through proactive communication with other departments.
* You will operationalize machine learning pipelines together with a team of highly motivated data scientists.
* A key part of your job will be architecting and developing continuous integration & deployment processes.
* You will also operate and optimize Hadoop (Cloudera) clusters with support of the DevOps and Infrastructure teams.
* Mentorship is an important aspect of this position, as you will mentor more junior team members through insightful code reviews and pair programming sessions.
Requirements:
* We require a Master's degree in Computer Science or equivalent.
* A minimum of three years' experience as a data engineer or similar position is necessary.
* You should have extensive experience with Spark, Hadoop, SQL & relational databases, data models and ETL pipelines.
* The ability to write efficient, well-tested code with a keen eye on scalability and maintainability in Python; Airflow and Scala experience is a plus.
* Docker, Kubernetes and usage of continuous integration & deployment is also a plus.
* Good Linux knowledge is essential.
* This position requires strong teamwork skills and good communication abilities.
* Fluent English is a must-have.
Benefits:
* We offer a secure, permanent job in a future-proof industry that is characterized by growth.
* You will participate in shaping the digital transformation in an innovative company.
* We provide a permanent employment contract with 30 days of vacation, an attractive salary and further training opportunities/career model.
* An onboarding program is available to ensure a smooth transition into the role.
* Numerous benefits, such as a diverse food selection in our canteens and company events, are offered to all employees.
Note:
NEW YORKER is an equal opportunity employer and welcomes applications from people of all backgrounds. The most important thing is that you fit in with us and contribute to our company's success.