Job Title: Data Engineer Retail Media
The IT department is responsible for the digital infrastructure and software solutions of various companies. They select, provide, operate and further develop IT infrastructure, platforms and business applications to support company departments through IT solutions.
Key Responsibilities:
* Design and implement data-centered features with a cross-functional team for Europe's largest Ad Network.
* Scale data stores, pipelines and ETLs handling terabytes of data from a major retail company.
* Implement efficient data processing workflows.
* Extend reporting platform for external customers and internal stakeholders to measure advertising performance.
* Continuously develop custom data processing pipeline and search for ways to improve technology stack as scale increases.
* Collaborate with machine learning engineers and software engineers to build and integrate fully automated and scalable reporting, targeting and ML solutions.
* Work remotely but meet colleagues in person at company events.
Requirements:
* 3+ years experience working on data-intensive applications.
* Fluency in Python and good knowledge of SQL.
* Experience developing scalable data pipelines using Apache Spark.
* Understanding of efficient algorithms and how to analyze them.
* Curious about databases and other data processing tools.
* Familiarity with git.
* Ability to write testable and maintainable code that scales.
* Excellent communication skills and team-player attitude.
Desirable Skills include:
* Experience with Kubernetes.
* Experience with Google Cloud Platform.
* Experience with Snowflake, Big Query, Databricks and DataProc.
* Knowledge of columnar databases and file formats like Apache Parquet.
* Knowledge of 'Big Data' technologies like Delta Lake.
* Experience with workflow management solutions like Apache Airflow.
* Affinity for Data Science tasks to prototype Reporting and ML solutions.
* Knowledge of Dataflow / Apache Beam.