Senior Data Analyst - Databricks & PySpark
Standort: Neckarsulm
Abteilung / Bereich: E-Commerce
Level: Berufserfahrene
Referenznummer: 2316
Minimum 8 years of experience as a data or BI analyst
Demonstrated ability in stakeholder communication and management
Experience working with Agile methodology
Ability to work flexibly and independently
Experience in creating and maintaining project documentation
Good understanding of related data disciplines (e.g. data engineering, data science)
Ability to understand, analyze and translate business requirements into data-driven solutions
Enthusiasm for collaboration, knowledge sharing and joint learning
Very good English skills - German is a plus at minimum B1 level.
Einleitungstext
As a digital system provider for Lidl's online business, we at Lidl e-commerce create efficient, scalable digital products and services and develop them further for the future. As a brand of the IT and digital division Schwarz Digits, our divisions are divided into Commerce Platforms, Marketing Tech & Enablement, Payment, New Digital Business Models and SCRM Loyalty Platforms.
Your tasks
Perform exploratory data analysis on large datasets to identify inconsitencies, trends & anomalies
Building ETL pipelines & curate data following medallion architecture
Ensuring data quality & integrity: design and implement robust data quality frameworks, including unit tests and automated schema checks
Apply statistical methods & techniques to answer business questions
Experience with Databricks and Snowflake platforms
Strong proficiency in SQL (nice to have), PySpark and Python (must have)
Proficiency with local development tools including VSCode, PyCharm, and Git
Experience in building reports
Being able to work with or in a setup with: CI/CD, Unit & Integration Tests, Code Quality Tools, Vulnerability Scans
Working in Cloud Environments