Senior Data Analyst - Databricks & PySpark
* Standort: Neckarsulm
* Abteilung / Bereich:
* Level: Berufserfahrene
* Referenznummer: 2316
* Minimum 8 years of experience as a data or BI analyst
* Demonstrated ability in stakeholder communication and management
* Experience working with Agile methodology
* Ability to work flexibly and independently
* Experience in creating and maintaining project documentation
* Good understanding of related data disciplines (e.g. data engineering, data science)
* Ability to understand, analyze and translate business requirements into data-driven solutions
* Enthusiasm for collaboration, knowledge sharing and joint learning
* Very good English skills - German is a plus at minimum B1 level.
Einleitungstext
As a digital system provider for Lidl's online business, we at Lidl e-commerce create efficient, scalable digital products and services and develop them further for the future. As a brand of the IT and digital division Schwarz Digits, our divisions are divided into Commerce Platforms, Marketing Tech & Enablement, Payment, New Digital Business Models and SCRM Loyalty Platforms.
Your tasks
* Perform exploratory data analysis on large datasets to identify inconsitencies, trends & anomalies
* Building ETL pipelines & curate data following medallion architecture
* Ensuring data quality & integrity: design and implement robust data quality frameworks, including unit tests and automated schema checks xwminpx
* Apply statistical methods & techniques to answer business questions
* Experience with Databricks and Snowflake platforms
* Strong proficiency in SQL (nice to have), PySpark and Python (must have)
* Proficiency with local development tools including VSCode, PyCharm, and Git
* Experience in building reports
* Being able to work with or in a setup with: CI/CD, Unit & Integration Tests, Code Quality Tools, Vulnerability Scans
* Working in Cloud Environments