At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.
What will you be doing in this role?
* Designs and implements data pipelines and data stores to acquire and prepare data.
* Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
* Carries out routine data quality checks and remediation Programming/software development.
* Designs, codes, verifies, tests, documents, amends and refactors moderately complex programs/scripts.
* Applies agreed standards and tools to achieve a well-engineered result.
* Proposes practical solutions to resolve issues.
* Collaborates in reviews of work with others as appropriate.
* Defines the software modules needed for an integration build and produces a build definition for each generation of the software.
* Assesses the integrity of data from multiple sources.
* Provides advice on the transformation of data from one format/medium to another.
* Enables the availability, integrity and search ability of information through the application of formal data and metadata structures and protection measures.
* Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
* Establishes, modifies and maintains data structures and associated components.
* Communicates the details of data structures and associated components to others using the data structures and associated components
Requirements
What will you be bringing to the team?
* Have at least a high school certificate.
* Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management in an on premise environment.
* At least 4 years' experience planning and maintaining data lakes, databases and pipeline processes, both batch-wise and (near) real-time.
* Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using data integration technologies on premise.
* Experience in using of data engineering tools to support data science, data analytics and data visualization (KNIME, SQL Server, Power BI is the preferred toolset).
* Familiarity with KNIME Analytics Platform and Server is preferred
* Experience with state-of-the-art data engineering, analytics, data integration and pipeline tools/programming language (Python).
* Solid understanding of data security best practices, including data encryption, access controls, authentication/authorization mechanisms, and compliance requirements.
* Experience with monitoring and logging tools to ensure the reliability and performance of data pipelines.
* Familiarity with containerization and orchestration tools such as Docker and Kubernetes is a plus.
* Knowledge of best practice of software development. E.g. CI/CD pipelines, unit/functional testing, following styling guides is a plus.
* Experience working within NCIA or similar defence-related environments is considered an advantage.
* Knowledge of NATO Communication and Information Systems Infrastructure is considered an advantage.
* Prior experience working in an international environment comprising both military and civilian elements is considered an advantage.
* Proficiency in English language a a C1 level.