Data Engineer

The Data Engineer role exists to ensure that all test‑lab data is trustworthy, accessible, scalable, and usable for engineering, validation, analytics, and decision‑making. The function provides the technical backbone that enables reliable testing, advanced analysis, automation, and long‑term product improvement.

The Data Engineer is responsible for designing and operating the data infrastructure that supports all laboratory test activities. This includes connecting test equipment, building pipelines for high‑frequency and large‑volume datasets, ensuring data quality, and enabling engineers, analysts, and scientists to work efficiently with accurate data.

As the laboratory and organization expand, the role will evolve into a leadership function that guides the long‑term data strategy and leads a multidisciplinary data team.

Key Responsibilities

Key responsibilities include (but are not limited to)

Design, build, and maintain data pipelines for high‑frequency lab data

Integrate test equipment such as battery cyclers (Chroma, Keysight, PEC, PNE), chambers, DAQ systems, and PLCs

Develop ETL/ELT processes to transform raw → validated → curated datasets

Build scalable data storage solutions (data lakes, time-series DBs, structured metadata stores)

Implement data validation, anomaly detection, and quality monitoring

Automate data processing for reporting, dashboards, and analysis

Ensure data traceability, version control, and audit compliance

Work closely with test and validation engineers to understand test profiles, metadata, and measurement methods Support lab technicians with tools that simplify workflows and reduce manual data tasks

Integrate with MES, LIMS, PLM, and other enterprise systems

Troubleshoot data-related issues in test execution or equipment communication

Take increasing ownership of data architecture and long‑term data roadmap

Contribute to documentation standards, data governance, and best practices

• Requirements
• Qualifications and Experience

Engineering in technical data role (Data Engineering, Data Science, Machine Learning) including processing, storage, quality, and management on GCP or AWS

+4 years of relevant experience

Project management experience

Experience in large manufacturing or industrial enterprises with heterogeneous, distributed data sources, demonstrating ability to navigate complexity at scale

Specific skills & Knowledge

Proven experience scaling and re‑architecting data platforms and infrastructure to handle rapid growth and increasing data volumes

Hands-on experience designing and building highly scalable and reliable data architectures using modern cloud and data tooling (e.g., AWS Kinesis, Lambda, Redshift, GCP equivalents; Airflow, dbt; Parquet, Protobuf, Avro)

Strong programming skills in Python, SQL, and general-purpose scripting for automation, data processing, and integration

Deep understanding of ETL/ELT frameworks (Airflow, dbt, Spark, etc.) and experience building production-grade data pipelines

Familiarity with time-series and high‑frequency measurement data, particularly from industrial or test environments

Cloud engineering experience in AWS, GCP, or Azure, including serverless architectures, distributed storage, and stream processing

Experience with CI/CD, Git-based workflows, Docker, and robust software engineering practices

Knowledge of data serialization formats (Parquet, Avro, Protobuf, JSON) and best practices for efficient storage and retrieval

Experience integrating systems via APIs; familiarity with hardware communication protocols such as REST, OPC-UA, and Modbus is a strong plus

Understanding of machine learning concepts and experience supporting data scientists with structured, high-quality datasets

Domain knowledge (Preferred)

Solid engineering foundation (electrical, mechanical, chemical, physical), preferably within the energy, electrical testing, or battery domain

Understanding of sensor calibration, noise, drift, and data validation