Data Quality Engineer is required by a global IT company to join their growing data engineering team.
You will be responsible for:
- Defining, implementing and managing data quality rules for data ingestion, transformation and reporting layers.
- Developing automated regression and contract tests for data pipelines and business-critical reports.
- Building automated data quality assertions and deployment quality gates for CI/CD pipelines.
- Reproducing reported data issues and converting them into automated regression tests.
- Reviewing transformation logic and data quality changes, ensuring appropriate test coverage.
- Working closely with data engineers and business stakeholders to identify, prioritise and resolve data quality issues.
- Maintaining testing documentation and contributing to continuous improvement of data quality practices.
Required experience and skills:
- Extensive experience testing data pipelines and ETL/ELT processes.
- Strong SQL skills with experience of complex data transformations.
- Experience designing and implementing automated data quality and regression testing.
- Knowledge of schema validation, data reconciliation and contract testing.
- Experience of integrating automated testing into CI/CD pipelines.
- Agile environment experience.