Job Summary:
We are looking for a highly motivated Data Engineer with a passion for data modeling, data architecture patterns, and modern engineering practices. In this role, you will be instrumental in designing and building scalable, reliable, and high-performance data solutions that power our analytics and business intelligence platforms.
You will work closely with senior data engineers and cross-functional teams to implement robust data models and pipelines using cutting-edge tools in the Azure ecosystem. This is a unique opportunity to shape the foundation of our data infrastructure and contribute to the evolution of our data products.
Duties/Responsibilities:
- Design & Implement Data Models: Develop and maintain dimensional data models and semantic layers that support enterprise reporting and analytics. Apply best practices in data warehousing and data architecture.
- Build Scalable Data Pipelines: Create modular, reusable, and pattern-driven ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, and Databricks.
- Transform & Structure Data: Use Spark SQL, DBT, and Azure Synapse to transform raw data into structured, analytics-ready formats. Implement data quality checks and schema evolution strategies.
- Leverage Azure Technologies: Utilize Azure services such as SQL Server, Synapse Analytics, Databricks, and Delta Lake to build and manage scalable data infrastructure. and data pipelines
- Enable CI/CD & DevOps: Integrate data workflows with Azure DevOps and Git for version control, automated testing, and continuous deployment.
- Support Reporting & Visualization: Collaborate with analysts and BI developers to ensure data models are optimized for tools like Power BI.
- Troubleshoot & Optimize: Monitor and resolve issues in data pipelines and models. Ensure high availability and performance of data systems.
- Stay Ahead of the Curve: Continuously learn and apply the latest in data engineering best practices, tools, and technologies.
Required Skills/Abilities:
- 5–7 years of experience in data engineering or related roles.
- Proven expertise in data modeling (especially dimensional modeling) and data warehouse design.
- Hands-on experience with Azure Data Factory, Synapse Analytics, Databricks, and DBT.
- Strong SQL and Spark SQL skills.
- Experience with CI/CD, DevOps, and version control (Git, Azure DevOps).
- Familiarity with Power BI or similar visualization tools.
- Solid understanding of data integration, data quality, and data transformation best practices.
- Strong problem-solving skills and a collaborative mindset.
Desired Skills/Abilities:
- Experience with Azure Synapse Analytics
- Experience with Infrastructure as Code
- Experience with Databricks, DLT, Autoloader
- Experience with Unity Catalog
- Familiarity with Delta Lake core and Parquet files
- Experience with DBT (Data Build Tool)
- Working understanding of Spark Pool and/or Python
- This role requires extensive experience in data modelling, specifically dimensional modelling
Education and Experience:
At least 5-7 years’ related experience required.