Job Summary:
We are looking for a highly motivated Data Engineer with a passion for data modeling, data architecture patterns, and modern engineering practices. In this role, you will be instrumental in designing and building scalable, reliable, and high-performance data solutions that power our analytics and business intelligence platforms.
You will work closely with senior data engineers and cross-functional teams to implement robust data models and pipelines using cutting-edge tools in the Azure ecosystem. This is a unique opportunity to shape the foundation of our data infrastructure and contribute to the evolution of our data products.
Duties/Responsibilities:
1. Design & Implement Data Models: Develop and maintain dimensional data models and semantic layers that support enterprise reporting and analytics. Apply best practices in data warehousing and data architecture.
2. Build Scalable Data Pipelines: Create modular, reusable, and pattern-driven ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, and Databricks.
3. Transform & Structure Data: Use Spark SQL, DBT, and Azure Synapse to transform raw data into structured, analytics-ready formats. Implement data quality checks and schema evolution strategies.
4. Leverage Azure Technologies: Utilize Azure services such as SQL Server, Synapse Analytics, Databricks, and Delta Lake to build and manage scalable data infrastructure. and data pipelines
5. Enable CI/CD & DevOps: Integrate data workflows with Azure DevOps and Git for version control, automated testing, and continuous deployment.
6. Support Reporting & Visualization: Collaborate with analysts and BI developers to ensure data models are optimized for tools like Power BI.
7. Troubleshoot & Optimize: Monitor and resolve issues in data pipelines and models. Ensure high availability and performance of data systems.
8. Stay Ahead of the Curve: Continuously learn and apply the latest in data engineering best practices, tools, and technologies.
Required Skills/Abilities:
Desired Skills/Abilities:
Education and Experience:
At least 5-7 years’ related experience required.