Job Title : Data Engineer
Position Description:
We are looking for an experienced Data Engineer with deep understanding of large-scale data handling and processing best practices in a mixed on-prem and cloud environment to help us build scalable systems. It is vital that we deliver robust solutions that ensure reliable access to data with a focus on quality and availability to facilitate analytics and user understanding. Those solutions will help bring to light actionable insights to improve business decisions and processes.
Responsibilities include, but are not limited to:
Collaborate with other data engineers to implement a shared technical visionParticipate in the entire software development lifecycle, from concept to release
Designing and implementing batch and streaming data pipelines capable of processing large volumes of dataBuild efficient code to transform raw data into datasets for analysisDesigning and implementing a data warehouse for reporting and analytics
Designing and deploying data models and views with large datasets that meet functional / non-functional business requirementsIdentifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
Delivering quality production-ready code in an agile environment
Delivering test plans, monitoring, debugging and technical documents as a part of development cycle
Creating data tools for analytics and working with stakeholders across all departments to assist with data-related technical issues and supporting their data infrastructure needs
We are looking for engineers who can not only tackle technical problems, but also collaborate and evangelize best practices across teams. We value engineers who can bring fresh ideas and are willing to own solving problems all the way to a solution.
Qualifications (required):
4+ years of data engineer experience with experience with data warehouse architecture and hands-on experience of data modeling design, ETL pipeline implementation
Deep understanding of data architecture data engineering, data analysis, data modelling, and reportingExperience with cloud-based data warehouses such as Snowflake or similar
Advanced working SQL knowledge and experience working with relational databasesKafka or equivalent streaming platform experience
Strong experience with Python
Strong general programming proficiency
Can learn anything you don't already know to get the job done
Excellent communication skills and ability to understand complex technology systemsGood active listening skills, the ability to empathize with stakeholders, and other engineers
Comfortable with ambiguity; you enjoy figuring out what needs to be done
Ability to quickly learn new technologies
Experience with GIT
Experience with Agile methodology
Comfortable with Linux operating system and command-line tools
Qualifications (nice-to-have):
Strong experience with Snowflake
Experience working in a hybrid cloud and on-prem environment and/or with migrations from on-prem to cloud.
Experience with continuous integration and automated testing tools and methodologies
Experience with serverless architecture and microservices.
Experience JIRAExperience with SCRUM
Experience with of Tableau, Qlikview, PowerBI or similar tools
Experience with Machine Learning