Data Warehouse Architect
Come, Innovate, Build, Disrupt & Thrive!
Position Overview
KēSTA I.T. is seeking a Data Warehouse Architect to lead the design and delivery of cloud data lake pipelines, governed Data Products, and ML-ready data solutions on a modern lakehouse platform.
In this lead-level role, you will oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems. The work centers on building and overseeing pipelines, data modeling, and delivering data and ML products in an agile DevOps framework.
You will serve as the primary technology lead for a public sector data engineering effort. You will work with a proof of concept team to support best practice adoption in a hosted environment, and you will train and mentor data engineers.
The data landscape includes relational, semi-structured, and unstructured sources landed in a Lakehouse Medallion architecture in parquet format on AWS, Azure, or Google. You will partner with data scientists, analysts, product teams, and business stakeholders so that data solutions meet organizational needs.
Key Responsibilities
- Oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems.
- Build Extract and Load pipelines that hydrate an enterprise data lake on a cloud provider from relational, semi-structured, and unstructured sources.
- Transform data lake datasets into Data Products whose attributes and features trace back to Critical Data Elements in the systems of record.
- Enforce Data Sharing Policies on Data Products so users see only the version they are entitled to access at the time of subscription.
- Architect and optimize data infrastructure, including storage solutions, orchestration frameworks, and ETL/ELT processes.
- Design and implement Lakehouse and Medallion Architecture datasets in parquet format, using Python, PySpark, and SQL, including SQL query tuning.
- Design and deliver star-schema operational data stores that enable visualization of program activities and outcomes in tools such as Power BI.
- Deliver data and ML products using an agile DevOps framework and distributed data architectures.
- Establish standards, monitoring, validation, and governance practices to ensure data quality, reliability, and security.
- Lead and mentor data engineering staff by providing technical guidance, reviewing designs and code, and supporting professional growth.
- Provide training to data engineers and support best practice adoption within the hosting environment.
- Collaborate with data scientists, analysts, product teams, and business stakeholders to ensure data solutions meet organizational needs and strategic goals.
Required Qualifications
- 4+ years of hands-on experience building Extract and Load pipelines that hydrate an enterprise data lake on AWS, Azure, or Google from relational, semi-structured, and unstructured sources.
- 4+ years of hands-on experience transforming data lake datasets into Data Products with traceability to Critical Data Elements in systems of record.
- 4+ years of experience with Python, PySpark, and SQL, including tuning SQL queries to load data from sources such as relational databases, flat files, CSV, HTML, and JSON into a Lakehouse Medallion architecture in parquet format.
- 4+ years of programming and scripting in Python, R, and Spark.
- 4+ years of experience modeling and leveraging relational data services.
- Experience building data pipelines with the data platform tools of a major cloud provider (AWS, Microsoft, or Google), with 4+ years overall designing and implementing data, analytics, and AI solutions for large enterprises.
- Working knowledge of Spark, Kafka, Kubernetes, Databricks, SageMaker, and DBT.
- Experience with Lakehouse and Medallion Architecture concepts and parquet formats.
- Experience designing and delivering star-schema operational data stores that support visualization in Power BI.
- 2+ years of experience enforcing Data Sharing Policies on Data Products.
- Bachelor's degree in Computer Science, Data Science, or Information Systems.
- Experience leading and mentoring data engineering staff.
Preferred Qualifications
- Proficiency with DevOps tools such as GitHub, Jenkins, Terraform, YAML, DAGs, and Docker.
- Experience using Databricks and SageMaker to build data and ML pipelines that store data in parquet destinations.
- Experience promoting data engineering standards and best practices among developers to support scalable, supportable data and ML product delivery.
- Experience implementing cloud data governance and security tools to automate Data Sharing Policy enforcement at the point of subscription.
Available Benefits
- Medical Benefits (Platinum level plans available)
- Work from home / Hybrid / Onsite options
- PTO
- Holiday Pay
- VTO
- 401K
- Charitable Match
- Training reimbursement
About KēSTA I.T.
Our name says it all; KēSTA I.T. (Keys-to-I.T.) AND our people are our keys to our success!
KēSTA I.T. is a premier Utah-based technical staffing and consulting services firm. We specialize in temporary and permanent placement of Software, Hardware, Network, Cloud, CRM/ERP, Data, End-User support, Web and Executive / leadership-based positions on a full time and consulting basis.
If you're interested in a role where top performance is rewarded, personal time is valued, and excellence is demanded at every level we want to talk to you today!
Where do you want to go? We've got the keys! ~
KēSTA I.T.