We're looking for a Python Software Engineer with Data Engineering experience to join a global team building a large-scale Metering Data Platform. This is not a traditional Data Engineer role focused solely on Databricks notebooks and ETL development. The ideal candidate has a strong software engineering foundation and enjoys building scalable, production-grade applications.
What You'll Do
- Build and maintain Python-based applications, APIs, and data services.
- Develop scalable data ingestion and processing solutions using PySpark and Databricks.
- Create reusable frameworks, CI/CD processes, monitoring, and testing capabilities.
- Collaborate with global teams to build a shared platform that aggregates customer usage data into a centralized data lake.
- Contribute to architecture decisions, engineering standards, and platform growth.
Required Qualifications
-
Strong Python software engineering background (Python Developer first, Data Engineer second)
Experience with:
- Python
- Django and/or Flask
- PySpark
- Databricks
- REST APIs
- Object-Oriented Design
- Git
- Data Engineering experience including:
- Data pipelines and data lakes
- Spark optimization and performance tuning
- Data modeling and distributed systems
Preferred:
- AWS (S3, Glue, Lambda)
- CI/CD and DevOps practices
What We're Looking For
Someone who writes clean, maintainable code, enjoys solving complex engineering problems, and wants a voice in architecture and technical direction. If your background is primarily notebook development without significant software engineering experience, this likely won't be the right fit.