Job Details

Description

Are you a hands-on expert in designing, developing, and optimizing scalable data pipelines and systems with Databricks and Spark? Do you thrive in a leadership role while staying actively involved in technical problem-solving and development? If so, we’d love to hear from you!

We’re seeking a Lead Data Engineer to join our machine-learning engineering team and contribute both technical expertise and leadership skills. In this role, you’ll lead a team of data engineers, mentor team members, and drive projects, while remaining deeply involved in hands-on development to build scalable, secure, and efficient data solutions. You’ll collaborate closely with machine-learning engineers, software engineers, data scientists, and data analysts to deliver high-impact data products for our clients and enhance our internal data capabilities.

E Source provides predictive data science, research and advisory, and solution services to help utilities make decisions that benefit their customers, their bottom line, and our planet.

What you’ll do

• Lead and mentor a team of data engineers, fostering collaboration, innovation, and adherence to best practices in data engineering and development.
• Stay actively engaged in hands-on development, designing, building, and maintaining data pipelines, systems, and infrastructure using technologies like Databricks, Spark, AWS, Python, and SQL databases (e.g., PostgreSQL).
• Develop and implement scalable ETL/ELT processes, ensuring the efficient ingestion, transformation, and delivery of data to support business and analytics needs.
• Provide technical leadership to your team, guiding architecture and design decisions, and ensuring high-quality code through reviews and mentorship.
• Collaborate with cross-functional teams to translate business problems into data-driven technical solutions.
• Monitor and troubleshoot data pipelines and systems to ensure optimal performance, data quality, and availability.
• Research emerging data technologies and trends to evaluate tools and enhance engineering practices.
• Manage the software development lifecycle (SDLC) and DevOps workflows, including CI/CD pipelines, version control (Git), and containerization tools like Docker.
• Define and enforce data governance, security, and privacy policies.
• Build and maintain data lakes and storage solutions to support advanced analytics and business intelligence.

What will make you a good fit

• Bachelor’s degree in computer science, information technology, or a related field (Master’s degree preferred).
• 6 or more years of experience in data engineering, including at least 2 years in a leadership role.
• Proven hands-on expertise with Databricks and Spark for building and optimizing data pipelines and processing large datasets.
• Extensive experience with cloud-based data engineering (preferably AWS), Python, and SQL.
• Strong ability to balance hands-on development and leadership responsibilities, staying involved in technical tasks while guiding the team.
• Demonstrated experience in team mentorship and collaboration, including managing technical projects and resolving complex challenges.
• Strong knowledge of data governance, security, and retention best practices.
• Familiarity with agile development methodologies and tools like Jira, and experience implementing DevOps practices (e.g., CI/CD, Jenkins, Docker).
• Exceptional problem-solving and communication skills.

Preferred qualifications:

• Databricks certification (e.g., Databricks Certified Data Engineer Associate or Professional).
• Expertise in optimizing ETL processes and designing efficient workflows in Databricks.
• Knowledge of data lineage and data quality frameworks.
• Familiarity with data science and machine-learning workflows and their data requirements.
• Industry experience in the energy or utility sector.
• Master’s degree in a STEM field.

A little about E Source

Utilities across the US and Canada face the same fundamental, day-to-day challenges: to ensure reliable service for every customer while maintaining and modernizing aging distribution networks and meeting regulatory requirements—all while keeping rates affordable. At the same time, climate change has created a common, universal call to action: to reduce our carbon impact, improve our environment, and ensure the prosperity of future generations.

At E Source, we’re dedicated to helping every utility become a Sustainable Utility. That means doing the hard work it takes to achieve goals that often seem at odds with one another:

• Environmental responsibility: Decarbonizing operations, reducing emissions, eliminating water leaks, and finding efficiencies
• Reliability: Providing safe, continuous, and consistent service in the face of increasing volatility caused by climate change, including extreme weather, drought, and fire
• Equity: Making services and programs truly available to all, especially low- and moderate-income residential customers and small and midsize businesses who are often disproportionately impacted by societal events
• Financial stability: Ensuring a bottom line that affords capital and operational expenditures while enabling innovation and giving back to our communities

E Source blends industry-leading research, predictive data science, and solution services to help utilities make better decisions to serve their customers, their bottom line, and our planet. With a commitment to practical innovation, we use more than three decades of utility-focused experience and our unique solution set to help our clients become a Sustainable Utility.

Benefits

• We offer excellent insurance packages, including medical, dental, and vision plans; company-paid life insurance; company-paid long- and short-term disability insurance; and medical and dependent-care flexible spending plans.

• We provide a flexible time off (FTO) program; E Source employees can take as many paid days off per year as they need, with manager approval, while fulfilling their work obligations and ensuring proper coverage of their responsibilities.
• We offer flexible schedules, flexible work locations, and a paid parental leave benefit.
• We provide a 401(k)/RRSP plan with a 3% employer match.

The budgeted salary for this position is $120,000 - $140,000 USD + annual bonus up to 10%. Actual pay will be adjusted based on experience.

This role will be 100% remote.

Applicants must be authorized to work for any employer in the US. We’re unable to sponsor or take over sponsorship of employment visas at this time.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Employees of E Source are encouraged to apply. To foster a positive work environment and company culture, we support our employees in their career growth at E Source.  Employees who are interested in similar job opportunities in the future should visit the E Source careers page for a listing of all open positions and contact Human Resources to express interest. 

We contact applicants directly via email using only our designated company email addresses with the domain of @esource.com. Please do not provide personal information to anyone over email and be wary of other accounts impersonating businesses.