Senior Data Engineer / Databricks / End-to-End Ownerhp
Chicago, IL, US
Engineering
Full Time,
$140000 - $165000
On-site
Other/Non Classified
Chicago, IL, US
$140000 - $165000
Full Time,
Other/Non Classified
On-site
Engineering
Job details
A well-established, global professional services organization is expanding its Data & AI engineering team and hiring a Data Engineer to support a large-scale cloud data platform initiative. This role is based in Chicago and focuses on building modern data pipelines using Azure Databricks, Python, SQL, and Spark in a production environment.
This is a hands-on engineering opportunity for someone who enjoys owning data pipelines end-to-end and wants exposure to enterprise-scale data challenges. You’ll work alongside experienced engineers and business partners to turn raw data into trusted, analytics-ready datasets that power reporting, insights, and AI use cases.
This team is early in its Databricks journey, which means your work will matter immediately. You’ll help shape how pipelines are built, how data is governed, and how the platform evolves over time. It’s ideal for a strong mid-level engineer who wants to deepen their Databricks expertise while working on a highly visible, long-term transformation initiative.
Required Skills & Experience
- 6+ years of hands-on data engineering experience
- Strong experience building pipelines using Databricks
- Proficiency in Python and SQL for production data processing
- Working knowledge of Apache Spark and Delta Lake
- Experience with cloud data storage (ADLS, object storage)
- Experience with data modeling and schema design
- Familiarity with Git, CI/CD concepts, and basic testing/monitoring
Desired Skills & Experience
- Azure Databricks in an enterprise environment
- Experience with Unity Catalog and Databricks Jobs/Workflows
- Exposure to streaming or CDC pipelines
- Experience supporting BI or AI use cases
- Familiarity with Infrastructure as Code
What You Will Be Doing
Tech Breakdown
- 70% Azure Databricks / Spark / Delta Lake
- 20% Python & SQL development
- 10% CI/CD, testing, and optimization
Daily Responsibilities
- 80% Hands-On Engineering
- 10% Collaboration with BI, AI, and product teams
- 10% Documentation, reviews, and platform improvements
The Offer
- Bonus eligible
You will receive the following benefits:
- Medical, Dental, and Vision Insurance
- Vacation Time
- Stock Options
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
I want more jobs like this in my inbox.
About Kelly
Work changes everything. And at Kelly, we’re obsessed with where it can take you. To us, it’s about more than simply accepting your next job opportunity. It’s the fuel that powers every next step of your life. It’s the ripple effect that changes and improves everything for your family, your community, and the world. Which is why, here at Kelly, we are dedicated to providing you with limitless opportunities to enrich your life—just ask the 300,000 people we employ each year.Kelly is committed to providing equal employment opportunities to all qualified employees and applicants regardless of race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or any other legally protected status, and we take affirmative action to recruit, employ, and advance qualified individuals with disabilities and protected veterans in the workforce. Requests for accommodation related to our application process can be directed to the Kelly Human Resource Knowledge Center. Kelly complies with the requirements of California’s state and local Fair Chance laws. A conviction does not automatically bar individuals from employment. Kelly participates in E-Verify and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S.
Kelly may use AI-powered tools during the recruitment and hiring process. For full details, including how Kelly uses AI, your rights, and how to request a reasonable accommodation, visit the Recruitment Artificial Intelligence Notice.