English
French
Spanish
Backend Engineer, LLM Applications – Newton, MA
Backend Engineer, LLM Applications - Newton, MA
Job ID: mrp-888808
Newton, ,
Information Technology
Full Time,
$127000 - $220000
On-site
Other/Non Classified
Newton, ,
$127000 - $220000
Full Time,
Other/Non Classified
On-site
Information Technology
Job details
Job Description
A venture-backed technology startup is building the next generation of AI-powered customer experiences and is looking for a Backend Engineer, LLM Applications to join its growing engineering team.
This role is ideal for a software engineer who enjoys building production systems at the intersection of backend engineering and generative AI. You will design and develop the services, APIs, and infrastructure that support large language model applications used by real customers at scale.
Unlike many AI-focused positions centered on experimentation or research, this role is highly focused on software engineering. You’ll work on production-grade backend systems, integrate LLM capabilities into customer-facing products, and help shape the technical foundation of a rapidly growing startup.
Location: Newton, MA
Schedule: Hybrid, 3 days onsite per week
Salary: $127,000 – $220,000 Base Salary Required Skills & Experience
- 4+ years of backend software engineering experience
- Strong programming experience with Python, Go, Java, or similar languages
- Experience building and maintaining APIs, microservices, and distributed systems
- Hands-on experience deploying machine learning or LLM-powered applications into production environments
- Experience designing scalable, reliable backend architectures
- Understanding of cloud infrastructure and modern software development practices
- Experience monitoring and supporting production applications
- Strong communication and collaboration skills
Desired Skills & Experience
- Experience working with Generative AI products or platforms
- Familiarity with LLM evaluation, observability, and monitoring practices
- Experience with retrieval-augmented generation (RAG), AI agents, or orchestration frameworks
- Knowledge of containerization and cloud-native technologies
- Experience in startup or high-growth environments
- Passion for building customer-facing AI products
What You Will Be Doing Daily Responsibilities
- Design and develop backend services powering AI-enabled applications
- Build APIs and microservices that support LLM workflows and customer experiences
- Integrate large language models into scalable production systems
- Develop tooling to evaluate, monitor, and improve AI application performance
- Partner with product and engineering teams to design new features and capabilities
- Improve system reliability, scalability, and observability
- Troubleshoot issues across backend services, model integrations, and supporting infrastructure
- Own solutions from architecture and development through deployment and optimization
- Contribute to technical decisions that influence the future direction of the platform
The Offer
- Competitive base salary up to $220,000
- Annual performance-based bonus opportunity
- Hybrid work environment with 3 days onsite per week in Newton, MA
- Opportunity to join a well-funded startup building cutting-edge AI products
- High-impact role with significant ownership and visibility
- Collaborative engineering culture with direct access to leadership
- Strong growth potential as the organization scales
You will receive the following benefits
- Medical Insurance
- Dental Benefits
- Vision Benefits
- Flexible Paid Time Off
- 401(k)
- Parental Leave
- Life Insurance
- Disability Coverage
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
I want more jobs like this in my inbox.
Similar Jobs
Newton, ,
Full Time,
$127000 - $220000
About Kelly
Work changes everything. And at Kelly, we’re obsessed with where it can take you. To us, it’s about more than simply accepting your next job opportunity. It’s the fuel that powers every next step of your life. It’s the ripple effect that changes and improves everything for your family, your community, and the world. Which is why, here at Kelly, we are dedicated to providing you with limitless opportunities to enrich your life—just ask the 300,000 people we employ each year.Kelly is committed to providing equal employment opportunities to all qualified employees and applicants regardless of race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or any other legally protected status, and we take affirmative action to recruit, employ, and advance qualified individuals with disabilities and protected veterans in the workforce. Requests for accommodation related to our application process can be directed to the Kelly Human Resource Knowledge Center. Kelly complies with the requirements of California’s state and local Fair Chance laws. A conviction does not automatically bar individuals from employment. Kelly participates in E-Verify and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S.
Kelly may use AI-powered tools during the recruitment and hiring process. For full details, including how Kelly uses AI, your rights, and how to request a reasonable accommodation, visit the Recruitment Artificial Intelligence Notice.