Build your future with Sovos.

If you're seeking a career where innovation meets impact, you've come to the right place. As a global leader, Sovos is transforming tax compliance from a business requirement to a force for growth while revolutionizing how businesses navigate the ever-changing regulatory landscape.

At Sovos, we're dedicated to more than just solving compliance challenges -- we're committed to making a positive and lasting difference in everything we do. Our teams operate on the modern edge of digital technology, working not only to solve complex business challenges but also to enrich our personal, professional, and local communities.

Our purpose-built systems provide the tools you need to thrive in a world where governments demand increased visibility, faster reporting and greater control over business processes. Excited about the possibilities? So are we!

Don't worry if you don't check all the boxes -- apply anyway! We're focused on hiring the right people, not just the "right" resume. It's not about what you've done elsewhere; it's all about what you're capable of doing here.

The Work You'll Do:

At Sovos, we're seeking a Software Developer to help us design and implement a framework for LLM management and observability. You will ensure that teams can easily experiment with different LLM providers (e.g., AWS Bedrock, OpenAI, Anthropic, Azure) while maintaining consistent tracing, logging, and evaluation.

This role is ideal for a developer who enjoys building developer tools, integrations, and observability pipelines for large-scale AI systems.

More specifically, you will:

• Build and maintain an orchestration layer for LLM-powered applications.
• Implement adapters to allow seamless switching between model providers (OpenAI, Anthropic, AWS Bedrock, Azure, etc.).
• Integrate Langfuse for tracing, observability, cost monitoring, and feedback loops.
• Design and develop monitoring dashboards and alerts for LLM usage (latency, cost, quality, errors).
• Enable prompt versioning, structured logging, and experiment tracking.
• Work closely with product and application teams to ensure scalability, reliability, and cost efficiency of LLM services.
• Ensure all LLM integrations follow security and compliance best practices.

What We Need From You

• Strong proficiency in Python (Node.js/TypeScript familiarity is a plus).
• Knowledge of LLMOps practices: logging, monitoring, evaluation metrics, and feedback loops.
• Strong understanding of APIs, microservices, and distributed systems.
• Experience with AWS Bedrock or other managed LLM providers is a plus.
• Hands-on experience with LangChain (chains, agents, tools, memory, RAG pipelines) is desired.
• Familiarity with LiteLLM or similar framework for model abstraction and provider integrations is beneficial.
• Experience with vector databases (Pinecone, Weaviate, FAISS, OpenSearch) and RAG pipelines is valued.
• Due to client contractual obligations, the successful candidate will be asked to clear a background check and drug test upon hire.

What Does Sovos Offer You?

The tools to enhance your life - because we want you to enjoy your life outside of work and inside!

• Flexible Time-Off
• Comprehensive Health, Dental and Vision benefits
• 401(k) with employee sponsored match
• Bi-Weekly Meeting Free Days
• Mentoring Programs
• Globally recognized Training and Development programs
• Tuition Reimbursement, Time off to Volunteer, Charitable Giving Match, and more!

Sovos is an equal opportunity employer committed to providing an environment that celebrates diversity and where equal employment opportunities are available to all applicants and employees. We do not discriminate against race, color, religions, national origin, age, sex, marital status, physical or mental disability, veteran status, gender identity, sexual orientation, or any other characteristic provided by law. At Sovos, all employees are encouraged to bring their whole selves to work.

Company Background

Sovos is a global provider of tax, compliance and trust solutions and services that enable businesses to navigate an increasingly regulated world with true confidence. Purpose-built for always-on compliance capabilities, our scalable IT-driven solutions meet the demands of an evolving and complex global regulatory landscape. Sovos' cloud-based software platform provides an unparalleled level of integration with business applications and government compliance processes.

More than 100,000 customers in 100+ countries -- including half the Fortune 500 -- trust Sovos for their compliance needs. Sovos annually processes more than three billion transactions across 19,000 global tax jurisdictions. Bolstered by a robust partner program more than 400 strong, Sovos brings to bear an unrivaled global network for companies across industries and geographies. Founded in 1979, Sovos has operations across the Americas and Europe, and is owned by Hg and TA Associates. For more information visit http://www.sovos.com and follow us on LinkedIn and Twitter.