hero

Portfolio Jobs

We invest early — preseed and seed — in real companies tackling real markets.

Manager, Software Engineering - AI/ML Evaluation Platform

Supio

Supio

Software Engineering, Data Science
San Francisco, CA, USA · Seattle, WA, USA
Posted on Feb 3, 2026
Manager, Software Engineering - AI/ML Evaluation Platform
Seattle • San Francisco
Software Engineering
In office
Full-time

About Us

Supio is a trusted AI platform purpose-built for law firms, reshaping how data drives impactful outcomes. Our innovative approach blends technology with deep legal expertise, making us a leader in our field. We go beyond surface-level AI to deeply understand our customers’ daily needs, empowering law firms with unparalleled data insights. Supio delivers human-level, accurate analysis of complex data and legal records, quickly and efficiently bringing critical insights when they matter most. Trusted by top litigation lawyers, our platform has supported over $1 billion in settlements.
Headquartered in Seattle with an office in San Francisco, we raised $60M Series B in April 2025 led by Sapphire Ventures with Mayfield and Thomson Reuters Ventures, bringing total funding to $91M. We're scaling rapidly and looking for exceptional talent to join us in this next phase of growth.
​​We're looking for passionate team members who are motivated by our mission and ready to help us achieve it.

Who We’re Looking For

We’re seeking Engineering Managers with AI Evals Framework experience to drive and scale the validation of our AI systems while staying deeply hands-on with both infrastructure and product delivery. You’ll sit at the intersection of ML, data, and developer experience, building the tooling and platforms that help every team at Supio ship reliable AI faster.

A bit about you

  • Track record of shipping complex technical products, internal platforms, or developer tools at startup speed.
  • Deep hands-on experience building infrastructure for LLM evaluation, including datasets, runners, and metrics.
  • Experience designing APIs and SDKs that other engineers genuinely enjoy using.
  • Strong data engineering fundamentals; you care about dataset versioning, schema validation, and reproducibility.
  • Bachelor’s in CS or related field; 2+ years managing engineering teams or leading technical initiatives.

What You’ll Do

  • Lead and grow a team of 6–10 engineers while architecting a self-service evaluation platform used across product teams.
  • Create the tooling that allows product teams to define, run, and visualize their own tests without being blocked by your team.
  • Integrate our HITL workflows and subject-matter experts into the model evaluation pipeline through intuitive UI/UX and clear developer surfaces.
  • Define and implement company-wide metrics for latency, cost, and accuracy across diverse tasks and products.
  • Own the full lifecycle of our evaluation platform—from roadmap and architecture to execution, rollout, and continuous improvement.

Benefits & Perks

Supio offers an extensive benefits package and perks which include:
  • Health insurance: medical, dental, and vision
  • 401k
  • Flexible paid time off (PTO) and company-paid holidays
  • Monthly commuter subsidies
  • DoorDash subsidies for breakfast and dinner

E-Verify Participation Notice

Supio participates in E-Verify, an employment authorization program through the U.S. Department of Homeland Security and the Social Security Administration.

Equal Employment Opportunity (EEO) Statement

Supio is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.
Ready to apply?
Powered by
First name *
Last name *
Email *
LinkedIn URL *
Phone number *
Location *
Resume *
Click to upload or drag and drop here
Cover letter
Click to upload or drag and drop here
LinkedIn Profile *
This role requires working from either our downtown Seattle or San Francisco office 5 days/week. Does that work for you? *
Voluntary Self-Identification
To comply with government reporting requirements, we invite candidates to participate in the self-identification survey below. Your completion of this form is entirely optional, and your decision will neither influence the hiring process nor any subsequent stages. Any information you choose to share will be kept confidential and stored in a secure file. As outlined in our Equal Employment Opportunity policy, we uphold a commitment to non-discrimination based on any protected group status specified in applicable laws.
Gender
Race
Race and ethnicity descriptions
By applying you agree to Gem's terms and privacy policy.
Save your info to apply to other roles faster & help employers reach you.