Backend Software Engineer (Evals) – Support Automation Engineering

Related Jobs
  • Supabase
    FullTime
    Remote

    ### About the Company Supabase is the Postgres development platform, built by developers for developers. We're a remote-first, open source company dedicated to making building scalable apps as easy as possible. ### Job Description Own subscripti
  • Cohere Health
    FullTime
    Remote

    About the Company Cohere Health is a fast-growing clinical intelligence company that’s improving lives at scale by promoting the best patient-specific care options, using leading edge AI combined with deep clinical expertise. In only four years our
  • Snowflake
    FullTime
    AU-New South Wales-Remote

    About the Company: Snowflake is about empowering enterprises to achieve their full potential — and people too. With a culture that’s all in on impact, innovation, and collaboration, Snowflake is the sweet spot for building big, moving fast, and t
  • FullTime
  • Anywhere
  • 330000 USD / Year
  • Salary: 330000

About OpenAI

OpenAI’s Support Automation team applies cutting-edge AI models to real-world challenges, automating and enhancing work across the organization. We develop an ecosystem of automation products that empower our colleagues and drive impact, leveraging OpenAI technology to improve OpenAI through reusable solutions and patterns.

Responsibilities

  • Design and build eval pipelines that are reliable, reproducible, and extendable
  • Build infrastructure for continuous eval monitoring frameworks and feedback loops
  • Design, build, and maintain backend services and APIs for intelligent automation
  • Integrate and structure data across internal platforms for AI workflows
  • Collaborate with data, research, and engineering teams to integrate OpenAI models
  • Own full development lifecycle of new backend systems and platform capabilities
  • Build with scale and maintainability while rapidly iterating on new ideas

Qualifications

  • 4+ years backend engineering experience at product-driven companies
  • Proficiency in Python, FastAPI, Postgres and backend technologies
  • Experience designing and scaling distributed systems and data processing pipelines
  • Experience building AI agents or applications including designing evals
  • Familiarity with evaluation methods for LLMs and multi-agent workflows
  • Experience creating production evals and measuring ML/LLM model performance
  • Pragmatic mindset comfortable shipping iteratively toward long-term vision

Benefits

  • Annual salary: $330,000
  • Comprehensive health, dental, and vision insurance
  • Generous equity compensation package
  • Professional development opportunities
  • Access to cutting-edge AI technology
  • Collaborative engineering environment
  • Opportunity to work on internal AI automation

Tips for Secure Interview

  • All communications from official @openai.com domains
  • Verify interview scheduling through Ashby platform
  • Technical interviews may include system design exercises
  • No financial information requests during process
  • Report suspicious activity to security@openai.com

To apply for this job please visit jobs.ashbyhq.com.