Founding Software Engineer

Overview

Scorecard AI is the leading evaluation and testing platform, specifically designed for products built with Large Language Models (LLMs). As a founding software engineer, you'll be a key part of mission to create AI that automatically improves our customers' products, enabling leading companies to ship faster, cheaper, and with greater confidence.

In this role, you'll collaborate closely with full stack engineers and product owners to craft intuitive, scalable systems that empower teams to iterate on their AI products.

Examples of challenges you'll tackle include:

• Training AI models for LLM system auto-improvement

• Designing the trusted evaluation 'Scorecard'

• Building pipelines for meta-evaluation of customer metrics

• Scaling up the infrastructure for large-scale eval simulations

As a core member of our founding team, you'll have the opportunity to architect and maintain the backend components that form the backbone of our product, ensuring scalability, performance, and reliability. This role demands a unique blend of technical prowess, creative problem-solving, and a passion for pushing the boundaries of AI technology.

If you're excited about creating tools that will shape the future of software development and AI evaluation, we want to hear from you. Join us in making our vision a reality and be part of a team that's redefining how AI products are built, tested, and improved.


Responsibilities

  • Collaborating with full stack engineers and product owners to implement core features

  • Integration of APIs to build core product features

  • Development and maintenance of backend components


Qualifications

  • Strong proficiency with Python and backend frameworks FastAPI and Railway

  • Familiarity with OpenAPI specifications or RESTful APIs

  • Understanding of data visualization and charting libraries


Skills and Abilities

  • Ability to work independently and in a team environment

  • Strong product sense, communication and collaboration skills

  • Attention to detail and a focus on delivering high-quality code

  • Adaptability to learn new technologies and frameworks

  • Proficiency with GitHub and Vercel

  • Proficiency with SQL databases (Postgres) and Supabase

  • [Bonus] Backend skills in Python FastAPI or Node.js

  • [Bonus] Skills in LLM development (OpenAI, LangChain, etc.)


Education and Experience

  • Previously worked for a top tech company or startup in a contract or full time capacity

  • Previous experience in backend development or related roles

  • Bachelor's degree in Computer Science or related field (preferred)

  • Working knowledge of Generative AI such as ChatGPT, LLMs and OpenAI APIs


Benefits and Perks

  • Opportunity to work on state-of-the-art AI technology

  • Working alongside a senior team from FAANG+ with top-tier partners

  • Collaborative and inclusive work environment

  • Professional development and massive growth opportunities

  • Strong compensation and benefits


How to Apply

Please reach out to jobs@scorecard.io with your resume and a brief description of why you're interested!