About H: H exists to push the boundaries of superintelligence with agentic AI. By automating complex, multi-step tasks typically performed by humans, AI agents will help unlock full human potential.

H is hiring the world’s best AI talent, seeking those who are dedicated as much to building safely and responsibly as to advancing disruptive agentic capabilities. We promote a mindset of openness, learning and collaboration, where everyone has something to contribute.

Holistic, Humanist, Humble.

About the Team: The Evaluations team develops agent specific benchmarks and tools to simplify benchmark creation. We interact with all the teams involved in the product development and make sure that the agents and all their components are thoroughly measured in order to put the best agents in production.

Key Responsibilities:

• Collaborate with other teams to gather the needs in terms of environments to build

• Create benchmarks that reflect the problems agent face

• Define metrics that match business use cases

• Gather insights from benchmark to define the critical ameliorations to bring to the LLMs and agents

Requirements:

• Technical skills

  • MS or PhD in Computer Science, Machine Learning or related fields

  • Proficient in Python

  • Significant experience in web development

• Soft skills:

  • Collaborative mindset, thriving in dynamic, multidisciplinary teams

  • Strong communication and presentation skills

  • Eager to explore new challenges

• Bonuses:

  • Participation in open source projects

  • Experience in agent development

  • Experience in software architecture in large projects

Location:

• H's teams are distributed throughout France, the UK, and the US

• This role has the potential to be fully remote or hybrid for candidates based in cities where we have an office - currently Paris and London

• The final decision for this will lie with the hiring manager for each individual role

What We Offer:

• Join the exciting journey of shaping the future of AI, and be part of the early days of one of the hottest AI startups

• Collaborate with a fun, dynamic and multicultural team, working alongside world-class AI talent in a highly collaborative environment

• Enjoy a competitive salary

• Unlock opportunities for professional growth, continuous learning, and career development

If you want to change the status quo in AI, join us.