Member of technical staff (Evaluations)
H Company
About H: H exists to push the boundaries of superintelligence with agentic AI. By automating complex, multi-step tasks typically performed by humans, AI agents will help unlock full human potential.
H is hiring the world’s best AI talent, seeking those who are dedicated as much to building safely and responsibly as to advancing disruptive agentic capabilities. We promote a mindset of openness, learning and collaboration, where everyone has something to contribute.
Holistic, Humanist, Humble.
About the Team: The Evaluations team develops agent specific benchmarks and tools to simplify benchmark creation. We interact with all the teams involved in the product development and make sure that the agents and all their components are thoroughly measured in order to put the best agents in production.
Key Responsibilities:
Collaborate with other teams to gather the needs in terms of environments to build
Create benchmarks that reflect the problems agent face
Define metrics that match business use cases
-
Gather insights from benchmark to define the critical ameliorations to bring to the LLMs and agents
Requirements:
-
Technical skills
MS or PhD in Computer Science, Machine Learning or related fields
Proficient in Python
Significant experience in web development
-
Soft skills:
Collaborative mindset, thriving in dynamic, multidisciplinary teams
Strong communication and presentation skills
Eager to explore new challenges
-
Bonuses:
Participation in open source projects
Experience in agent development
-
Experience in software architecture in large projects
Location:
H's teams are distributed throughout France, the UK, and the US
This role has the potential to be fully remote or hybrid for candidates based in cities where we have an office - currently Paris and London
-
The final decision for this will lie with the hiring manager for each individual role
What We Offer:
Join the exciting journey of shaping the future of AI, and be part of the early days of one of the hottest AI startups
Collaborate with a fun, dynamic and multicultural team, working alongside world-class AI talent in a highly collaborative environment
Enjoy a competitive salary
-
Unlock opportunities for professional growth, continuous learning, and career development
If you want to change the status quo in AI, join us.