AI Deployment Engineer - AI Agents (Healthcare)

100ms

100ms

Software Engineering, Data Science

Bengaluru, Karnataka, India

Posted 6+ months ago

100ms is looking for an AI Deployment Engineer to help build and improve our AI agents for U.S. healthcare. This role is central to our product delivery — you’ll work with Product, Operations, and Account Managers to make sure our agents are accurate, reliable, and always improving based on customer needs.

Deployment Engineers are hands-on builders. You won’t just design ideas; you’ll see them through from start to finish: testing, fixing, refining, and making sure our AI agents work smoothly in the real world. This role blends technical problem-solving, product sense, and customer focus to create AI that actually helps people.

Responsibilities

  • Understand Customer Needs
  • Work with Product and Account Managers to understand healthcare and insurance use cases.
  • Translate these needs into clear, working agent designs.

  • Build & Deploy Agents

  • Create and update prompts, conversation flows, and tool integrations.

  • Test agents thoroughly before they go live.

  • Make sure they’re reliable and ready for customer use.

  • Test & Improve Performance

  • Set up datasets and automated tests to measure quality.

  • Run real-world checks to catch and fix edge cases.

  • Continuously raise the bar for accuracy and consistency.

  • Support Customer Value

  • Ensure agent outputs (like benefit checks or call notes) show up correctly in dashboards.

  • Troubleshoot quickly and connect fixes to what customers see.

  • Partner with Operations to turn frontline issues into improvements.

  • Keep Workflows Running Smoothly

  • Maintain prompts, scripts, and rules so agents don’t break.

  • Ensure smooth hand-offs between AI and human support when needed.

  • Track long-term adoption and success metrics.

Success Looks Like

  • Fast and accurate updates to workflows.
  • Strong test coverage and reliable quality checks.
  • Quick turnaround from customer issues to product fixes.
  • Clean, accurate dashboards.
  • Tangible improvements in customer satisfaction.

What We’re Looking For

  • 2–6 yrs Experience with prompt design and working with LLM-powered tools.
  • Comfort with APIs, dashboards, and light scripting (Python/JS).
  • Problem-solver who can debug as well as design.
  • Thinks about the whole system, from backend data to end-user experience.
  • Strong communicator who works well across Product, Ops, and Accounts.
  • Quick learner who’s motivated to turn new AI tech into dependable, customer-ready products.

Why This Role Matters

  • In healthcare, accuracy and trust are everything. Patients, providers, and payers rely on our AI agents to handle critical interactions. Deployment Engineers make this possible by turning AI from a raw model into something practical, reliable, and human-friendly.

Why 100ms

  • You'll be part of a small team at a fast-growing engineering-first startup.
  • You'll work with engineers across the globe with experience in video at places like Facebook and Hotstar.
  • You can grow as an individual contributor or as a team leader - freedom to set your own goals.
  • You'll work on problems at the cutting-edge of real-time video communication technology at a massive scale.

Additional Information

  • At 100ms, we place a strong emphasis on in-office presence to promote collaboration and strengthen company culture.
  • Under the current policy, employees are expected to work from the office at least three days a week—Tuesday, Wednesday, and Friday—as an essential part of their role.