Test Engineer - Automotive AI Assistant
Mihup
Software Engineering, Data Science, Quality Assurance
Pune, Maharashtra, India
Posted on Jan 9, 2026
Key Responsibilities:
Develop and maintain comprehensive test plans tailored for voice-based AI systems and in-car assistant platforms.
Design test strategies for LLM-based interactions where predefined outputs don’t exist—leveraging creative thinking and scenario modeling to validate conversational accuracy, relevance, and safety.
Define and execute test cases for speech-related components such as (ASR/NLU/TTS):
Build tools and automation pipelines to evaluate thousands of voice interactions and LLM outputs for quality, stability, and edge-case behavior.
Collaborate with engineering and product teams to simulate real-world environments for in-car assistant testing.
Analyze audio and text logs, spot anomalies, and systematically triage issues.
Report defects with clarity and collaborate closely with developers to drive resolution.
Build reusable testing components and contribute to internal QA frameworks and best practices.
Occasionally lead quality-focused initiatives and drive improvements in test efficiency, coverage, and automation maturity.
Education & Experience:
Bachelor’s/master’s degree in computer science, Information Technology, or related disciplines.
2–4 years of experience in manual and automation testing; prior experience testing AI/ML or voice-based systems is a plus.
Exposure to testing in automotive environments (In-vehicle Infotainment development) or other devices is an advantage.
Experience testing APIs, custom web applications, or data-intensive systems is a strong advantage
Key Skills:
Proficient in writing scripts using Python for test automation and data handling.
Hands-on experience with test case design, bug tracking tools, and test management platforms.
Strong analytical mindset with the ability to test beyond "expected results" and simulate nuanced user behaviors.
Understanding of QA in the software development lifecycle (SDLC/STLC) and continuous delivery environments.
Comfort with structured and unstructured test data generation and creative input crafting.
Knowledge of logging/monitoring tools like Grafana, Kibana, or observability platforms is a plus.
Excellent communication skills and strong collaboration mindset with cross-functional engineering teams.
Why This Role Matters
This is not just a traditional testing role - you're validating intelligent systems that adapt and learn, and shaping the quality of experiences users will trust and rely on while driving. As part of a fast-growing team building the future of voice-based interaction, you’ll help ensure that every response, every utterance, and every behavior is tested with creativity, depth, and precision.