{"id":82717,"title":"🕵️ Hamming - Automated AI voice agent testing","tagline":"AI voice agent reliability platform: AI voice agent testing, prompt tuning, evals, call analytics","body":"👋 [@Sumanyu Sharma](https://www.linkedin.com/in/sumanyusharma) and [@Marius Buleandra](https://www.linkedin.com/in/mariusbuleandra) from [@Hamming AI](https://www.ycombinator.com/companies/hamming-ai)\n\n**TLDR:** Are you testing your voice agents by hand? We're launching [Automated AI voice agent testing](https://app.hamming.ai/voice-demo) to automatically test your voice agents and flag quality issues in development and production.\n\n🌟 [Click here to try our free Voice Simulations Demo](https://app.hamming.ai/voice-demo) 🌟\n\n## Problem: Making voice agents reliable feels like whack-a-mole\n\nHere's the workflow most teams follow:\n\n1. **Call** your voice agent by hand and find bugs. Slow and ad-hoc.\n2. **Tweak** your voice agents by adding new tools and changing the prompts or models to fix the bugs.\n3. **Call again** to see if the changes worked.\n4. **Detect** regressions when users complain of things breaking in production.\n5. **Repeat** steps 1 to 4 until you get tired.\n\n**Calling your voice agent \u0026 finding bugs** is the slowest \u0026 most painful part of the feedback loop. This is what we automate.\n\n## Our take: Character AI for voice testing\n\nWe create hundreds of characters that simulate how **real users interact with your voice agents** in real life. For every call, we measure whether our character successfully accomplishes the task (e.g., ordering a vegan burger, canceling next week’s appointment, etc.).\n\nOur automated AI voice agent testing approach is 100x faster, cheaper, and more thorough than manual testing.\n\n![uploaded image](/media/?type=post\u0026id=82717\u0026key=user_uploads/497858/87b2fbc7-5137-46e5-a948-80b440eba8a6)\n\n### Flag errors \u0026 Tag calls in production\n\nYou can log all call transcripts and traces within Hamming. We actively **tag your production calls** in real-time, and flag cases the team needs to double-click on. This helps engineering teams quickly prioritize cases they need to fix.\n\n**Example tags**: human detects that the bot is an AI, a follow-up call is needed, the user requested an urgent appointment, etc.\n\n![uploaded image](/media/?type=post\u0026id=82717\u0026key=user_uploads/497858/7bf685f0-5348-4c0e-863f-90e3bd4e3f9f)\n\n### Test new changes quickly\n\n**Simulation-driven development**\n\nLet’s imagine you’re building an agent called ‘YC Founder’; we can spin up 100s of VC agents who will try to distract you. You can edit the prompts or models and re-run the simulation to make sure you made progress.\n\nWant to see how you would handle a persistent investor? Try our ‘VC trying to distract founders’ free [demo here](https://app.hamming.ai/voice-demo).\n\n![uploaded image](/media/?type=post\u0026id=82717\u0026key=user_uploads/497858/a39b0c3e-107d-4808-9096-30dbae4ad3f4)\n\n**Easily create new characters from call transcripts**\n\nWhen customers complain about a bad call, you can locate the call transcript and create a new character in one click. Make a change to your prompt, and then run the simulations to ensure you addressed the bad call.\n\n![uploaded image](/media/?type=post\u0026id=82717\u0026key=user_uploads/497858/cc3e6632-f482-47f5-aee6-2511b34d441d)\n\n## Meet the team\n\n[Sumanyu](https://www.linkedin.com/in/sumanyusharma/) previously helped Citizen (safety app; backed by Founders Fund, Sequoia, 8VC) grow its users by 4X and grew an AI-powered sales program to $100s of millions in revenue/year at Tesla.\n\n[Marius](https://www.linkedin.com/in/mariusbuleandra/) previously ran data infrastructure @ Anduril, drove user growth at Citizen with Sumanyu and was a founding engineer @ Spell (MLOps startup acquired by Reddit).\n\n![uploaded image](/media/?type=post\u0026id=82717\u0026key=user_uploads/497858/92a125e1-9612-4c4f-bb2d-1ab88aa9b24a)\n\n# Summary\n\nWe previously launched [Prompt Optimizer](https://www.ycombinator.com/launches/L4V-hamming-let-ai-optimize-your-prompts-free-for-7-days) and [AI Experimentation Tools](https://www.ycombinator.com/launches/LHa-hamming-make-your-rag-ai-agents-reliable) to automate prompt engineering and make RAG pipelines more robust. In this launch, we show how you can test your voice agents quickly.\n\n![uploaded image](/media/?type=post\u0026id=82717\u0026key=user_uploads/497858/674bd4d5-4041-4466-821e-f62328e440c4)\n\n# Our offer\n\n**Personalized characters + 100 free calls.** Struggling to make your voice agents reliable? We’ll create personalized characters and call + stress test your system \\~100 times for free. Book time with us [here.](https://calendly.com/sumanyusharma/1-1-debug-session)\n\nQuestions? Email us [here](mailto:sumanyu@hamming.ai) or chat with us [here](https://calendly.com/sumanyusharma/30min).","slug":"LW9-hamming-automated-ai-voice-agent-testing","created_at":"2024-08-05T01:45:12.663Z","updated_at":"2026-07-22T10:41:28.690Z","total_vote_count":57,"url":"https://www.ycombinator.com/launches/LW9-hamming-automated-ai-voice-agent-testing","share_image_url":"https://www.ycombinator.com/media/?type=post\u0026id=82717\u0026key=user_uploads/497858/92a125e1-9612-4c4f-bb2d-1ab88aa9b24a","company":{"id":29610,"name":"Hamming AI","slug":"hamming-ai","url":"https://hamming.ai/","logo":"https://bookface-images.s3.amazonaws.com/small_logos/63f48bd5017efb50e1fd3bcb1bd32b4b6a0147e3.png","batch":"Summer 2024","industry":"B2B","tags":[],"search_path":"https://bookface.ycombinator.com/company/29610"}}