{"id":117920,"title":"EvalRouter by Kimpton: One API for AI evaluation","tagline":"Evaluate any model against any benchmark","body":"\n![uploaded image](/media/?type=post&id=117920&key=user_uploads/3054189/67ffcd7e-40fd-40ff-81ad-cacb271d97b1)\n\nWe’re Jack, Mauricio, and Adrian, the founders of Kimpton (YC P26). Today we’re introducing **EvalRouter**.\n\nOne API for evaluating any model against any benchmark.\n\n<https://youtu.be/NLggXJxQoX4?si=lwgdK4-SwGfZycKb>\n\nWe built it because running an evaluation still means setting up a harness, provisioning sandboxes and babysitting long jobs. Model builders need to repeat this work as their models change and they add new benchmarks.\n\nWith EvalRouter you name a model and a benchmark and get graded results back. Choose a managed model or connect your own endpoint, select a benchmark version and set a spending cap. EvalRouter runs the evaluation and returns the results with the recorded answers and execution details. You can inspect what happened and export the report.\n\nCheckout the demo:\n\n<https://youtu.be/Sb5Ujg95ZLk>\n\nBefore Kimpton, we built and ran a quantitative fund together. Mauricio and I previously worked at Goldman Sachs, and Adrian worked at SpaceX and Vistra. We raised $10M from a family office, built our own research and automated trading systems, and scaled the fund to $35M in assets. At Kimpton, we’ve been building benchmarks and environments to evaluate AI models. EvalRouter makes those evaluations accessible through one API.\n\nRun your next evaluation at <https://evalrouter.ai>. If you build models or maintain a benchmark, we’d like to hear from you. Reach us at [founders@kimpton.ai](mailto:founders@kimpton.ai).","slug":"Ufw-evalrouter-by-kimpton-one-api-for-ai-evaluation","created_at":"2026-10-01T21:50:20.304Z","updated_at":"2026-11-17T21:26:46.172Z","total_vote_count":6,"url":"https://www.ycombinator.com/launches/Ufw-evalrouter-by-kimpton-one-api-for-ai-evaluation","share_image_url":"https://www.ycombinator.com/media/?type=post&id=117920&key=user_uploads/3054189/67ffcd7e-40fd-40ff-81ad-cacb271d97b1","company":{"id":31420,"name":"Kimpton","slug":"kimpton","url":"https://kimpton.ai","logo":"https://bookface-images.s3.amazonaws.com/small_logos/dc55a7e4190cac127494553294ea19379fdf8fc3.png","batch":"Spring 2026","industry":"Fintech","tags":["B2B","Investments","Trading","AI"],"search_path":"https://bookface.ycombinator.com/company/31420"}}