{"id":98397,"title":"The Token Company: Intelligent compression for LLM context bloat","tagline":"Intelligent compression for LLM context bloat","body":"Hey everyone,I’m Otso Veisterä, founder of The Token Company (YC W26).\n\n**TL;DR**\\\nWe build LLM input compression using a fast machine learning model (not a generative LLM). It removes useless tokens from prompts via a drop-in API—cutting token counts, latency, and costs while improving model performance. It compresses 100k tokens in under 100ms.\n\n\u003chttps://youtu.be/65ScMCGNPss\u003e\n\n**The Problem**\\\nPrompts bloat with redundant tokens from chat history, RAG docs, or large inputs. This wastes context windows, drives up costs, slows inference, and weakens model outputs. Heavy users face high bills and must limit context to stay affordable.\n\n**The Solution**\\\nOur API compresses prompts intelligently, preserving semantic intent while stripping noise. Integration takes minutes.\\\nBenchmarks show accuracy gains (e.g., +2.7 percentage points on financial QA with up to 20% fewer tokens) and up to 37% faster end-to-end latency.\n\n**My Ask**\\\nIf you're running production LLMs and fighting context bloat, high costs, or latency, email me: [otso@thetokencompany.com](mailto:otso@thetokencompany.com)\\\n\u003chttps://thetokencompany.com\u003e","slug":"Pb3-the-token-company-intelligent-compression-for-llm-context-bloat","created_at":"2026-03-03T16:18:10.552Z","updated_at":"2026-05-25T04:34:03.792Z","total_vote_count":25,"url":"https://www.ycombinator.com/launches/Pb3-the-token-company-intelligent-compression-for-llm-context-bloat","share_image_url":"//bookface-static.ycombinator.com/assets/ycdc/yc-og-image-c440a0ad1dacfb86eeeb343717479cc54d256614449b4ef719977a0a451f8bc8.png","company":{"id":31250,"name":"The Token Company","slug":"the-token-company","url":"https://thetokencompany.com","logo":"https://bookface-images.s3.amazonaws.com/small_logos/4b6d23e94e331354b9f326725df83ff557b97c1a.png","batch":"Winter 2026","industry":"B2B","tags":[],"search_path":"https://bookface.ycombinator.com/company/31250"}}