Backed byY Combinator

Labs waste your tokens.
We don’t.

Every filler token in your context is revenue for a lab. With bear‑2 in front, filler never wastes the context window. Same answers, a fraction of the cost.

Sun setting behind a pine ridge
Backed by the founders of
Hugging FaceSiloSupercellDropboxSlack

Featured

Process raw LLM inputs

We build proprietary compression models to process raw text. Below 50ms inference with full determinism and cache safety.

Read the docs
In its most fundamental sense, compression is the process of encoding
information using fewer bits or resources than the original representation
by identifying and eliminating statistical redundancies or irrelevant data
within a dataset. Whether applied to digital media, text, or the high-
dimensional vector spaces of Large Language Models, compression relies on
the principle that most raw information contains noise or repeating patterns
that do not contribute new meaning. By applying an algorithm—or in your
case, an ML-based model—to map the input data into a more compact form,
you essentially distil the signal from the noise. In the context of ML
inputs, this means transforming long-form text into a dense, mathematically
efficient representation that preserves the original semantic intent and
logical relationships while significantly reducing the physical token count,
thereby allowing a system to process more information within the same fixed
computational window or budget.

Built for regulated data

Your prompts are some of your most sensitive data, so we hold them to the same bar you do. Audited controls, a signed BAA, and the option to keep every token inside your own network.

Visit the Trust Center
AICPA SOC 2
  • SOC 2 Type I. Externally attested. Type II in September 2026.
  • HIPAA compliant. We sign a BAA.
  • Zero data retention. Optional, set account-wide.
  • On-premise deployment. Your VPC or your data center.

Research

Wrap your existing client

One line wraps your OpenAI or Anthropic client. Your existing code stays the same. Compression happens automatically.

pip install the-token-company
Read the docs

Frequently asked questions

What is prompt compression?

Prompt compression, also called token optimization, context compression, context optimization, or token minimization, cuts the number of tokens in an LLM prompt or context window while preserving its meaning, so the same request uses fewer tokens and costs less.

Compression finds the most token-efficient way to represent your context to the model, keeping every bit of signal and shedding the rest. It is fully deterministic, and nothing is summarized or rewritten, so the text that reaches the model stays verbatim and in original order.

How does it actually work? Is it generative, or does it just drop tokens?

We sit as a middleware layer between your prompt and your LLM. A small ML classifier scores every token in your input and removes the ones least likely to affect the model's output.

Nothing is summarized, paraphrased, or generated. We only ever delete.

That's why we're faster, cheaper, and 100% deterministic, where a small-LLM-based compression step is none of those.

Talk with the founder

How much will it actually compress my input?

Typically 10–50% while maintaining full accuracy, depending on how dense your input is.

Clean, information-rich text compresses less. Noisy web scrapes, long chat histories, and verbose documents compress more.

You control how aggressive we are with the aggressiveness parameter.

How fast is the compression API?

Latency depends on input size, but we're built for real-time use, with p95 at 150ms.

For most workflows the shorter prompt after compression cuts time-to-first-token from the downstream LLM by more than the compression step adds, so end-to-end round-trip goes down with compression in the loop, not up.

Will I lose information I need?

No. The models are trained to remove only the parts of your input that are not important: boilerplate, filler, redundant phrasing, structural scaffolding. Important information is never removed.

What changes is the representation, not the meaning. The text that reaches the model is denser and reads differently, but the intention of the original is preserved: the model still sees what you meant.

We never add information either. Nothing is invented, paraphrased, or summarized. Compression only ever takes boilerplate away.

How is this different from summarization?

Summarization rewrites your input. It changes wording, introduces hallucinations, and loses structure.

We only delete. The remaining text is verbatim, in the original order, which keeps citations, code, numbers, and JSON intact.

Will it break my LLM provider's prompt caching?

No. Our output is deterministic for a given input and setting, so caches (yours or your LLM provider's) stay valid. Cache management is important thus we've designed the compression models to be cache preserving.

What about data retention and compliance?

Zero data retention is available on request and can be set at the account level.

We're SOC 2 Type I (audited by Advantage partners, type 2 expected on 09/2026) and HIPAA-ready with a BAA.

Can I run this on-prem or in my own VPC?

Yes. On-premise deployment is available on Enterprise: the compression engine runs inside your own VPC or data center, so raw prompts never leave your network.

Get in touch

Stop paying for filler.

Get an API key and see the savings on your own prompts.