↓ Skip to main content
tomrochette.com
  1. Agents/
  2. Retrieval/

Chonkie

Author
glm-5.3-flash
History / Edit / PDF / EPUB / MD
Created: / Updated: / Status: finished / Readability: 3 / 6 minutes read (~1075 words)
agent-curated 361 chunking 3 fully-ai-generated 463 llm=glm-5.3-flash 372 rag 16 research-note 331 retrieval 11
Table of Contents

Chonkie is an MIT-licensed Python (with a TypeScript port) chunking library for RAG pipelines that packages token-based, sentence, recursive, semantic, late, code (AST), and neural chunkers behind one small, dependency-light interface.

It won the chunking niche on install size and speed, survived the niche’s commoditization, and outlived its own company’s attention: the library keeps shipping while the startup behind it has moved on to a new venture.

What it is
#

The README’s chunker table covers TokenChunker, FastChunker (SIMD-accelerated byte chunking), SentenceChunker, RecursiveChunker, SemanticChunker (embedding-similarity boundaries, in the Greg Kamradt lineage), LateChunker (embeds before splitting, per the late-chunking paper), CodeChunker (AST-based code splits), and NeuralChunker (model-based segmentation), with a pip install chonkie core the repo badges at 505KB and optional extras for semantic, code, and API dependencies. It also ships refineries, pipelines stored in a local SQLite database, a self-hosted REST API server (uvicorn chonkie.api.main:app), works with transformers, tokenizers, and tiktoken tokenizers, and publishes its own agent skills (npx skills add chonkie-inc/skills). The project began as bhavnicksm/chonkie (Show HN, 199 points, November 2024), became the YC X25 company Chonkie with a 151-point Launch HN in June 2025, and the repository now lives under the Feyn Labs org as feyninc/chonkie, though the original author repository now 404s.

Status
#

The open source library is active and widely used; the company around it has visibly moved on. The repository shows 4,783 stars, a push on 2026-10-03, and PyPI shows version 1.7.0 released 2026-07-07 across 62 releases, with 1,255,276 downloads in the last month (as of 2026-10-06); the TypeScript port, renamed alongside the org to feyninc/chonkiejs, was last pushed 2026-10-03. The caution is the corporate trail: chonkie.ai, the domain in the Launch HN, now redirects to Feyn Labs, a venture whose founder letter is signed by Chonkie’s co-founder Shreyash Nigam, the repository itself moved under the Feyn org (feyninc/chonkie, with the old chonkie-inc URL redirecting), the hosted endpoints (cloud.chonkie.ai, hub.chonkie.ai, labs.chonkie.ai) are dead or 404, and the README still links Cloud to the dead labs domain. The community footprint earlier scans missed is real: two major HN threads (199 points in 2024, 151 in 2025) plus a 153-point technical post (“So, you want to chunk really fast?”, December 2025) by co-founder Bhavnick Minhas on his delimiter-based memchunk approach.

Strengths
#

  • The lightweight pitch held up: a small default install working with any tokenizer, which is exactly what bloated framework splitters made painful.
  • The chunker menu spans cheap to expensive strategies (token to neural) behind one interface, so upgrading a pipeline’s splitter is a one-line change.
  • Adoption is broad: over a million PyPI downloads a month and framework integration, with LlamaIndex’s newer Chunker node parser delegating to Chonkie rather than reimplementing chunking.
  • Still maintained: releases through July 2026 and pushes in September 2026, no deprecation notice.

Cautions
#

  • The commercial layer is gone: the cloud API the 2025 launch sold is dead, so anything built on Chonkie Cloud needs migration to the self-hosted API server, and the docs’ “via our API” wording is now stale.
  • The benchmark claims (15MB versus 80-170MB installs, up to 33x faster token chunking than LangChain and LlamaIndex) are vendor-run and unverified independently; the repo’s BENCHMARKS.md is maintained by the vendor.
  • The practitioners’ ranking cuts against premium chunking: Continue’s custom code RAG guide ranks truncation and fixed-length chunking above AST chunking because long-context embedding models fit most files whole.
  • Dependency on a venture that has pivoted means roadmap risk: Feyn Labs is about training custom models, not chunking.

Pricing
#

The library is free and MIT-licensed; the paid hosted API it once sold is dead, and the replacement is running the bundled self-hosted REST API server yourself. Costs beyond integration time are the usual RAG bill: embedding API calls for semantic and late chunking, or GPU time for the neural chunker.

Compared to
#

  • LangChain and LlamaIndex splitters: the benchmark targets; LlamaIndex now wraps Chonkie for chunking, which concedes where the effort should live, while LangChain offers separator-based splitting only.
  • Tree-sitter code chunking: the code-specific alternative; Chonkie’s CodeChunker competes in the same AST-aware niche with less per-language machinery.
  • Fixed-length and truncation chunking: the practitioners’ default; per Continue’s guide they beat fancier chunking for most corpora with 16k-token embedding models.

Bottom line
#

Recommended as the default chunker library when a pipeline genuinely needs splitting beyond naive truncation, since it is small, maintained, and framework-accepted. Not for anyone wanting a hosted or supported product: that part of Chonkie no longer exists. My disagreeable claim: Chonkie’s real innovation was packaging, not algorithms, and its founders’ move to a new venture says as much about chunking’s commoditization as any benchmark does.

Changes
#

  • 2026-09-16 - Created.
  • 2026-09-18 - Refreshed volatile facts for the 2026-09-18 verification: 4,755 stars, a push on 2026-09-18, and 1,081,591 PyPI downloads in the last month (pypistats answered again after the 2026-09-16 blocking).
  • 2026-09-20 - Recorded the repository’s move under the Feyn Labs org (feyninc/chonkie, the chonkie-inc URL now redirects) and refreshed the star count to 4,760; PyPI, releases, and the stale Cloud link unchanged.
  • 2026-09-20 - Recorded the TypeScript port’s matching rename to feyninc/chonkiejs and refreshed the trailing-month PyPI figure to 1,046,347 as of 2026-09-20.
  • 2026-09-25 - Refreshed the volatile facts: 4,770 stars and 1,138,639 trailing-month PyPI downloads as of 2026-09-25; version 1.7.0, the push date, and the JS port unchanged.

See also
#

References
#