Chonkie And Friends Co.

All

3 repositories

chonkie
Public
🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library
python nlp ai etl retrieval text-processing chunking semantic-segmentation rag vector-search
Python
•
MIT License
•100•2.2k•13•1•Updated Jan 5, 2025Jan 5, 2025
chonkie-docs
Public
A tiny handbook unlocking mighty power - 🦛 Documentation for Chonkie ✨
ai retrieval embeddings artificial-intelligence chunking rag llms chonkie
MDX
•0•1•0•0•Updated Jan 5, 2025Jan 5, 2025
autotiktokenizer
Public
🧰 The AutoTokenizer that TikToken always needed -- Load any tokenizer with TikToken now! ✨
nlp machine-learning transformers tokenizers tiktoken
Python
•
MIT License
•3•32•1•1•Updated Jan 3, 2025Jan 3, 2025