whisper.cpp: Speech Recognition on Anything - Inside ggml-org/whisper.cpp
Every app that listens — the meeting transcriber, the voice assistant, the subtitle generator on your phone — needs speech-to-text that runs without a datacenter, and for most of the industry the answer is this repository. whisper.cpp took OpenAI’s Whisper...
Weaviate: The Vector Database Built Like a Database - Inside weaviate/weaviate
Most vector databases grew out of an ANN index and added a database around it. Weaviate grew out of a database and added the vectors in. The result shows everywhere in the source: writes flow through a write-ahead-logged LSM tree...
Transformers: The Library That Standardized AI - Inside huggingface/transformers
Before 2018, using five model architectures meant reading five papers and porting five codebases; after transformers, it meant changing one string. The library’s contract is deceptively simple — AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.2-1B-Instruct") returns a ready model, AutoTokenizer handles the text, and model.generate() streams...
TensorRT-LLM: Two Engines, One API - Inside NVIDIA/TensorRT-LLM
Serving a large model on a GPU is a different sport from running one on a laptop: the difference between a demo and a production endpoint is measured in tokens per second per dollar, and every millisecond of kernel launch...
SWE-agent: The Agent That Fixes Real GitHub Issues - Inside SWE-agent/SWE-agent
In 2023 the founders of this project asked a question that sounds naive and turned out to be profound: if you put a language model inside a terminal, can it fix a real GitHub issue? The answer, published with the...
RAGFlow: Deep Document Understanding, Now in Go - Inside infiniflow/ragflow
Most retrieval-augmented generation projects treat documents as text to be split; RAGFlow was built on the conviction that the hard part happens before the first embedding call. Scanned PDFs, multi-column papers, tables spanning pages, contracts with stamps — a naive...
OpenManus: An Open General Agent, Built in Hours - Inside FoundationAgents/Op...
When the closed-source Manus agent went viral behind an invite-code wall, five researchers from the MetaGPT team responded the fastest way they knew how: they built an open alternative and shipped the prototype in three hours. OpenManus — MIT-licensed, Python...
Gradio: The Python Function That Became a Web App - Inside gradio-app/gradio
Every machine learning demo you have clicked in the last five years — on Hugging Face Spaces, in a paper’s supplementary page, inside a model card — was almost certainly built with this library. The promise is absurd and delivered...
Fish Speech: A Language Model That Speaks in Audio Tokens - Inside fishaudio/...
The newest generation of text-to-speech systems stopped pretending to be signal processing and started being language models, and fish-speech is one of the clearest open examples of that shift. Its flagship model, Fish Audio S2, is a 4-billion-parameter transformer trained...
Coqui TTS: The Voice Zoo That Refused to Die - Inside idiap/coqui-ai-TTS
When the original Coqui company shut down in 2024, it left behind something unusual: a full zoo of text-to-speech architectures — fourteen acoustic models, a shelf of vocoders, speaker encoders, voice conversion — with pretrained checkpoints for over a thousand...
Whisper: One Model for Every Voice - Inside openai/whisper
Speech recognition used to mean a stack of specialist components — a voice activity detector, an acoustic model, a pronunciation lexicon, a language model, each with its own failure modes — and Whisper’s central idea is that a single sequence-to-sequence...
Streamlit: The Script That Became an App - Inside streamlit/streamlit
Most web frameworks ask you to learn HTTP. Streamlit asks you to write a Python script. x = st.slider("Select a value") followed by st.write(x, "squared is", x * x) is a complete interactive web app — run streamlit run streamlit_app.py...
Skyvern: LLM Agents That Drive the Browser - Inside skyvern-ai/skyvern
Every Selenium script eventually dies the same death: the website redesigns one button, the XPath goes stale, and the automation that ran for months starts failing on a Tuesday. Skyvern attacks that fragility at the root — instead of hand-written...
Pydantic AI: Typed Agents for Every Model - Inside pydantic/pydantic-ai
Type safety is the oldest promise in the pydantic ecosystem, and Pydantic AI — subtitled simply “How Python does AI” — is that promise carried into the agent era. The README’s pitch is that an agent is a normal Python...
Milvus: Vector Search at Billion Scale - Inside milvus-io/milvus
Every RAG application eventually hits the same wall: the embeddings outgrow Postgres, and the search that was instant at a hundred thousand vectors becomes a pile of scan queries at a hundred million. Milvus is the database built for that...
llama.cpp: LLM Inference on Anything - Inside ggml-org/llama.cpp
There is a particular kind of satisfaction in watching a multi-billion-parameter model generate fluent text on a laptop with no discrete GPU, fully offline, at usable speed. That experience is exactly what ggml-org/llama.cpp ships: LLM and vision-language inference written in...
LanceDB: The Embedded Multimodal Lakehouse - Inside lancedb/lancedb
There is a niche between “my vectors fit in a NumPy array” and “I need a Kubernetes cluster” where most AI applications actually live, and LanceDB is built exactly for it: a serverless vector database that runs embedded in your...
Faster Whisper: The Same Model, Four Times the Speed - Inside SYSTRAN/faster-...
The fastest way to make a model four times faster is often to leave it alone. faster-whisper is SYSTRAN’s reimplementation of OpenAI’s Whisper on CTranslate2, a quantized Transformer inference engine, and the README’s benchmark table makes the case with numbers:...
Chainlit: Python Chat UIs in Minutes - Inside Chainlit/chainlit
The fastest way to demo an LLM is a print loop; the fastest way to ship one is a chat interface people can actually use — with history, streaming, file uploads, authentication, and a thread they can return to. Chainlit...
CAMEL: Finding the Scaling Laws of Agents - Inside camel-ai/camel
There is a question that sounds almost childish until you try to answer it: what happens to agent behavior when you multiply agents the way you multiply model parameters? CAMEL is an open-source community dedicated to finding the scaling laws...
vLLM: PagedAttention and Continuous Batching at Web Scale - Inside vllm-proje...
Most inference libraries treat GPU memory as one more thing for you to manage. vLLM, Apache-2.0-licensed and originally developed in the Sky Computing Lab at UC Berkeley, is the serving engine that made memory management the product: its PagedAttention scheme,...
SGLang: RadixAttention and Cache-Aware Serving - Inside sgl-project/sglang
Serving systems usually rediscover the same insight over and over: most tokens you generate have been generated before. SGLang, Apache-2.0-licensed and hosted by the LMSYS non-profit, turned that insight into its founding idea. The project grew out of the RadixAttention...
Qdrant: A Vector Database Written in Rust - Inside qdrant/qdrant
Embeddings are only half of a semantic search system; the other half is a database that can store billions of them, filter them by arbitrary metadata, and return nearest neighbors in milliseconds under concurrent writes. Qdrant, an Apache-2.0 vector database...
