标签：Transformers

21 Lessons, Get Started Building with Generative AI

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Learn AI Engineering! Learn it. Build it. Ship it for others.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

CVPR 2026 论文和开源项目合集

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Machine Learning Engineering Open Book

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Ongoing research training transformer models at scale

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

A straightforward method for training your LLM, from downloading data to generating text.

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

A PyTorch-based Speech Toolkit

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

This repository contains demos I made with the Transformers library by HuggingFace.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Open source real-time translation app for Android that runs locally

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

BertViz: Visualize Attention in Transformer Models

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing

Open-source offline translation library written in Python

On-device Speech AI for Apple Silicon

Chronos: Pretrained Models for Time Series Forecasting

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Robust recipes to align language models with human and AI preferences

Superduper: End-to-end framework for building custom AI applications and agents.

A machine learning software for extracting information from scholarly documents

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

《大模型白盒子构建指南》：一个全手搓的Tiny-Universe

🌟100+ 原创 LLM / RL 原理图📚，《大模型算法》作者巨献！💥（100+ LLM/RL Algorithm Maps ）

LightGlue: Local Feature Matching at Light Speed (ICCV 2023)

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.