参数高效微调

67 条

LoRA / QLoRA / DoRA 等 PEFT 方法。

#仓库Stars
1unslothai/unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
79k
2labmlai/annotated_deep_learning_paper_implementations
🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
68k
3lyogavin/airllm
AirLLM 2.8T LLM inference with single 4GB GPU
42k
4datawhalechina/self-llm
《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程
33k
5huggingface/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
22k
6ymcui/Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
19k
7OpenPipe/ART
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
11k
8meshtastic/firmware
The official firmware for Meshtastic, an open-source, off-grid mesh communication system.
8.6k
9markqvist/Reticulum
The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.
7.7k
10Akegarasu/lora-scripts
SD-Trainer. LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.
6.2k
11ExpressLRS/ExpressLRS
High Performance Open Source Radio Control Link
5.5k
12agentheroes/agentheroes
Generate, animate and schedule your AI characters 🤖
3.4k
13gioblu/PJON
PJON (Padded Jittering Operative Network) is an experimental, arduino-compatible, multi-master, multi-media network protocol.
2.8k
14adapter-hub/adapters
A Unified Library for Parameter-Efficient and Modular Transfer Learning
2.8k
15absmach/magistrala
IoT Platform Framework
2.7k
16markqvist/NomadNet
Communicate Freely
2.6k
17cyberman54/ESP32-Paxcounter
Wifi & BLE driven passenger flow metering with cheap ESP32 boards
2.1k
18meshtastic/Meshtastic-Android
Android application for Meshtastic
1.9k
19dphnAI/sonar
Large-scale LLM inference engine
1.9k
20markqvist/Sideband
LXMF client for Android, Linux and macOS allowing you to communicate with people or LXMF-compatible systems over Reticulum networks using LoRa, Packet Radio, WiFi, I2P, or anything else Reticulum supports.
1.9k
21ARahim3/mlx-tune
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
1.5k
22whitecatboard/Lua-RTOS-ESP32
Lua RTOS for ESP32
1.3k
23ModelCloud/GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia (CUDA), AMD (ROCm), Intel GPU (XPU), Huawei Ascent (NPU), and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
1.3k
24torlando-tech/columba
Native Android messaging app using Bluetooth LE, TCP, or RNode (LoRa) over LXMF and Reticulum
1.3k
25TheThingsNetwork/lorawan-stack
The Things Stack, an Open Source LoRaWAN Network Server
1.2k
26chirpstack/chirpstack
ChirpStack open-source LoRaWAN Network Server
1.1k
27Finrandojin/alexandria-audiobook
AI-powered multi-voice audiobook generator — LLM script annotation, voice cloning, voice design, LoRA training, per-line style control, and export to MP3, chaptered M4B, or Audacity multi-track. Built on Qwen3-TTS.
1.1k
28X-LANCE/SLAM-LLM
A Framework for Speech, Language, Audio, Music Processing with Large Language Model
1.1k
29lyusupov/SoftRF
:airplane: Multi-functional, compatible DIY general aviation proximity awareness system
1.0k
30tapparelj/gr-lora_sdr
This is the fully-functional GNU Radio software-defined radio (SDR) implementation of a LoRa transceiver with all the necessary receiver components to operate correctly even at very low SNRs. This work has been conducted at the Telecommunication Circuits Laboratory, EPFL.
1.0k
31NVlabs/DoRA
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
1.0k
32ElectronicCats/CatSniffer
CatSniffer is an original multiprotocol and multiband board for sniffing, communicating, and attacking IoT (Internet of Things) devices using the latest radio IoT protocols. It is a highly portable USB stick that integrates TI CC1352, Semtech SX1262, and an RP2040 for V3 or a Microchip SAMD21E17 for V2
958
33baidu-baige/LoongForge
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
834
34finegrain-ai/refiners
Refiners (discontinued early 2025) was a microframework on top of PyTorch with first-class citizen APIs for foundation model adaptation.
832
35drowzeys/Imagination-Studio-by-keys-Wasserman
Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate workflow by Sam Wasserman), render Qwen-Image-2.1 / FLUX3-K pictures and MiniMax H3 / FastH3 video with sound on TensorFold.
817
36buildwithparallel/haven-manet-ip-mesh-radio
Haven – MANET IP Mesh Radio toolkit
766
37alesha-pro/tools
Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig
697
38sunrainyg/RandOpt
Official Codebase for "Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weights" (ICML 2026 Spotlight)
658
39timmbogner/Farm-Data-Relay-System
A system that uses ESP-NOW, LoRa, and other protocols to transport sensor data in remote areas without relying on WiFi.
629
40wildminder/awesome-ltx2
All available LTX-2 models, encoders, workflows, LoRAs for ComfyUI
603
41ukairia777/tensorflow-nlp-tutorial
tensorflow를 사용하여 텍스트 전처리부터, Topic Models, BERT, GPT, LLM과 같은 최신 모델의 다운스트림 태스크들을 정리한 Deep Learning NLP 저장소입니다.
580
42shootthesound/comfyUI-Realtime-Lora
Train and block edit and save LoRAs directly inside ComfyUI for Z-image, Flux Klein, SDXL, Flux, WAN 2.2, SD 1.5
575
43richonguzman/LoRa_APRS_iGate
LoRa APRS iGATE for ESP32 Based Board with Rx + Tx capabilities
534
44richonguzman/LoRa_APRS_Tracker
LoRa APRS Tracker with Tx and Rx capabilities, Messages, Wx, Winlink and more...
527
45meshtastic/network-management-client
A Meshtastic desktop client, allowing simple, offline deployment and administration of an ad-hoc mesh communication network. Built in Rust and TypeScript.
504
46lora-rs/lora-rs
LoRa and LoRaWAN crates for End Devices
480
47agamrossen/VolAnti
Open-source acoustic drone detection. It hears the propellers, not the radio, so it works against fibre-optic FPV aircraft that emit no signal at all.
465
48ClusterDuck-Protocol/ClusterDuck-Protocol
Firmware for an ad-hoc mesh network of Internet-of-Things devices based on LoRa (Long Range radio) that can be deployed quickly and at low cost.
449
49chirpstack/chirpstack-gateway-bridge
ChirpStack Gateway Bridge abstracts Packet Forwarder protocols into Protobuf or JSON over MQTT.
446
50Saquib764/omini-kontext
An inference and training framework for multiple image input in Flux Kontext dev
444