coai

🥳 CoAI.Dev

🚀 Next Generation AIGC One-Stop Business Solution

"CoAI.Dev > Next Web + One API"

English · 简体中文 · 日本語 · Docs · Discord · Deployment Guide

📝 Features

1. 🤖️ Rich Model Support: Multi-model service provider support (OpenAI / Anthropic / Gemini / Midjourney and more than ten compatible formats & private LLM support)
2. 🤯 Beautiful UI Design: UI compatible with PC / Pad / Mobile, following Shadcn UI & Tremor Charts design standards, rich and beautiful interface design and backend dashboard
3. 🎃 Complete Markdown Support: Support for LaTeX formulas / Mermaid mind maps / table rendering / code highlighting / chart drawing / progress bars and other advanced Markdown syntax support
4. 👀 Multi-theme Support: Support for multiple theme switching, including Light Mode for light themes and Dark Mode for dark themes. 👉 Custom Color Scheme
5. 📚 Internationalization Support: Support for internationalization, multi-language switching 🇨🇳 🇺🇸 🇯🇵 🇷🇺 👉 Welcome to contribute translations Pull Request
6. 🎨 Text-to-Image Support: Support for multiple text-to-image models: OpenAI DALL-E✅ & Midjourney (support for U/V/R operations)✅ & Stable Diffusion✅ etc.
7. 📡 Powerful Conversation Sync: Zero-cost cross-device conversation sync support for users, support for conversation sharing (link sharing & save as image & share management), no need for WebDav / WebRTC and other dependencies and complex learning costs
8. 🎈 Model Market & Preset System: Support for customizable model market in the backend, providing model introductions, tags, and other parameters. Site owners can customize model introductions according to the situation. Also supports a preset system, including custom presets and cloud synchronization functions.
9. 📖 Rich File Parsing: Out-of-the-box, supports file parsing for all models (PDF / Docx / Pptx / Excel / image formats parsing), supports more cloud image storage solutions (S3 / R2 / MinIO etc.), supports OCR image recognition 👉 See project CoAI.Dev Blob Service for details (supports Vercel / Docker one-click deployment)
10. 🌏 Full Model Internet Search: Based on the SearXNG open-source engine, supports rich search engines such as Google / Bing / DuckDuckGo / Yahoo / Wikipedia / Arxiv / Qwant, supports safe search mode, content truncation, image proxy, test search availability, and other functions.
11. 💕 Progressive Web App (PWA): Supports PWA applications & desktop support (desktop based on Tauri)
12. 🤩 Comprehensive Backend Management: Supports beautiful and rich dashboard, announcement & notification management, user management, subscription management, gift code & redemption code management, price setting, subscription setting, custom model market, custom site name & logo, SMTP email settings, and other functions
13. 🤑 Multiple Billing Methods: Supports 💴 Subscription and 💴 Elastic Billing two billing methods. Elastic billing supports per-request billing / token billing / no billing / anonymous calls and minimum request points detection and other powerful features
14. 🎉 Innovative Model Caching: Supports enabling model caching: i.e., under the same request parameter hash, if it has been requested before, it will directly return the cached result (hitting the cache will not be billed), reducing the number of requests. You can customize whether to cache models, cache time, multiple cache result numbers, and other advanced cache settings
15. 🥪 Additional Features (Support Discontinued): 🍎 AI Project Generator Function / 📂 Batch Article Generation Function / 🥪 AI Card Function (Deprecated)
16. 😎 Excellent Channel Management: Self-written excellent channel algorithm, supports ⚡ multi-channel management, supports 🥳priority setting for channel call order, supports 🥳weight setting for load balancing probability distribution of channels at the same priority, supports 🥳user grouping, 🥳automatic retry on failure, 🥳model redirection, 🥳built-in upstream hiding, 🥳channel status management and other powerful enterprise-level functions
17. ⭐ OpenAI API Distribution & Proxy System: Supports calling various large models in OpenAI API standard format, integrates powerful channel management functions, only needs to deploy one site to achieve simultaneous development of B/C-end business💖
18. 👌 Quick Upstream Synchronization: Channel settings, model market, price settings, and other settings can quickly synchronize with upstream sites, modify your site configuration based on this, quickly build your site, save time and effort, one-click synchronization, quick launch
19. 👋 SEO Optimization: Supports SEO optimization, supports custom site name, site logo, and other SEO optimization settings to make search engines crawl faster, making your site stand out👋
20. 🎫 Multiple Redemption Code Systems: Supports multiple redemption code systems, supports gift codes and redemption codes, supports batch generation, gift codes are suitable for promotional distribution, redemption codes are suitable for card sales, for gift codes of one type, a user can only redeem one code, which to some extent reduces the situation of one user redeeming multiple times in promotions😀
21. 🥰 Business-Friendly License: Adopts the Apache-2.0 open-source license, friendly for commercial secondary development & distribution (please also comply with the provisions of the Apache-2.0 license, do not use for illegal purposes)

✨ CoAI.Dev Business

• ✅ Beautiful commercial-grade UI, elegant frontend interface and backend management
• ✅ Supports TTS & STT, plugin marketplace, RAG knowledge base and other rich features and modules
• ✅ More payment providers, more billing models and advanced order management
• ✅ Supports more authentication methods, including SMS login, OAuth login, etc.
• ✅ Supports model monitoring, channel health detection, fault alarm automatic channel switching
• ✅ Supports multi-tenant API Key distribution system, enterprise-level token permission management and visitor restrictions
• ✅ Supports security auditing, logging, model rate limiting, API Gateway and other advanced features
• ✅ Supports promotion rewards, professional data statistics, user profile analysis and other business analysis capabilities
• ✅ Supports Discord/Telegram/Feishu and other bot integration capabilities (extension modules)
• ...

👉 Learn More

🔨 Supported Models

1. OpenAI & Azure OpenAI (✅ Vision ✅ Function Calling)
2. Anthropic Claude (✅ Vision ✅ Function Calling)
3. Google Gemini & PaLM2 (✅ Vision)
4. Midjourney (✅ Mode Toggling ✅ U/V/R Actions)
5. iFlytek SparkDesk (✅ Vision ✅ Function Calling)
6. Zhipu AI ChatGLM (✅ Vision)
7. Alibaba Tongyi Qwen
8. Tencent Hunyuan
9. Baichuan AI
10. Moonshot AI (👉 OpenAI)
11. DeepSeek AI (👉 OpenAI)
12. ByteDance Skylark (✅ Function Calling)
13. Groq Cloud AI
14. OpenRouter (👉 OpenAI)
15. 360 GPT
16. LocalAI / Ollama (👉 OpenAI)

👻 OpenAI Compatible API Proxy

• Chat Completions (/v1/chat/completions)
• Image Generation (/v1/images)
• Model List (/v1/models)
• Dashboard Billing (/v1/billing)

📦 Deployment

[!TIP] After successful deployment, the admin account is root, with the default password chatnio123456

✨ Zeabur (One-Click)

Zeabur provides a certain free quota, you can use non-paid regions for one-click deployment, and also supports plan subscriptions and elastic billing for flexible expansion.

1. Click Deploy to deploy, and enter the domain name you wish to bind, wait for the deployment to complete.
2. After deployment is complete, please visit your domain name and log in to the backend management using the username root and password chatnio123456. Please follow the prompts to change the password in the chatnio backend in a timely manner.

🐳 BTPanel (One-Click)

1. Install Baota Panel by visiting BTPanel and install using the stable version script.
2. Log in to the panel and click Docker on the left to enter Docker management.
3. If prompted that Docker / Docker Compose is not installed, you can install according to the guide above.
4. After installation is complete, enter App Store, search for CoAI and click Install.
5. Configure basic application information such as your domain name, port, etc., and click Confirm (default configuration can be used).
6. First-time installation may take 1-2 minutes to complete database initialization. If you encounter issues, please check the panel running logs for troubleshooting.
7. Visit your configured domain or server http://[ip]:[port], log in to the backend management using username root and password chatnio123456.

AlibabaCloud ComputeNest (One-Click)

1. Access the CoAI service on ComputeNest International Edition. If you are in China, please visit ComputeNest, and fill in the deployment parameters as prompted.
2. Select the payment type, fill in the instance parameters and network parameters, and click Next: Confirm Order.
3. After confirming the deployment parameters and checking the estimated price, click Create Now and wait for the service instance to be deployed.
4. Click Service Instance on the left. After the service instance is deployed, click the instance ID to enter the details interface.
5. Click the address in Use Now on the details interface to enter the CoAI interface. The default username is root and the password is chatnio123456 to log in to the backend management.
6. For more operation details and payment information, see：Service Details.

⚡ Docker Compose Installation (Recommended)

[!NOTE] After successful execution, the host machine mapping address is http://localhost:8000

git clone --depth=1 --branch=main --single-branch https://github.com/coaidev/coai.git
cd chatnio
docker-compose up -d # Run the service
# To use the stable version, use docker-compose -f docker-compose.stable.yaml up -d instead
# To use Watchtower for automatic updates, use docker-compose -f docker-compose.watch.yaml up -d instead

Version update (If Watchtower automatic updates are enabled, manual updates are not necessary):

docker-compose down 
docker-compose pull
docker-compose up -d

• MySQL database mount directory: ~/db
• Redis database mount directory: ~/redis
• Configuration file mount directory: ~/config

⚡ Docker Installation (Lightweight runtime, commonly used for external MYSQL/RDS services)

[!NOTE] After successful execution, the host machine address is http://localhost:8094.

To use the stable version, use programzmh/chatnio:stable instead of programzmh/chatnio:latest

docker run -d --name chatnio \
   --network host \
   -v ~/config:/config \
   -v ~/logs:/logs \
   -v ~/storage:/storage \
   -e MYSQL_HOST=localhost \
   -e MYSQL_PORT=3306 \
   -e MYSQL_DB=chatnio \
   -e MYSQL_USER=root \
   -e MYSQL_PASSWORD=chatnio123456 \
   -e REDIS_HOST=localhost \
   -e REDIS_PORT=6379 \
   -e SECRET=secret \
   -e SERVE_STATIC=true \
   programzmh/chatnio:latest

• --network host means using the host machine's network, allowing the Docker container to use the host's network. You can modify this as needed.
• SECRET: JWT secret key, generate a random string and modify accordingly
• SERVE_STATIC: Whether to enable static file serving (normally this doesn't need to be changed, see FAQ below for details)
• -v ~/config:/config mounts the configuration file, -v ~/logs:/logs mounts the host machine directory for log files, -v ~/storage:/storage mounts the directory for additional feature generated files
• MySQL and Redis services need to be configured. Please refer to the information above to modify the environment variables accordingly

Version update (After enabling Watchtower, manual updates are not necessary. After execution, follow the steps above to run again):

docker stop chatnio
docker rm chatnio
docker pull programzmh/chatnio:latest

⚒ Compile and Install

[!NOTE] After successful deployment, the default port is 8094, and the access address is http://localhost:8094

Config settings (~/config/config.yaml) can be overridden using environment variables. For example, the MYSQL_HOST environment variable can override the mysql.host configuration item

git clone https://github.com/coaidev/coai.git
cd chatnio

cd app
npm install -g pnpm
pnpm install
pnpm build

cd ..
go build -o chatnio

# e.g. using nohup (you can also use systemd or other service manager)
nohup ./chatnio > output.log & # using nohup to run in background

📦 Tech Stack

• 🥗 Frontend: React + Redux + Radix UI + Tailwind CSS
• 🍎 Backend: Golang + Gin + Redis + MySQL
• 🍒 Application Technology: PWA + WebSocket

🤯 Why Create This Project & Project Advantages

• We found that most AIGC commercial sites on the market are frontend-oriented lightweight deployment projects with beautiful UI interface designs, such as the commercial version of Next Chat. Due to its personal privatization-oriented design, there are some limitations in secondary commercial development, presenting some issues, such as:

  1. Difficult conversation synchronization, for example, requiring services like WebDav, high user learning costs, and difficulties in real-time cross-device synchronization.
  2. Insufficient billing, for example, only supporting elastic billing or only subscription-based, unable to meet the needs of different users.
  3. Inconvenient file parsing, for example, only supporting uploading images to an image hosting service first, then returning to the site to input the URL direct link in the input box, without built-in file parsing functionality.
  4. No support for conversation URL sharing, for example, only supporting conversation screenshot sharing, unable to support conversation URL sharing (or only supporting tools like ShareGPT, which cannot promote the site).
  5. Insufficient channel management, for example, the backend only supports OpenAI format channels, making it difficult to be compatible with other format channels. And only one channel can be filled in, unable to support multi-channel management.
  6. No API call support, for example, only supporting user interface calls, unable to support API proxying and management.

• Another type is API distribution-oriented sites with powerful distribution systems, such as projects based on One API. Although these projects support powerful API proxying and management, they lack interface design and some C-end features, such as:

  1. Insufficient user interface, for example, only supporting API calls, without built-in user interface chat. User interface chat requires manually copying the key and going to other sites to use, which has a high learning cost for ordinary users.
  2. No subscription system, for example, only supporting elastic billing, lacking billing design for C-end users, unable to meet different user needs, and not user-friendly in terms of cost perception for users without a foundation.
  3. Insufficient C-end features, for example, only supporting API calls, not supporting conversation synchronization, conversation sharing, file parsing, and other functions.
  4. Insufficient load balancing, the open-source version does not support the weight parameter, unable to achieve balanced load distribution probability for channels at the same priority (New API also solves this pain point, with a more beautiful UI).

Therefore, we hope to combine the advantages of these two types of projects to create a project that has both a powerful API distribution system and a rich user interface design, thus meeting the needs of C-end users while developing B-end business, improving user experience, reducing user learning costs, and increasing user stickiness.

Thus, CoAI.Dev was born. We hope to create a project that has both a powerful API distribution system and a rich user interface design, becoming the next-generation open-source AIGC project's one-stop commercial solution.

❤ Donations

If you find this project helpful, you can give it a Star to show your support!