Imagination-Studio-by-keys-Wasserman

drowzeysApache-2.0活跃维护

面向 Mac 和 NVIDIA DGX Spark 的 AI 电影制作工作室,按剧组流程规划分镜,并用 Qwen-Image、FLUX、MiniMax 等模型生成带声音的画面与视频。

Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate workflow by Sam Wasserman), render Qwen-Image-2.1 / FLUX3-K pictures and MiniMax H3 / FastH3 video with sound on TensorFold.

v4.4.1发布于 2026-11-08 15:49 UTC828star +178 / 7 天145fork同步于 2026-11-10 17:55 UTC

怎么上手

由 README 提炼,执行前请确认
brew install [email protected] uv ffmpeg
git clone https://github.com/drowzeys/Imagination-Studio-by-keys-Wasserman.git
cd Imagination-Studio-by-keys-Wasserman
bash oneshot-setup.sh --app
硬件要求按 README 说明

Mac 需 Apple silicon 与 macOS 26+,快速原生视频路径需 M5 系列;安装要求 48 GB 内存仅做图片、96 GB 标准视频、128 GB Turbo/Ref2VA,标准安装约需 185 GB 磁盘。NVIDIA Linux 面向 DGX Spark(GB10,128 GB 统一内存),核心安装约 125 GB 磁盘,含可选模型约 400 GB;另有 RTX Pro 6000、RTX 5090 等机型文档。Windows 原生运行(无 WSL),目标为 Windows 11 on Arm 配 NVIDIA RTX Spark,128 GB 配置面向完整功能。

支持 Apple Silicon需要 CUDA
下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

本地 AI 电影工作室,在 Mac、Windows 或 NVIDIA Linux 上完成从剧本规划到图像、视频、配音、配乐和剪辑导出

面向 Mac 和 NVIDIA DGX Spark 的 AI 电影制作工作室,按剧组流程规划分镜,并用 Qwen-Image、FLUX、MiniMax 等模型生成带声音的画面与视频。

核心能力

  • 按剧组流程规划影片,维护剧本、分镜和 film bible
  • 用 Qwen-Image-2.1 / FLUX3-K 生成图片,MiniMax H3 / FastH3 生成带声视频
  • Fish Audio Drama 3 配音,MiniMax-Music3 / YuE2 生成歌曲与音效
  • 内置内存守卫,渲染前测量峰值并卸载空闲模块腾出显存
  • 提供 job API 与 MCP 工具,供 Claude Code 等 agent 调用渲染

容易踩的坑

安装器只装组件和模型框架,模型权重需另在 Settings → Models & weights 下载,仓库不重新分发权重;Qwen-Image-2.1 与 MMAudio 权重为非商用,MiniMax H3 有地域限制,商用前需逐个核对许可;默认绑定 localhost:7870,其他设备访问需用 Settings → Access key 的访问密钥;Windows 上不要运行 Linux 的 --upgrade 升级命令,改用对应 PowerShell 脚本。

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

5 个版本v4.4.1
  1. v4.4.14.4.1: the 4.3.1 screens are back最新正式版2026-11-08 · 2026-11-08 15:49 UTC

    The 4.3.1 screens are back, at Wasserman's request (#226). The page is 4.3.1's again. Everything under it stays as it is in 4.4.0: native Windows, the Windows auto-update (#224), Access (#218), Finish and Premiere, keys-HDR, two GPUs, the Sparks fixes, SPARK_PROGRESS_FILE and job previews. To update, git pull and restart. The updater does this by itself.

    • Out of the screens: the Console look and Appearance themes (#219, #197), the simple studio (#220), the Quick Edit tab (#208), the No sound choice (#205), the new Library layout and its paging (#222), and the 4.4.0 additions to the Home composer and the Windows pages.
    • Kept: the Windows app icon (the tray and the desktop shortcut use it), and adding clips to the timeline one at a time, so two quick additions both land.
    • Video Turbo adapter (#228, fixes #225, reported by deeeed): oneshot-setup.sh --turbo failed with a 404 because the Phosphene release copy is gone. It now downloads LightX2V's own file (sha256 pinned) and converts it into the runner layout at install. The tensors are the same as before, bit for bit.
  2. v4.4.0Imagination Studio 4.4.02026-11-08 · 2026-11-08 04:36 UTC
    查看更新说明

    Native Windows, the Console look with the simple studio, and Quick Edit. The Mac and Spark engines are the same as 4.2.1's. To update, git pull and restart. On Windows, run the setup again, since 4.4.0 adds its own setup scripts.

    • Windows, natively (#200, #206, #207, #211, #212; ivberg's #198 and #210 carried): the whole Studio runs on Windows on Arm (RTX Spark N1X), with no WSL. It includes ComfyUI, TensorFold 1.2.2 engines, Library actions, Character Swap, foley, Finish, LoRA training and Music 3's own engine. Native video fits within Windows' 30 GB. The WSL version is gone.
    • The Console look (#219, MiaAI-Lab; #197): Light, Dark, OLED and Match the computer themes, a Text size setting, and the screens rebuilt.
    • The simple studio (#220, MiaAI-Lab): a simpler starting view, with the next actions under every result.
    • Quick Edit (#208, MiaAI-Lab): change a picture by saying what to change, in one box.
    • No sound (#205, MiaAI-Lab): a clip can be made without sound, from step 3.
    • Access (#218, MiaAI-Lab): you can choose to trust your own tailnet and home networks. Off by default.
    • Library (#222, nickmontag's #221 carried): players load only when they come near the screen, 60 tiles show per page with Show more, and the page redraws only for a new or deleted take.
    • Finish (#216): Premiere export works everywhere (the converter is fixed on Windows), and Windows renders frame-exact.
    • keys-HDR LORA (#190): an HLG HDR finish for any clip.
    • Two GPUs in one machine (#191, davidlowjw's #184 carried) and paired cards in the web UI (#194, davidlowjw's #192 carried).
    • Sparks: live readings are drawn in place, so a playing clip no longer restarts every 4 s (#193, davidlowjw, fixes #186). Cancelled clips are no longer sent to workers (#209, newjordan).
    • For apps that drive the Studio: SPARK_PROGRESS_FILE writes a clip's progress to a file, for a workload governor (#189, benbuschmann's #182, plus a Cancel fix). Job previews give a clip's live preview over the API, opt-in (#217).
    • Home (#196, wassermanproductions): FLUX3 Klein and YuE2 chips in the composer.
    • RTX Spark N1X: the GPU carve-out is used as the memory pool, and STUDIO_MEMORY_GUARD=warn flags instead of refusing (#199). Speed and LLM measurements are in the docs (#202, #203, #204).
    • Fixes: a docs table row (#188, halr9000), and two flaky tests (#180, #181).
  3. v4.3.1Imagination Studio 4.3.12026-10-30 · 2026-10-30 07:02 UTC
    查看更新说明

    Imagination Studio 4.3.1 runs on one to four local NVIDIA GPUs on one Linux machine, and raises a Mac's default install to 96 GB. The engines are the same as 4.2.1's.

    New

    • Local NVIDIA GPU workers (#177, akol1's #168 carried onto 4.3.0, thank you @akol1).
      • On a workstation with up to four NVIDIA cards, the Studio runs on one card and starts a worker on each other compute card.
      • Machine → Sparks shows each card's VRAM, utilization and job.
      • Card pinning: workers are pinned by card UUID, so a card whose order changed is caught rather than used by mistake.
      • Shared RAM: jobs wait their turn for the machine's RAM. A job that can never fit is refused at once, and the refusal names what holds the memory.
      • Which card the Studio uses: with two or more compute cards, set STUDIO_GPU to the Studio's own card; the launch script asks for it. A display card is only used when you say so.
      • Limit: a fifth card is refused.
      • See Local GPUs.

    Changed

    • A Mac needs 96 GB for the default install (video, voice, music, Bolt), up from 64 GB (#178).
      • Pictures only: bash oneshot-setup.sh --image-only still needs 48 GB. A fresh install on a smaller Mac stops before downloading anything and offers it.
      • Upgrading a 64 to 95 GB Mac: --upgrade keeps what's installed, updates it to this version without fetching weights, and says the new minimum. Video keeps running there; the Voice and Music tabs now say they need 96 GB.
      • Unchanged: the 128 GB (MiniMax H3 Turbo, Ref2VA) and 192 GB (Upscale, Remove a person) tiers.

    Install or update

    • Update: git pull, then run --upgrade as usual and restart the app. Installed engines whose commit didn't change are kept.
    • Prebuilt parts: unchanged. The carrier image stays ghcr.io/drowzeys/keys-tensorfold-studio:4.2.1, and the Mac Bolt archive stays the v4.2.1 asset.

    Tested

    • CI on #177, #178 and this release.
    • #177 on a DGX Spark:
      • The full suite: 1,359 passed, 0 failed.
      • Simulated cards:
        • a display card plus a compute card, in either order;
        • two compute cards with and without STUDIO_GPU;
        • four cards, plus a refused fifth;
        • every shutdown left nothing behind.
      • RAM admission against real memory.
      • A real 30 s song rendered from the branch.
      • Not tested by us: two physical cards rendering at once. akol1 reports a two-card run.
    • #178 on Linux and a Mac: new installer tests fake a Mac at 32 to 128 GB, plus the Voice and Music refusals at 64 and 95 GB.

    🤖 Generated with Claude Code

    https://claude.ai/code/session_01PfjmufXm4L7qsVNFyRw9ZK

  4. v4.3.0Imagination Studio 4.3.02026-10-30 · 2026-10-30 05:33 UTC
    查看更新说明

    Imagination Studio 4.3.0 adds Apps, every tool of the Studio as a one-click app. Songs can now be cleared to the trash, and the Library's automatic captions no longer load a Bolt that can't see. The engines are the same as 4.2.1's.

    New

    • Apps (#176, Sam Wasserman): a new room at the top of the sidebar.
      • Nine kinds (Cinema, Characters, Camera, Effects, Styles, Sound, Finish, Filmmaker Suite and Studio), with a search box. A DGX Spark lists 61 apps.
      • Pre-filled forms: each app opens the Studio's own form with its model, LoRA or start already chosen. It adds no new engine or server route.
      • Nothing to set up first:
        • A LoRA that isn't installed yet opens Looks on that LoRA.
        • A Library action (Character Swap, Restyle, Fix, Extend, Remove a person, Upscale, Captions, Turnaround) first asks for a clip or picture from your newest takes.
        • An app this machine can't run says why on its card.
      • Character Swap · Openjutsu: the swap is named for what it is, Comfy Org's Openjutsu made inside the Studio, fully local. Search for Openjutsu or Genjutsu to find it.
      • Shortcuts and phones: every app is in ⌘K. On a phone, Apps sits in the More sheet.
      • Marks and art: YuE2's mark appears beside its name in Music and in Apps; it's recorded in THIRD-PARTY-MARKS.md. There's new key art for Captions, Titles, Restyle, Fix and Extend.

    Fixed

    • Songs can be cleared to the trash (#170, Sam Wasserman).
      • What goes with it: a cleared song takes its record, and for a YuE2 song its score folder, to the trash. Put back restores every file.
      • What stays: a song stays where it is while a film's soundtrack or a queued export or finish names it, or while it's still being made. The skipped list says why.
      • Before: a finished song could never be cleared.
      • Test fix: a test that counted other jobs' engine unloads no longer fails in some full runs.
    • Library captions don't load a Bolt with no vision (#175). A Mac's Metal Bolt reads text only. The automatic clip captions used to load it for every new clip, get no answer, and keep it from unloading. Now the captioner skips a Bolt without a vision tower, and the Studio's Bolt unloads on its usual idle timer.
      • If you turned off Settings → "Describe new clips automatically" on a Mac because of this, you can turn it back on.

    Install or update

    • Update: git pull, then reload the page; the 4.2.1 engines are unchanged.
      • On a DGX Spark or a Linux workstation, --upgrade is still safe to run: bash oneshot-setup-spark.sh --upgrade or oneshot-setup-rtx-6000.sh --upgrade. It keeps every installed engine whose commit didn't change.
      • Restart the app after either.
    • New install: clone the repo and run bash oneshot-setup.sh.
    • Prebuilt parts: unchanged. The carrier image stays ghcr.io/drowzeys/keys-tensorfold-studio:4.2.1, and the Mac Bolt archive stays the v4.2.1 asset.

    Tested

    • CI on each pull request and on main.
    • New tests/test_apps_page.py: rooms, kinds, LoRA use, install and unsupported cases, the take picker for Library actions, search and ⌘K.
    • New tests/test_clear.py cases for songs.
    • On a DGX Spark: 61 of 61 apps ready; LoRA apps open Create with the look on; Upscale lists recent clips; the phone layout at 375 px has no sideways scroll.

    🤖 Generated with Claude Code

    https://claude.ai/code/session_01PfjmufXm4L7qsVNFyRw9ZK

  5. v4.2.1Imagination Studio 4.2.12026-10-29 · 2026-10-29 02:54 UTC
    查看更新说明

    Imagination Studio 4.2.1 removes build-machine paths from the prebuilt engines. The engines' code and output are unchanged.

    What changed

    • Engines: the H3 engine (libtf_h3.so) and Drama 3's drama3-generate and libtensorfold_drama3.so for the DGX Spark carried build folders in their debug sections, unchanged since 3.3.0. So did the Mac's Bolt tensorfold-native in 4.2.0. All four are now stripped of debug information. Their code, data and CUDA kernels are byte for byte the same; only a few header bytes differ.
    • Carrier: ghcr.io/drowzeys/keys-tensorfold-studio:4.2.1 holds the stripped H3 and Drama 3. The Mac Bolt archive on this release is the stripped one.
    • Guard: scripts/build-carrier.sh now strips every engine it packs and refuses a payload that names the building machine's home folder or user. A new test checks this.

    Same output

    Old and new builds were run alternately (old, new, new, old) on the same machine and seeds:

    EngineTestResult
    H3 (DGX Spark)5 s at 864×480, FastH3 8 steps, seed 7video and audio byte-identical in all 4 runs; about 118 s both ways
    Drama 3 (DGX Spark)3 lines, seed 7WAVs byte-identical in all 4 runs
    Bolt (Mac)7 greedy prompts7 of 7 identical replies

    Update

    git pull, then --upgrade as usual, and restart the app. An installed engine is kept while its commit is unchanged. To take the stripped builds, remove only each engine's version marker before --upgrade: on a DGX Spark rm $PREFIX/tf-h3/commit $PREFIX/drama3/commit $PREFIX/drama3/BUILD, then run bash scripts/setup-voice.sh (or oneshot-setup-spark.sh --voice) for Drama 3. On a Mac, rm $PREFIX/bolt-metal/COMMIT. Don't delete the drama3 folder: it also holds the converted codec link, codec-v1.safetensors. If it was deleted, setup-voice.sh converts the codec again in a few seconds.

    🤖 Generated with Claude Code

    https://claude.ai/code/session_01PfjmufXm4L7qsVNFyRw9ZK

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    Imagination Studio by keys+Wasserman, powered by TensorFold

    A local film studio: plan a film, generate pictures, video, voices and music, then edit and export it. Use Windows (natively, no WSL), an Apple-silicon Mac, or a supported NVIDIA Linux machine. Available models and settings depend on the machine, installed components and runtime memory.

    Imagination Studio

    Start here: Windows · Mac · NVIDIA Linux · Using Studio · Documentation

    Windows

    Studio runs natively on Windows; there is no WSL version. The native GPU setup targets Windows 11 on Arm with an NVIDIA RTX Spark, with 128 GB configurations intended for the full feature set. Smaller machines can use features that fit their GPU/runtime memory requirements and pass local validation. Planning, imports, settings and media browsing do not require large model downloads.

    Run the Windows installer in an administrator PowerShell:

    Invoke-WebRequest https://raw.githubusercontent.com/drowzeys/Imagination-Studio-by-keys-Wasserman/main/oneshot-setup-rtx-spark-n1x.ps1 -OutFile "$env:TEMP\studio-setup.ps1"
    powershell -ExecutionPolicy Bypass -File "$env:TEMP\studio-setup.ps1"
    

    The installer clones Studio, sets up the selected components, and registers Desktop/Start shortcuts and a notification-area tray icon. Review the model licences, download sizes and runtime-fit plan before proceeding. It is a component/model installation, not just a download-free UI launcher.

    Open Imagination Studio from Desktop or Start, then use http://127.0.0.1:7870. The tray starts Studio and stops it after an idle, confirmed stop. Component selection, UI-only setup and tray details.

    Already have a local checkout? Register its tray and shortcuts without installing models:

    powershell -ExecutionPolicy Bypass -File scripts\setup-windows-desktop.ps1 -Backend native
    

    Add models from Settings → Models & weights: see download sizes, measured memory usage and setup commands. Below 128 GiB RAM, setup helps avoid huge downloads unlikely to run; an explicit flag lets you proceed anyway. See Windows setup for the details.

    Verify features in Machine → Feature checks. Checks are opt-in renders on this machine, not background startup tests. Each passed recipe enables its tested settings; groups run recipes sequentially and retain individual passes. Failed larger checks do not remove smaller passes.

    Models & weights (left) and Feature checks (right): installed categories, qualifications and observed memory usage

    Actual Windows UI: installation, successful checks and failed/unchecked recipes are shown separately.

    Installed physical RAMQualification gating and badges
    Below 128 GiB, or capacity unknownRequired; unverified recipes stay gated
    128 GiB or moreOff by default and optional; no qualification run is required just to use an installed feature

    At 128 GiB+, you can turn qualification on if wanted. Diagnostics and individual checks remain available either way. Prerequisites, supported settings, backend policy and live memory guards always apply. The threshold is a verification-policy default, not a guarantee that every model fits.

    GPU memory, Windows commit backing and available system RAM are separate limits; download size is not a RAM requirement. Adaptive setup currently uses known admission policies, not a complete predictive model for every recipe. For example, a 64 GB RTX Spark's GPU carve-out may not meet Voice's current requirement even though other image and sound recipes work. On a 128 GB RTX Spark the firmware gives the GPU about 98 GB and Windows about 30 GB; the models load straight into the GPU's share (how).

    Native setup, components and qualification · Measured Windows results and troubleshooting · RTX Spark hardware, memory pools and measurements

    Mac

    Use Apple silicon and macOS 26+; the fast native video path needs an M5-family chip. The installer requires 48 GB for pictures only, 96 GB for the standard video install, and 128 GB for Turbo/Ref2VA. Allow about 185 GB free disk for the standard setup; optional models need more. Requirements derive from measurements on an M5 Ultra; smaller Macs and M1–M4 video paths are not equivalent hardware measurements and may be much slower.

    brew install [email protected] uv ffmpeg
    git clone https://github.com/drowzeys/Imagination-Studio-by-keys-Wasserman.git
    cd Imagination-Studio-by-keys-Wasserman
    bash oneshot-setup.sh --app
    

    Open Wasserman Slate AI Studio in Applications. The app is a local launcher around this clone; rebuild it if you move the clone. Use --image-only for pictures without the video installation.

    Mac installation and hardware details · Install flags

    NVIDIA Linux

    DGX Spark: GB10, 128 GB unified memory, DGX OS and Docker for the prebuilt engines. Allow about 125 GB free disk for the core install, or about 400 GB with the optional models.

    git clone https://github.com/drowzeys/Imagination-Studio-by-keys-Wasserman.git
    cd Imagination-Studio-by-keys-Wasserman
    sudo apt install -y git ffmpeg
    bash oneshot-setup.sh
    bash scripts/app.sh
    

    The app opens at http://127.0.0.1:7870. Review the installer checklist; --all requests the optional models. Without Docker, building the CUDA engines requires the supported toolkit and compiler setup.

    For other GPUs, use the machine-specific instructions rather than assuming Spark's unified-memory budget:

    Linux setup, memory guard and upgrades

    Using Studio

    • Story & Production: import scripts, plan shots, maintain a film bible and build storyboards.
    • Image & Video: choose a model, make candidates, edit pictures and generate clips with sound.
    • Sound: Fish Audio Drama 3 voices, MiniMax-Music3/YuE2 songs, effects and Foley where supported.
    • Edit & Finish: organize takes, grade, mix, create motion graphics and export to an editor.
    • Machine & Settings: see runtime memory, model installation, qualifications and connected tools.

    On Windows, start with the on-page controls and their PowerShell setup commands. Mac/Linux shell recipes live in the command-line guide; they are not native Windows commands.

    Projects, renders and uploads are kept under ~/ImaginationStudio, or STUDIO_HOME. Native Windows environments and models normally live under %LOCALAPPDATA%\ImaginationStudio. Back up projects and media before changing installations; model files and Python environments are separate.

    Agents, renders and memory

    Every render and processing task runs through Imagination Studio: its page, its job API or its MCP tools (mcp/README.md), never the render scripts or a separate ComfyUI started beside it. Only the Studio's queue checks a job's measured memory peak, unloads its own idle modules (voice, songs, ComfyUI's cached models, the Bolt brain) to make room, waits and then refuses, naming them, when other programs hold the memory, and keeps a floor under the render. Agents (Claude Code, Codex, Hermes...) read STUDIO-AGENT.md: check GET /api/memory before starting a model server of their own, ask POST /api/memory/release for room, and never run a big model beside a render. Machine → The memory guard shows the same and has Release idle modules.

    The one-shot setups also install a per-user machine memory guard (scripts/memguard.py: systemd user unit, launchd agent or a Windows logon task) that has the Studio give memory back before the OOM killer or a hang, and cancels a render only as the last resort. It never stops your own programs unless you opt in (--memguard-stop-foreign, -MemoryGuardStopForeign on Windows). --no-memguard (-NoMemoryGuard) leaves it out; python3 scripts/memguard.py uninstall removes it. More

    Updates

    Save work and stop through the tray/app launcher before updating. In a clean Git clone, pull the branch you follow. Mac/Linux installs can then run bash oneshot-setup.sh --upgrade; restart afterward. Native Windows components use their PowerShell setup/verification scripts—do not run the Linux upgrade command there. The supported Mac/Linux launcher also offers in-app source updates; source updates and model/runtime installation are separate operations.

    The access key

    Studio binds to localhost by default; this computer does not need a browser access key. Other devices require the Studio access key. Use Settings → Access key for the QR code and remote-device sign-in. Never post keys, tokens or private addresses in issues, logs or screenshots.

    Phone/remote access

    Documentation

    GuideContents
    WindowsNative setup, components, qualification and tray
    Mac & Linux installationHardware, install flags, upgrades, memory guards and workers
    Moving an installReusing models and compiled Python packages, similar-machine copies and cross-platform limits
    User guideScreenshots, phone access, image/video tools, Slate and the Library
    Voice, music and brainsAudio backends, song engines, references and local brains
    Production workflowsBeat edits, Finish, motion graphics and Motion Previs
    LoRAsHub, licences, essential adapters and training
    Command-line recipesMac/Linux image, video and reference commands
    Engine notesRendering architecture, native engines and audio processing
    Performance evidenceDated measurements and picture-model comparisons
    Updating model measurementsChanged-only/forced qualification sweeps and shared JSON
    Release historyEarlier release notes, retained as historical context

    Tutorial · Licences and attribution · Brand guide

    Licence, credits and support

    Studio code is Apache-2.0: LICENSE, NOTICE, citation. Models and bundled tools retain their own licences. Qwen-Image-2.1 and MMAudio weights are non-commercial; MiniMax H3 has territory limits; Fish Audio hosted services need separate licensing. Check each model's terms before commercial use. Weights are not redistributed by this repository.

    Keys (drowzeys) built Studio and its engine integrations with Sam Wasserman and Wasserman Productions, who shaped the filmmaking workflow and Wasserman's Filmmaker Suite. Powered by TensorFold; built with Qwen, Fish Audio and MiniMax-Music3, with contributions from the makers of all the models and tools. Retain the required attribution in forks and redistributions.

    Full credits and notices: CREDITS.md, THIRD_PARTY_NOTICES.md, and licensing details. Named at the request of the TensorFold project: this is an app built on TensorFold, not a TensorFold product.

    Use GitHub Issues for bugs/install trouble and Discussions for questions and ideas. Report vulnerabilities privately through GitHub: SECURITY.md.