UltimaScraper

UltimaHoarderAGPL-3.0活跃维护

用 TypeScript 编写的数据抓取工具,目前主要面向成人内容平台,能定期抓取并归档 OnlyFans 等站点的媒体数据。

Datascraper that is currently adult focused - Updated regularly

v7.4.1发布于 2021-07-20 12:29 UTC4,297star +4 / 7 天611fork同步于 2026-11-10 05:37 UTC

怎么上手

从 README 代码块原样提取,可能是其中一种安装方式
git clone https://github.com/UltimaHoarder/UltimaScraper.git
docker compose up -d
硬件要求按 README 关键词推断
有 Docker 镜像
下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

这个项目的说明还在生成中,先参考下面「最近发版」和 README。

最近发版

5 个版本v7.4.1
  1. v7.4.1OnlyFans DataScraper v7.4.1最新正式版2021-07-20 · 2021-07-20 12:29 UTC
  2. v7.4OnlyFans DataScraper v7.42021-06-19 · 2021-06-19 08:43 UTC
    查看更新说明

    Added updater script | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/5db4e167bf8fa89628bacade56ee421b644b7850 Fixed a bunch of things | https://github.com/DIGITALCRIMINAL/OnlyFans/compare/v7.3...master

    Authentication process has been changed. You just have to copy the cookie and user-agent values. No more doing it one by one.

    You'll probably need to upgrade your requirements. The new command to upgrade requirements is in the readme.

  3. v7.3OnlyFans DataScraper v7.32021-06-13 · 2021-06-13 03:48 UTC
    查看更新说明

    Fixed archived content | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/5f865962dfa3d87af69602287757cad2e4ec0d71 Fixed scraping paid content | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/d2732859d24931f34cf833e6ef6fc73b7a3cd1b1 Fixed multiple infinite loops | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/afe026969f11aa7dd5fdaabb261f39c5baa99d29 | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/cd72afd08159d421765f8d23678c08f54b0faf43 Fixed script not downloading profile headers | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/040af16fd75bc9da8d7ce3df5a19436adb66f6ae Fixed custom filenames not being downloaded (OFRenamer Fix) | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/d5adabcd5c05f0e23cef104e8301a0ae03e675b6 Fixed script not setting correct creation date on files | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/599138bbb0bcef2beb6aaa352ca3739936cf465d

    Script now uses asyncio | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/f49a5d6e9a9633148736db3e19f037d26a829a49 Script is now much faster for creators scraping their own profile | https://github.com/DIGITALCRIMINAL/OnlyFans/commit/660ec5cb881848848f9051f2284414d47d9ac72e

    I fixed a bunch of other stuff | https://github.com/DIGITALCRIMINAL/OnlyFans/compare/v7.2...master

    Known Issues: Some OLD json metadata files are broken


    I'm sure you're tired of downloading the latest commit every time the script breaks. I'll be adding a "upgrader script" soon, which will upgrade to the latest commit.

    Update script is now implemented, download from master if you want to use it.

  4. v7.2OnlyFans DataScraper v7.22021-05-16 · 2021-05-16 23:13 UTC
    查看更新说明

    Reinstall the requirements

    Not Working:

    Download this version instead https://github.com/DIGITALCRIMINAL/OnlyFans/archive/f49a5d6e9a9633148736db3e19f037d26a829a49.zip

  5. v7.1OnlyFans DataScraper v7.12021-05-05 · 2021-05-05 21:10 UTC
    查看更新说明

    Script will now automatically fetch header rules on every api request, so there's no need for you to keep coming back to download every new commit once you get session locked.

    This doesn't mean you won't get session locked. When OF updates their algorithm we have to figure it out and create the rules manually (soon to be automatically) and once we do, the script will continue to work without you having to download a new commit.

    No more download fatigue.

    Release no longer works, use the latest commit.

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    UltimaScraper

    Your creator archive, on autopilot. UltimaScraper saves the posts, messages, stories and media from the creators you follow on OnlyFans, Fansly and LoyalFans, and gives you a beautiful dashboard to run it all from your browser.

    The UltimaScraper dashboard

    Screenshots use made-up demo data.

    ✨ Features

    • 🖥️ Everything in your browser. Queue jobs, browse your library and manage accounts from one dashboard. No command line needed.
    • 📥 Grab it all. Timeline and archived posts, stories and highlights, messages with their attachments, and recorded streams.
    • ⚡ Fast and parallel. Workers download many creators at once, and new work slots in the moment a download finishes.
    • 🔁 Pick up where you left off. Failed items retry with one click, and a crashed worker's tasks go straight back in the queue.
    • 🖼️ A library you'll actually use. Search captions and messages, filter by creator, type or date, and preview photos, videos and audio right in the page.
    • 📊 See your archive grow. Charts of new accounts, posting activity and busiest hours, days and months, per site.
    • 📡 Live dashboard. Watch jobs, workers, throughput and disk space update in real time.
    • 🧙 Guided setup. A wizard installs everything on this machine, or on another one over SSH, and checks it as it goes.
    • 🌐 Grow to many machines. Add more servers and workers whenever you like, run them as one cluster, and invite other dashboards to share it.
    • 💾 Storage aware. Spread your archive over several drives, with warnings before one fills up.
    • 🔔 Webhooks and plugins. Get notified when things happen, and extend UltimaScraper with plugins.
    • 🔐 Private by design. It runs on your own hardware, protects the dashboard with a password, and keeps saved logins encrypted.

    🚀 Quick start

    You need Docker with Compose.

    git clone https://github.com/UltimaHoarder/UltimaScraper.git
    cd UltimaScraper
    cp .env.example .env
    

    Open .env and set POSTGRES_PASSWORD and REDIS_PASSWORD to long random values (openssl rand -hex 24 makes a good one). Then start it:

    docker compose up -d
    

    🎉 Open http://localhost:21120, choose a password, and the setup wizard takes it from there. If you open it from another device, enter the setup code that docker compose logs webui prints.

    [!IMPORTANT] UltimaScraper creates an encryption key on first start. Back it up: your saved logins can't be read without it. The Docker guide shows where it lives.

    📚 Learn more

    The full documentation is at ultimahoarder.github.io/UltimaScraper.

    ⚖️ Use responsibly

    Only archive content you have legitimate access to, and respect creators and each site's terms. You are responsible for how you use UltimaScraper.

    ☕ Support

    If you find UltimaScraper helpful, consider supporting the project:

    🌐 Need proxies? UltimaScraper can spread its work over proxies from the Network page. Sign up for Webshare through our affiliate link and you'll get 10 free proxies to see how much they help. It supports the project at no extra cost to you.

    What I use: I've personally scraped 500 million public OnlyFans profiles in two to three months with UltimaScraper's Mass Profile Scraper (Tools → Mass Profile Scraper) and this Webshare setup, for around $30:

    • Proxy server: Shared
    • 250 proxies
    • 5,000 GB bandwidth
    • High concurrency

    📄 License

    UltimaScraper is free software, released under the GNU Affero General Public License v3.0 or later. If you run a modified version as a service for others, you must offer them its source code. Found a security issue? See SECURITY.md.