YoutubeDL-Material

Hi all! Got a bigger update than I originally intended, but I doubt anyone will complain :)

Before I get to what's new, one thing I want to mention is Node.js v16 is now required for those not using Docker. So many people helped make this update possible, between translations, pull requests, feature suggestions, and bug reports. I really do appreciate the support.

Features

• Notifications (#440)
  • Supports third party services
    • Discord
    • Telegram
    • Slack
    • ntfy
    • Gotify
    • You can also use a generic webhook URL to connect with Zapier-like services
• Download archive now (mostly) handled in DB rather than text files (#809)
  • Should prevent file lock errors from occurring. New archive viewer is now available with ability to import/export archives
  • Even with youtube-dl archive setting disabled, subscription videos can be permanently deleted
• UI refresh
• Added ability to favorite/unfavorite videos
• Added RSS feed for downloads (#388)
• Added task to delete old files (#358)

Minor improvements

• Removed allow_autoplay setting and replaced it with force_autoplay (#695)
• Updated to Angular 15
• Node.js v16 is now required
• Expected file size now visible from UI in the quality select menu (#838)
• Added settings for tasks
• For non-YT videos, available resolutions will now be shown rather than presenting maximum desired values

Bug fixes

• Fixed broken Twitch VOD chat downloads (#859)
• Fixed an issue where subscriptions would only show 10 downloads (#715)
• Fixed an issue where encrypted streams could not be decoded (#819)
• Fixed an issue where download progress was not displayed (#774)
• Fixed an issue related to duplicate subscription names (#801)
• Fixed an issue preventing custom args with values from being used (#745)
• Switched default mongo version to v4 due to AVX incompatibility issues (#733)
• Fixed an issue where videos would still download for a subscription after unsubscribing (#689)
• Fixed an issue where task scheduling wasn't considering the container time-zone (#810)
• Fixed an issue where role/user permissions could not be changed
• Fixed an issue where the simulated output in Advanced download mode would only appear once changes were made to args

One thing I've had in the works is trying to get an electron app (desktop version) functional. I'm ~95% of the way there, but the last bit will be tough. I'll keep everyone posted on that here: https://github.com/Tzahi12345/YoutubeDL-Material/discussions/409

Hi everyone! It's been about a year and a half since the last update, so we've been due for one to say the least. If you're on the nightly tag, most of these you'll have already seen. If not, then you're in for a lot of improvements!

Features

• MongoDB support!
  • MongoDB is now preferred over the default, local DB. It's much quicker and at scales, leads to a much smoother experience
  • You can transfer your local DB to MongoDB using the Database tab in the settings menu
  • No more corrupt DBs! Regardless, please back up your DB regularly
• New download manager
  • Downloads can now be tracked and managed through a new interface. Downloads can be paused, restarted, and errors can be viewed.
  • Subscriptions now use the new download manager, preventing subs from getting locked up checking for new downloads and streamlining the download process
• New tasks & maintenance page
  • Added ability to run or schedule specific tasks
    • Backup/Restore DB
      • MongoDB backups can be done through MongoDB, we simply store it into a JSON file locally
    • Check for DB records with missing files
    • Import missing DB records
    • Fix duplicate files in DB
    • Update youtube-dl (or whatever repo you use)
• Concurrent streams
  • You can now watch your videos simultaneously with friends! Click here for a demo.
• File metadata can now be modified from the UI
  • Just click the info button on files and you'll see a new edit button on the top right of the dialog!
• Much faster downloads with yt-dlp as the new default downloader!

Minor improvements

UI

• Dedicated settings page
  • Settings dialog has been converted into a page for ease-of-use
  • Added option to rate-limit downloads
• Added pagination to files on the home screen
• Home screen files can now be filtered by type (audio or video)
• Version and commit info can now be viewed from the About dialog
• Updated subscription pages to use the new file cards (icons) from the home page
• Hovering over a file card will now show a preview of that video
• Fonts and bootstrap are now hosted locally (Thanks @firstdorsal for the PR!)
• Added ability to crop files prior to downloading
• New translations. We now support:
  • English
  • Spanish
  • Chinese
  • Dutch
  • French
  • German
  • Italian
  • Czech
  • Norwegian
  • Finnish
  • Korean
  • Macedonian
  • Portuguese
  • Russian
  • Telugu
  • Indonesian
  • Some of these are only partial translations. If you'd like to help out click here!. Special thanks to everyone who's helped out so far!

Backend

• Added args overriding support
  • E.g. global custom args will override default args, per-subscription args will override all other args
• File sharing should work a lot more reliably
• Improved arg simulation (it now occurs on the backend)

Dependencies/Integrations

• Added Kodi .nfo file generation support
• Helm chart added (Thanks @benashby for the PR!)
• Heroku deployments now use Docker
• Angular updated to v13
• PM2 is now used instead of nodemon to enable server restarts
• Updated Twitch VOD chat downloading to use new Twitch API
  • Twitch-Chat-Downloader is now required, and a client secret must be set along with a client ID
  • Benefit is chat downloads are much faster!
• SponsorBlock integration! Enable it in the settings and all supported videos will show a "skip ad" button where appropriate

Behind-the-scenes

• API docs now automated
• Much improved wiki (Thanks to @GlassedSilver for the support!)
• Tons of new automation using GitHub Actions
• Added unit tests (coverage will be a long-term WIP)

Bug fixes

• Way too many to name! Sorry if this section excites you,

Merry Christmas! We got a huge update incoming, with major feature additions, optimizations, and a ton of bug fixes. The community has been integral in helping track these down, so if I forgot to give a shoutout, this is my way of thanking you all. Between the PRs, the suggestions, and the bug fixes, the support from you guys has been incredible.

NOTE: This update has breaking changes so if you'd like to revert, you can rename the backed up database files in the appdata folder to their original name and get back to the old setup.

Features

• Homepage redesign
  • The home page has been redesigned with new file "cards", you can customize their size in the "about" dialog
  • "My videos" shows both subscription and regular downloads in one (paged) list, which can now be filtered and ordered to your choosing
    • Paging the files means much better performance for users with a high number of videos
    • Video duration and download date is shown
  • "Custom playlists" replaces the old playlist section
• Subscriptions
  • Added ability to edit subscriptions
    • Added ability to "pause" a subscription, set a maximum quality, and custom file output
  • Added ability to redownload "fresh" downloads (thanks @GlassedSilver for suggesting this!)
    • TL;DR is that newly uploaded videos will get redownloaded on the next day to avoid the issue where a video is downloaded before a higher quality version is processed
  • You can now add subscriptions with the same URL (caveat: the name has to be different)
  • You can directly access subscriptions from the hamburger menu
  • Added a loading bar to the subscription view when a subscription is checking/downloading videos
• Video player improvements
  • Video description is now included if available
  • Updated save and share icons styling and location so that it doesn't hide important content anymore
• Categories (thanks @GlassedSilver for this feature request!)
  • You can now create rule-based "categories" in the settings menu where videos can be organized and searched based on the given category
  • Automatic (uneditable) playlists are created from categories
• Twitch chat support (thanks @GlassedSilver for this great suggestion!)
  • You can now download and view Twitch chats in the video player. You can add a Twitch API key in the settings menu and on Twitch VODs a "chat" icon will pop up in the player
  • These can be automatically downloaded as well

Minor improvements

• Downloading
  • Max quality will always download the max quality (instead of the best mp4)
  • Progress bar is now visible for all videos
  • Downloading in general is a lot more stable, and you can now choose to download with either youtube-dl or youtube-dlc
  • Thumbnails are now downloaded automatically
  • You can opt not to download the JSON metadata as well, though it's recommended you keep it as in future updates we may draw more information from it
  • Added a "Kill all downloads" button in the settings
• Backend
  • Simplified database structure to allow for less code reuse (this is a breaking change)
  • Files that have been downloaded but not registered in the database will now be automatically added on startup
  • Bcrypt.js is now used to avoid security vulnerabilities with bcrypt
  • Improved performance by using async functions in key areas (thanks @NotWoods for doing this!)
• Docker
  • ARM builds now use the normal Docker tags and autobuild without issue (it is now done through GitHub rather than Dockerhub, thanks @diveflo for implementing this!)
• Misc
  • Added ability to login using LDAP
  • Added French, Chinese, and Norweigan support
  • Use encryption option is now deprecated, if you would like to use encryption please use a reverse-proxy (instructions here)
  • Tab title in browser now matches the top title set in the settings
  • Ctrl-clicking files opens them in a new tab, right clicking files lets you simply open it or open it in a

New update inbound! This one is focused on bug fixes and accessibility improvements. Subscriptions got its third iterative update as well, so we hope you enjoy those features as well. Since the last update, our Docker pulls have grown almost 600%, we're almost at 1 million now! Thank you everyone for your support, suggestions, bug fixes, and PR's. It's been amazing!

New features

• Subscriptions v3!
  • You can now use custom args and file outputs for subscriptions
  • Added ability to make subscription audio-only - thanks @Code-Slave for this suggestion!
  • Subscription videos are now stored in the DB, meaning the list of videos should load quicker and additional features like subscription video sharing can be added in the future
• You can now input and use your YouTube cookies in YoutubeDL-Material using the new cookies uploader in the settings
  • This allows you to download private videos and playlists
  • It may prevent 429 errors from occuring for some users
• New playlist modification dialog
  • Change the playlist name, the videos in the playlist, and their order. Thanks @bodzio4749 for inspiring this!
• Docker build now runs as non-root by default, adding an extra layer of security
  • Grateful to @SuperSandro2000 and @Wonderfall for getting this implemented, thank you both!
• Support for the German language
  • You can now select Deutsch in addition to English and Spanish in the language select in the settings
  • Thanks to @UnlimitedCookies, @SuperSandro2000, and @GlassedSilver for their organized efforts!

Minor additions

• Added Safe download override checkbox in the settings which will force the backend to use the safer downloading option
  • If you enable this override, you will lose the ability to see download progress
• Added ability to clear all downloads from a session in the downloads manager
• The ID for videos in the file manager will now by default use the youtube ID, rather than the file name - thanks @CountParadox for suggesting this!
• Pressing enter in the URL input will now trigger a download
• If you delete a video that was downloaded with a thumbnail, the thumbnail will autodelete as well - Thanks @GlassedSilver for recommending this!

Bug fixes

• Fixed bug that prevented sharing videos with non-users if multi-user mode was enabled
• Fixed bug that caused the server to crash when attempting to update youtube-dl
• Fixed bug where updating a user's password would update the admin's password instead - thanks @UnlimitedCookies for finding this one!
• @web-connect fixed a typo in the logger section of the settings, thank you!
• Fixed several bugs preventing non-YT videos from download - thanks @CountParadox for submitting bug reports on this front!

That's all for this update (hope I didn't miss anything). In the next update, we'll hopefully see a redesign of the home screen with a unified view of subscription and non-subscription downloads, focusing on providing a much stronger user experience. If you'd like to read more or provide input, you can see the issue here. Cheers!