Releases: AAndyProgram/SCrawler
2024.6.4.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Happy LGBT Pride Month! π π³οΈβπ π
Join our Discord server: https://discord.gg/uFNUXvFFmg
If you were using the yt-dlp-TTUser
plugin, you should remove it because this plugin was added to yt-dlp itself! Read more here.
- Added
- Added highlighting of scheduler plans (working, stopped, pending, etc.)
- YouTube (standalone app): add option to add the video upload date before/after the file name (
Settings
-Defaults
-Add date to file name
) - Twitter:
Communities
downloading - Feed: ability to select one of the download sessions and set it as the current session
- Minor improvements
- Updated
- yt-dlp up to version 2024.05.27
- gallery-dl up to version 1.27.0
- Fixed
- Twitter: deleting user directory when redownloading missing posts
- Minor bugs
Complete code changes: 2024.5.19.0...2024.6.4.0
2024.5.19.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- YouTube (standalone app): add upload date to description (request #192) (
Settings
-Info
-Create description files: add upload date
,Create description files: create without description
).
- YouTube (standalone app): add upload date to description (request #192) (
- Fixed
- YouTube (SCrawler): advanced settings are not saved when changed
2024.5.18.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- YouTube (standalone app): highlight frame rates higher/lower than this value (
Settings
-Defaults Video
-Highlight FPS (higher/lower)
). - Sites
- Instagram: 'DownDetector' support to determine if the site is accessible
- Reddit: change the naming method of video files (hosted on Reddit) to the
YYYYMMDD_HHMMSS
pattern - Twitter
Likes
downloading (user settings)- changed domain from twitter.com to x.com
- Site settings: group options by category
- Minor improvements
- YouTube (standalone app): highlight frame rates higher/lower than this value (
- PluginProvider
PropertyOption
attribute: set category name whenIsAuth = True
ISiteSettings
: addedUserAgentDefault
property
- Updated
- gallery-dl up to version 1.27.0-dev
- Fixed
- Sites
- Instagram: incorrect definition of pinned posts
- Threads: new posts are no longer downloaded from profiles with pinned posts
- Reddit: bypass error 429 for saved posts
- Twitter: data is not downloading due to domain change from twitter.com to x.com
- Minor bugs
- Sites
2024.5.4.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- YouTube (standalone app): setting to remove specific characters (
Defaults
-Remove characters
) - Instagram: simplify the
Connection closed
error - Users search: add 'FriendlyName' to search results
- YouTube (standalone app): setting to remove specific characters (
- Fixed
- YouTube (standalone app): incorrect download processing when the file name ends with a dot (Issue #188)
- The program is freezes when editing users in some cases
- Sites
- Reddit: token update error
- Threads: unable to obtain credentials (ID)
2024.4.26.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Site settings: the values that can be extracted from cookies immediately populate fields
- Feed: ability to load the last session of the current day (if it exists) as the current session after restarting SCrawler
- Users search: include friendly name matches in search result
- Updated
- gallery-dl up to version 1.26.9
- Fixed
- xHamster: saved posts aren't downloading
2024.4.14.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Fixed
- Facebook: can't get tokens
2024.4.13.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Minor improvements
- PluginProvider
- IPluginContentProvider: added
ResetHistoryData
function
- IPluginContentProvider: added
- Fixed
- Sites
- TikTok: remove last download date when erasing history data
- YouTube: remove last download date when erasing history data
- Instagram: saved posts aren't downloading
- Sites
2024.4.10.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
For those of you who use TikTok, it is highly recommended to update TikTok plugin (using these instructions) to the latest version!
ATTENTION! This version includes changes to downloading groups (including the scheduler) and the settings file. Once you start using it, you won't be able to downgrade. I recommend making a backup of your SCrawler settings folder. It is also recommended to check all of your download groups settings and scheduler plans settings.
- Added
- Sites
- TikTok: more settings for standalone downloader
- Instagram:
- automatically reset download options after updating credentials
- ability to extract an image (if it exists) from a video that contains a static image
- updated reels downloading function
- GraphQL support
- request timers (per request)
- OnlyFans:
- download stories
- option to disable timeline downloading
- Reddit: added
Check image
setting (unchecked by default) to make Reddit downloading faster
- YouTube (standalone app):
- the ability to add downloaded item(s) to a playlist
- the ability to create a playlist from downloaded music
- calculation and display of the actual size of downloaded files
- the ability to change audio bitrate (you can also set the default bitrate in
Defaults Audio
-Bitrate
) - embed thumbnail in the extracted audio (
mp3
only) as cover art (Settings:Defaults Audio
-Embed thumbnail (extracted files)
) - Exclude
drc
(dynamic range compression) from parsing results
- Standalone downloader:
- allow thumbnail to be saved with file
- calculation and display of the actual size of downloaded files
- Feed:
- add hotkeys:
Home
,End
,Up
,Page Up
,Down
,Page Down
- ability to save/load views
- add hotkeys:
- Scheduler:
All
andDefault
options removed. OnlyDisabled
,Specified
andGroups
are available. - Download groups: filter users who have been (not)downloaded in the last
x
days (download groups, advanced filter (main window), scheduler). - Main window:
- ability to save/load views (
View
-Save/Load view
) - all filter options from the
View
menu have now been moved toFilter
- ability to save/load views (
- Settings:
- ability to confirm mass download using the
F6
key (to protect against accidental pressing) (Settings
-Behavior
) - the ability to find the program environment
- default headers (
Settings
-Headers
)
- ability to confirm mass download using the
- Added the ability to display group users (works in scheduler, scheduler plans, download groups)
- Added exclusion of last 3 days from deleting session files
- Other improvements
- Sites
- Updated
- yt-dlp up to version 2024.04.09
- PluginProvider
- Add
PropertyValueEventArgs
class - PropertyValue:
- add
Checked
parameter - add
OnCheckboxCheckedChange
handler
- add
- ISiteSettings:
- add
CMDEncoding
,EnvironmentPrograms
properties - add
EnvironmentProgramsUpdated
function
- add
- Add
- Fixed
- Sites
- PornHub: some videos won't download
- xHamster:
- some videos are missing when downloading creators
- user videos aren't downloading
- JustForFans: fixed video downloading
- TikTok (standalone downloader): files with long names aren't downloaded
- Users: incorrect decision to set last update date, which resulted in an incorrect last download date for some users
- Feed: a scrolling bug where the feed scrolls up after returning to it
- Minor bugs
- Sites
Complete code changes: 2024.2.25.0...2024.4.10.0
2024.2.25.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- A
Feed
button has been added to notifications - Feed:
- ability to merge multiple special feeds into one
- ability to select all/none media
- ability to add to a special feed(s) with removal from the current one
- the name of the loaded feed is now displayed in the form title
Refresh
button now refreshes the loaded feed- ability to move/copy media
- Scheduler: the ability to move tasks (higher, lower) (just a view attribute, doesn't affect the scheduler)
- YouTube (standalone app): add
Open file
to the context menu - YouTube (standalone app): the ability to edit each playlist item
- YouTube (standalone app): embed thumbnail in the audio/video as cover art (Settings:
Defaults Audio
-Embed thumbnail
;Defaults Video
-Embed thumbnail (video)
) - Instagram: the
csrftoken
can now be automatically extracted from cookies - Instagram: remove
x-ig-www-claim
from settings - Threads: the
csrftoken
can now be automatically extracted from cookies - Threads: simplify 500 error when updating tokens
- Facebook: simplify token update errors
- OnlyFans: handle 500 error
- Plugins: added
ReplaceInternalPluginAttribute
attribute - Other improvements
- A
- Fixed
- Main window: incorrect sorting of profiles and collections
- Standalone downloader: url array form doesn't show scrollbars
- Feed: image rendering bug
- YouTube (standalone app): audio codec does not change when changing audio/video in the video options form
- Instagram: error downloading single post
- TikTok: files with long names aren't downloaded
- Minor bugs
Complete code changes: 2024.1.26.0...2024.2.25.0
2024.1.26.0
π³οΈβπ β€οΈ If you like SCrawler, please like the program on this site. β€οΈ π³οΈβπ
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- YouTube (standalone app): the ability to reduce video FPS
- TikTok: the ability to use a regex to clean the title
- YouTube (SCrawler): the ability to ignore community errors
- Fixed
- Instagram: stories (user) downloading with the wrong aspect ratio for some users
- Minor bugs