2.1.3

As you've probably noticed, the Javlibrary scraper is now throwing errors during scraping. Unfortunately Javlibrary has re-enabled their Cloudflare IAUM, and the Cloudscraper python library no longer supports solving these challenges, so using this scraper now requires some manual input.

Some documentation has been added in the README on how to manually specify your cookie and useragent when scraping with Javlibrary. To use Javlibrary without having to manually specify cookies, you can use a mirror in the javlibrary.baseurl setting as explained here. Though, as I don't know who is hosting the mirror, it's possible that they will enable cloudflare protection on that site in the future as they notice increased traffic hitting their site.

The two cookies you need to pull from javlibrary are:

• __cfduid
• cf_clearance

Your browser useragent can be found by googling: What is my useragent.

Added

• Function Get-CfSession to create a websession object to access the Javlibrary scraper
• Settings javlibrary.browser.useragent, javlibrary.cookie.cfduid, and javlibrary.cookie.cfclearance to persist Javlibrary websession

Changed

• Javinizer out-of-box-experience (OOBE) updated to remove Javlibrary as a default scraper due to Cloudflare IAUM protection
  • Javbus is now enabled as a default scraper

Fixed

• Sort now properly fails when there are missing required metadata fields when using -Url
• Javbus scraper now properly finds uncensored videos when similar search results are found in the censored section
• Maxtitlelength behavior for Japanese titles now do not cut off at the last whitespace character

See More

• 3c48a08 Merge pull request #132 from jvlflame/dev
• f7de215 Update for 2.1.3
• 843fd6a Set javlibrary validation webrequests to null
• 1829215 Fix Javbus url scraper for uncensored (#131)
• b5720a9 Change maxtitlelength behavior for Japanese/AlternateTitle (#128)
• 6ea64d6 Update validation flow redundancy (#127)
• 55a3311 Fix conditionals for cfsession (#127)
• 093a70a Move sleep to create session block
• 3052c6f Replace javlibrary with javbus for better OOBE (#127)
• cc53fdb Better persist javlibrary session (#127)
• df96641 Allow manual cookie/usersession for Javlibrary (#127)

This list of changes was auto generated.

2.1.2

Added

• Setting sort.format.groupactress to convert the <ACTORS> format string. If enabled:
  • Multiple actresses => @Group
  • Unknown actress => @Unknown
• -Strict parameter is now available during -Find usage for R18 scraper only (#125)
  • R18 scraper does automatic conversion from ContentID => Id which failed for certain movie IDs ( MBR-AA063)

Fixed

• Aliases for actresses with a single-word name are now properly replaced by the thumb csv
• Tags and tagline fields in the nfo now correctly replace invalid xml characters (#124)
  • Sort no longer fails when trying to download actress images
• R18 title metadata is now properly uncensored

See More

* cfb080b Merge pull request #126 from jvlflame/dev * cb42556 Update for 2.1.2 * fc0c11d Remove strict from dmm url search (#125) * c805095 Add strict param to -Find for r18/dmm (#125) * 2649282 Add feature to group format string actors * 2b5309e Fix R18 scraper title not replacing censored words * 1721a29 Fix aliases with single name * 82802bd Fix invalid nfo characters in tag and tagline (#124)

This list of changes was auto generated.

2.1.1

Added

• Setting sort.format.outputfolder to create a static or dynamic output folder for sorted movies in the destination path (#115)
  • This setting accepts a format string (i.e. "sort.format.outputfolder": "<STUDIO>" will sort movies into a folder of their studio name in the destination path)
• Setting sort.metadata.nfo.altnamerole to add the actress <altname> as the actress role (#110)
• Setting javlibrary.cookie.session and javlibrary.cookie.userid to set a path of movies as 'Owned' on JavLibrary. This runs on a single thread and is not affected by throttlelimit (#119)
  • Log into JavLibrary and view browser cookies [www.javlibrary.com / Cookies / session] and [www.javlibrary.com / Cookies / userid] and define them in your settings
  • Usage: Javinizer -Path 'C:\JAV\Sorted' -Recurse -SetOwned
• Setting sort.metadata.nfo.originalpath to add the path the movie was last sorted from to the nfo file under field <originalpath> (#116)

Changed

• <altname> in the actress metadata in the nfo is now dynamic based on the selected actress name language (#110)

Fixed

• Sort no longer fails when newlines are present in R18 maker and label metadata output (#121)

See More

• dce60dc Merge pull request #123 from jvlflame/dev
• c3ee6e4 Update for 2.1.1
• eb9441e Add feature to use altname as actor role (#110)
• 3c5186f Add custom output folder (#115)
• b7495cb Re-add feature to set owned movies on Javlibrary (#119)
• c51d469 Fix newlines added to r18 scraper output (#121)
• 9032a27 Merge branch 'dev' of https://github.com/jvlflame/JAV-Organizer into dev
• 4e02b01 Feature/116 (#117) [ #116 ]
• 0414e2c Update README.md

This list of changes was auto generated.

2.1.0

Added

• EXPERIMENTAL Dl.getchu scraper (#51)
  • This is scraper is only available via the -Url parameter when sorting a single file or using -Find to search the Url
• Setting sort.metadata.nfo.mediainfo added to allow user to add video/audio metadata to nfo (#94)
  • CLI version of MediaInfo required for use. MediaInfo will need to be added to your system PATH
  • <RESOLUTION> added to format string
• Setting sort.metadata.nfo.unknownactress to allow Unknown actress to be written to nfo file when no actresses are scraped (#105)
• Setting sort.metadata.nfo.format.tagline to allow user to set a tagline which accepts file format strings (#106)
• Setting sort.metadata.priority.contentid to set the priority of the ContentId displayed by aggregated data object (#112)
  • <CONTENTID> added to format string
• Setting scraper.option.idpreference to set the preferred Id output. Acceptable values are id and contentid

Changed

• Default file matcher updated to better match multipart videos and support DMM ContentId (#111)
• Setting sort.metadata.nfo.seriesastag is now sort.metadata.nfo.format.tag (#106)
  • This setting is now an array, which allows multiple file format strings to be created as separate tags
• Javinizer now performs a retry on the Javlibrary URL scraper and continues to run despite webrequest errors (#109)
• AggregatedData object now contains ContentId

Fixed

• Get-DmmUrl now correctly assigns the URLs when searching for a movie with ID with a letter suffix (#107)
• Manually sorting with a DmmJa URL now functions properly (#111)
• Nfo file now correctly renames to the movie name when sort.renamefile is set to false, and sort.create.nfoperfile is true (#102)
• <ACTORS> file rename format now properly falls back to the alternate language when the primary is missing (#103)
• R18 scraper now properly assigns the genre and label fields for Amateur videos (#108)
• Extra html on the Description field for the DMM scraper is now removed

See More

• 4291255 Merge pull request #114 from jvlflame/dev
• 0e3337b Update for 2.1.0
• b5755f0 Update thumb csv 9-29
• bf6ecb9 Update debug messages for dlgetchu (#51)
• 9e0de6d Fix release date for dlgetchu (#51)
• bef6f68 Add support for dlgetchu in main scraper functions (#51)
• 79bef59 Merge pull request #112 from seeyabye/feature/dmm-id
• df942c9 Merge branch 'dev' into feature/dmm-id
• 51a3dc7 Modified Id Preference setting
• e33b972 Add a default retry to Javlibrary URL requests (#109)
• 7cc646d Add MediaInfo (#94)
• 9e2d7e5 Added ContentId tag to aggregateData
• 7d90fbb Fixed bug for dmm-ja not extracting maker and label
• 7b22c44 Fixed regex for ID with suffix
• 6fa2ccb Convert DMM's ContentID to standard ID
• 252c55a Merge branch 'dev' of https://github.com/jvlflame/JAV-Organizer into dev
• d90438f Add updated VSCode settings
• b791e31 Merge pull request #111 from seeyabye/fix/dmmja-url
• 4014a0d Fixed poster grabbing for DMM's amateur site
• f8473e6 Fixed a bug when Url is specified on rename for DmmJa
• 480e5ab Merge pull request #101 from seeyabye/fix/update-parts
• b047f6c Moved file loop to a function
• 36672b3 Added additional tests
• 97d744b Regressed part support to A-D only
• 51c5d56 Added more use cases
• 8e87fa8 Fixed an update bug for multipart files
• b3e2c88 Set Javinizer to continue on scraper error (#109)
• a6487fa Fix error messages when failing to opening external files
• 4d6d28b Remove deprecated javlibrary session debug output
• 656a968 Clean up extra html on dmm description
• 5803861 Fix amateur r18 videos and uncensor functionality (#108)
• ddd996e Remove extra html elements from dmm description
• 271f285 Add initial dlgetchu scraper functions (#51)
• bca5e24 Fix error when tagline setting is empty (#106)
• abead29 Add tag and tagline to aggregated dataobject (#106)
• baa59b1 Fix variable name for unknownactress
• e8d8154 Change unknown actress setting name (#105)
• b15ec37 Add setting to insert unknown actress to aggregated data object (#105)
• 144ed29 Add fallback for actor name if selected language is blank in displayname (#103)
• 33e1999 Fix nfo name when sort.renamefile is false (#102)
• f9eaa38 Fix dmm URL on id with suffix of z and e (#107)
• 9b3a6a1 Update coverage threshold to 0

This list of changes was auto generated.

2.0.2

Fixed

• Dmm/DmmJa scraper
  • Aliases are now removed from the Japanese actress name
  • TrailerUrl no longer contains an invalid url with duplicate "https"
  • Actresses are now fully scraped if there are 10+ actresses in a movie
  • Maker, Series, and Label no longer pulls inaccurate data
• Javbus scraper
  • Search no longer fails when title html spans multiple lines
  • Both Japanese and English actress names are now pulled when scraping an uncensored movie
• Javinizer no longers fails to scrape when running in PowerShell 6

See More

• 52f6135 Merge pull request #100 from jvlflame/dev
• 842a2f0 Update CHANGELOG
• 41622b2 Fix id, title, and actress scraper for javbus
• 1c4ed8d Fix maker, label, series on dmm scraper (#99)
• 66561d2 Merge pull request #98 from jvlflame/dev
• dab6aa5 Fix threadjob throttlelimit for pwsh 6 (#97)
• 64a5678 Update for 2.0.2
• a534a42 Merge branch 'master' of https://github.com/jvlflame/JAV-Organizer into dev
• 405d887 Fix dmm scraper with 10+ actress
• 81e37dd Merge pull request #96 from seeyabye/fix/trailer-typo
• 17302d5 Fixed a double https display

This list of changes was auto generated.

2.0.1

Added

• Setting location.uncensorcsv to allow user-defined uncensor csv path

Changed

• Dmm scraper now includes TrailerUrl (Thanks @seeyabye)
• -Update parameter now downloads metadata items in addition to updating the nfo file
• Actress matcher logic updated for more accurate results
• Default file matcher logic updated to better clean filenames downloaded from torrent sites

Fixed

• Javlibrary ratings are now properly assigned to the nfo
• Dmm scraper now correctly gets actresses
• Regex file match no longer incorrectly changes the movie ID during sort
• sort.metadata.nfo.firstnameorder now correctly applies to <ACTORS> in sort formats

See More

• 6a2fcc7 Merge pull request #95 from jvlflame/dev
• 54ef250 Remove underscore prefix for file cleaning
• b08f967 Fix uncensorcsv path
• 6ac5806 Update for 2.0.1
• 734b294 Move iFrameUrl to try block
• 3aa698e Merge branch 'master' of https://github.com/jvlflame/JAV-Organizer into dev
• 918fe8d Added DMM Trailer (#90)
• 8929e48 Add configurable location for uncensor csv (#93)
• 37d37e9 Fix japanese actress nfo output (#92)
• 70d5549 Fix dmm scraper actresses (#92)
• d6401c0 Fix firstnameorder setting in aggregated data (#91)
• bae4174 Fix regex match transformation (#88)
• a82530d Remove alternate names in dmm scraper
• d5d312a Change update functionality to also download metadata
• e51bd8a Fix Dmm actress scraper
• e2117d1 Fix javlibrary rating output
• 121aa55 Update actress matcher logic
• a5c36c0 Update remove strings
• 4898cf2 Merge branch 'master' of https://github.com/jvlflame/JAV-Organizer into dev
• 83bed29 Fix find when using dmm url

This list of changes was auto generated.

2.0.0

Full release of 2.0.0 is here!

Documentation for 2.0.0 is fully updated on the README.

Notable changes from v1.x.x

• All scrapers updated v2 standards
• Improved default file matching to reduce the reliance on -Strict
• Thumb csv now includes actress Japanese name to better match actress metadata
• Thumb csv now allows multiple aliases per actress
• More user-configurable settings
• Improved -Find functionality
• Streamlined logging

Changes from 2.0.0-alpha9

Added

• Added -Update parameter to only update nfo when sorting a directory
  • This can replace v1.x.x functionality of using -MoveToFolder:$false -RenameFile:$false
• English 'dmm' scraper added
  • Somewhat unreliable as not all videos on the DMM Japanese site are available on the English site
  • Original 'dmm' scraper renamed to 'dmmja'
• Setting scraper.option.dmm.scrapeactress added to turn on/off both English/Japanese actress name scraping for dmm scrapers
  • Only enable this if you want to use Dmm as a primary scraper for your actress metadata as it greatly increases time taken to sort
• Parameter -EmbyUrl and -EmbyApiKey added to assign values in the commandline
• Parameter -OpenUncensor to open the R18 uncensored word replacement csv

Changed

• JapaneseName added to nfo file as altname
• Setting throttlelimit limited to 5
• R18 uncensored words and replacements are now moved to a file at module root jvUncensor.csv
• Path will default to your current commandline location if -Path is not specified and setting location.input is blank
• DestinationPath will default to the sorted file's current directory if -DestinationPath is not specified and setting location.output is blank
• Setting sort.metadata.thumbcsv.autoadd no longer adds actresses with a missing thumburl
• Add warning if custom thumb or genre csv is not found at specified path

Fixed

• Fixed scraped R18 actress names containing aliases in parentheses
• Writing thumbs to Emby/Jellyfin is now functional again with -SetEmbyThumbs following R18 resource restrictions
• Fixed failing screenshot download requests from R18 resources
• Parameter -Find with Javlibrary when using a custom javlibrary baseurl in your settings

Alpha Iterations

Thanks to all testers during the alpha phase!
2.0.0-alpha1
2.0.0-alpha3
2.0.0-alpha4
2.0.0-alpha5
2.0.0-alpha6
2.0.0-alpha7
2.0.0-alpha8
2.0.0-alpha9

1.7.6

Fixed

• Fixed failing download requests on R18 resources

2.0.0-alpha9

Fixed

• Fixed failing download requests from R18 resources

See More

• 2f4faaa Update for 2.0.0-alpha9
• 73c8fc6 Fix recurse depth
• 0bd6dc9 Set javlibrary scraper default to true
• f74f147 Add headers to download requests (#80)

This list of changes was auto generated.

2.0.0-alpha8

Starting to near the full release of 2.0.0 as most breaking bugs are getting cleared out.
As always, please open an issue or contact me on Discord if you find any issues or have any feature requests.

Changed

• Default matcher now supports IDs ending with a letter (IBW-###z, KTRA-###e)
• Logging messages updated to be more consistent

Fixed

• Jav321 scraper not running properly
• Javinizer now properly uses the thumb csv when a custom path is set in location.thumbcsv
• Error thrown when scraped genres are null and ignored genres are present

See More

* 91c65e0 Merge f2e69fe into fe86b81 * f2e69fe Update for 2.0.0-alpha8 * 013c789 Update default matcher for Id ending with Z and E * 3df511f Fix debug message for Jav321ja * 1b5ade2 Update logging messages (#78) * 35b63c6 Change method to output changed genres * 2a0ed81 Fix Jav321 scraper * 19e96e0 Add check for if genres is null * 9043069 Fix typo on installation docs (#78) * 55413c0 Fix mismatched thumb csv path when using custom location (#77)

This list of changes was auto generated.