Library.db Size

[Dpunkt]

Hello,

I was quite late to switch to this version and was using the old LMS till recently.
During the update I noticed that my Database file is at 20 GB, the Library contains 117515 Titels (acording to LMS).
Is this a normal file size?
I tried to clean it by ruinng a new scan with the "delete database" option, but the file does not get smaller.
Can I delete this file and LMS will rescan the database or does this file contain more than the library?

[michaelherger]

Yes, you can delete it. But I'd actually be interested in it, to better understand what was wrong with it.

Is this an installation which has been around for a few years? There was at some point an issue with the database file which could cause "infinite" growth. That was changed at some point, but IIRC it really required deletion of the file, as the necessary configuration could not be changed after the file had been created.

See also eg. https://forums.slimdevices.com/forum/user-forums/logitech-media-server/1735246-very-large-artwork-db-file-can-it-cause-issues

[Dpunkt]

This installation is around for many years (the Duet was new at the time). One of my guesses were saved internet radio cover arts, but I assume they would have been stored in e.g. cache db. (The latest version does not seem to cache them but direct the client to the original source. This caused some pain on one client which was not allowed internet access.)

[Dpunkt]

In the current state the scan does not finish and newer files are missing in the libaray,

[Dpunkt]

I renamed library.db, but it is refusing to start a scan.
Log:

[24-12-04 15:01:57.2568] main::init (387) Starting Lyrion Music Server (v9.0.0, 1730207668, Wed Oct 30 02:57:04 CUT 2024) perl 5.032001 - MSWin32-x64-multi-thread
[24-12-04 15:02:01.8025] main::checkDataSource (1110) Warning: Schema updated or no media found in the database, initiating scan.
[24-12-04 15:02:04.1683] Slim::Plugin::FullTextSearch::Plugin::_initPopularTerms (637) Fulltext index missing or outdated - re-building
[24-12-04 15:02:39.8298] Slim::Plugin::FullTextSearch::Plugin::_initPopularTerms (637) Fulltext index missing or outdated - re-building

Scanner Log is empty.
Can I rename the whole cache folder?

[Dpunkt]

I noticed that I do not see any additional perl process of the scanner. And when I manually run the command from the log (perl "C:/Program Files/Lyrion/server/scanner.pl" "--prefsdir=C:\ProgramData\Squeezebox\prefs" "--logconfig=C:\ProgramData\Squeezebox\prefs\log.conf" "--priority=0" "--wipe" "--debug" "artwork=ERROR,formats.playlists=ERROR,scan.import=DEBUG,formats.audio=ERROR,scan=DEBUG,scan.auto=DEBUG,scan.scanner=DEBUG,database.info=ERROR,database.virtuallibraries=ERROR") It starts to scan there and creates the scanner.log file

[michaelherger]

Ok, that's interesting. And you didn't get a single line indicating what went wrong in the server.log?

[Dpunkt]

No.

[24-12-04 15:47:02.1488] Slim::Music::Import::launchScan (206) Running scanner using arguments: C:\Program Files\Lyrion\Perl\perl\bin\perl.exe (
"C:/Program Files/Lyrion/server/scanner.pl",
"--wipe",
"--priority=0",
"--prefsdir=C:\ProgramData\Squeezebox\prefs",
"--logconfig=C:\ProgramData\Squeezebox\prefs\log.conf",
"--debug",
"database.info=ERROR,scan.import=DEBUG,formats.playlists=ERROR,database.virtuallibraries=ERROR,artwork=ERROR,scan=DEBUG,scan.scanner=DEBUG,formats.audio=ERROR,scan.auto=DEBUG",
)
[24-12-04 15:47:02.1610] main::init (613) Library Browser init...
[24-12-04 15:47:02.1621] main::init (617) Server persist playlists...
[24-12-04 15:47:02.1653] main::init (653) Server HTTP enable...
[24-12-04 15:47:03.1686] main::init (661) Server done init: http://192.168.178.192:9000
[24-12-04 15:47:03.3300] Slim::Utils::OS::Win64::runService (66) Running Windows Service...
[24-12-04 15:47:03.4921] Slim::Plugin::FullTextSearch::Plugin::_initPopularTerms (634) Fulltext index missing or outdated - re-building
[24-12-04 15:47:03.4929] Slim::Schema::wipeCaches (2255) Wiped all in-memory caches.
[24-12-04 15:47:03.4939] Slim::Schema::wipeCaches (2255) Wiped all in-memory caches.
[24-12-04 15:47:03.4951] Slim::Schema::wipeCaches (2255) Wiped all in-memory caches.

Maybe I have to increase a different log level, where would you expect "fail to start scanner"?

[michaelherger]

Hmm... this looks as if the scan was triggered before the service was fully set up and running. What if you trigger the scan from a running instance? Would you get the same "no-op"?

[Dpunkt]

I think it was ready when I clicked on scan last time. I clicked on scan again now, the server log displays:

[24-12-05` 22:30:49.6429] Slim::Web::Settings::Server::Basic::handler (110) Path information for single dir scan: {
  oldPaths => {},
  paths => ["D:\\Daten\\Musik"],
  singleDirScan => "file:///D:/Daten/Musik",
}
[24-12-05 22:30:49.6431] Slim::Web::Settings::Server::Basic::handler (124) Triggering singleDirScan (file:///D:/Daten/Musik)
[24-12-05 22:30:49.6435] Slim::Music::Import::initScanQueue (790) initialize scan queue
[24-12-05 22:30:49.6438] Slim::Music::Import::queueScanTask (854) adding scan rescan|full|file:///D:/Daten/Musik to queue
[24-12-05 22:30:49.6442] Slim::Music::Import::nextScanTask (808) triggering next scan: rescan|full|file:///D:/Daten/Musik
[24-12-05 22:30:49.6444] Slim::Music::Import::countImporters (628) Found importer: Plugins::OnlineLibrary::Importer
[24-12-05 22:30:49.6445] Slim::Music::Import::countImporters (628) Found importer: Slim::Media::MediaFolderScan
[24-12-05 22:30:49.6446] Slim::Music::Import::countImporters (628) Found importer: Slim::Plugin::FullTextSearch::Plugin
[24-12-05 22:30:49.6573] Slim::Music::Import::launchScan (206) Running scanner using arguments: C:\Program Files\Lyrion\Perl\perl\bin\perl.exe (
  "C:/Program Files/Lyrion/server/scanner.pl",
  "--priority=0",
  "--prefsdir=C:\\ProgramData\\Squeezebox\\prefs",
  "--logconfig=C:\\ProgramData\\Squeezebox\\prefs\\log.conf",
  "--rescan",
  "--debug",
  "formats.playlists=ERROR,database.virtuallibraries=ERROR,artwork=ERROR,scan=DEBUG,database.info=ERROR,scan.import=DEBUG,scan.auto=DEBUG,scan.scanner=DEBUG,formats.audio=ERROR",
  "D:\\Daten\\Musik",
)
[24-12-05 22:30:49.7133] Slim::Music::Import::nextScanTask (812) remaining scans in queue:()
[24-12-05 22:30:50.5739] Slim::Schema::wipeCaches (2255) Wiped all in-memory caches.
[24-12-05 22:30:50.5749] Slim::Schema::wipeCaches (2255) Wiped all in-memory caches.
[24-12-05 22:30:50.5758] Slim::Music::Import::nextScanTask (812) remaining scans in queue:()
[24-12-05 22:30:50.5764] Slim::Schema::wipeCaches (2255) Wiped all in-memory caches.

Btw. the scanner on my command line (manual run) finished succesfully, resulting in a useable library, The library.db now is more reasonable 250 MB. So the size issue is fixed by a new scan. But now it would be nice to know why the scan did not start correctly.