Non-webpage bookmarks duplication problem

[Haze-sh]

When adding links that contain non-webpage content (like pdfs or gifs) it gets duplicated in the database, I think this shouldn't be the expected behaviour

[kamtschatka]

I have added a gif and a pdf to hoarder and got only 1 entry. Please provide more information on what you are doing and where you are seeing a duplication

[Haze-sh]

Sorry this wasn't really clear, I was importing a list of urls through the command line, when I reimport the same list again the pdfs and gifs get readded to hoarder again but webpages do not duplicate. And they are not searchable too.

[kamtschatka]

can you please explain exactly what are you doing?
I ran bookmarks add --link https://asdf.readthedocs.io/_/downloads/en/2.9.2/pdf/ and get the response alreadyExists: false.
then I run it again and get the response alreadyExists: true and the bookmark is not added again.

Which commands are you calling to get the duplication?

[Haze-sh]

I can't replicate this with the same exact command above! I don't have a clue what could have been different at my machine.

[Haze-sh]

For further clarification, the above command gives alreadyExists: false at every re-run.

[kamtschatka]

are you on the latest version (0.17.1)?
I have just rerun the test and I can't reproduce it. Maybe someone else can reproduce it, but I don't really understand why the same command would lead to different outcomes on our machines, as it is quite simple^^

[kamtschatka]

OK now I can reproduce it, if you wait long enough for it to completely crawl, then this happens. I will have a look