Not finding torrent

[Masterditto]

Describe the bug
Taking example in the TV series "Arrow", medusa refuses to find "Arrow.S07E02.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE"
Where required word "Substance" is the only criteria for medusa. It easily find others (look below in log section)

This happends to all releases from "Substance" (Tracker: DanishBits) and "YesWeAre" (Tracker: NordicBits)

To Reproduce
Steps to reproduce the behavior:
Setup Medusa to do a search for "Arrow" with required word "Substance" on tracker DanishBits or "Supernatural" with required word "YesWeAre" on tracker NordicBits

I will gladly have you take a look from within my pc remotely, debug log says nothing else than normal log.

Expected behavior
Expected behavior is it should download and find this "Substance" and "YesWeAre" releases. Been trying to fix this for days now.
Please help :)

Screenshots
None that would help better.

Medusa (please complete the following information):

• OS: Linux Synology running SickBeard with Medusa set as master Branch
• Branch: master
• Commit: Not sure what is needed here?

Logs:
Not finding "Substance" Arrow episode on DanishBits.

2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [0c0a735] Unable to find forced results for: Arrow - S07E02 - The Longbow Hunters
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.1080p.HEVC.x265-MeGusta based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.1080p.HEVC.x265-MeGusta is 1080p HDTV
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.HDTV.x264-SVA based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.HDTV.x264-SVA is SDTV
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.iNTERNAL.720p.WEB.h264-BAMBOOZLE based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.iNTERNAL.720p.WEB.h264-BAMBOOZLE is 720p WEB-DL
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.1080p.WEB.h264-TBS based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.1080p.WEB.h264-TBS is 1080p WEB-DL
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.720p.HDTV.x264-SVA based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.720p.HDTV.x264-SVA is 720p HDTV
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Performing episode search for Arrow

Additional context
Dont have more details.

[medariox]

Enable debug logs and post a full manual search.

[Masterditto]

I did enable debug, but "logs" dont show anything debug related. Been trying to find solution online too. What should I do ?

Even tried restarted Medusa after enable and try do manual search. Still shows no debug even tho I see the checkmark for "enabled"

[medariox]

You need to select debug from the drop down in view logs.

[Masterditto]

Stupid me.. Ok found debug. Look here please.
https://imgur.com/a/Jq9sIKP

[Masterditto]

Better picture here:

[p0psicles]

Copy the logs to gist.github.com. Past gist link here

[Masterditto]

https://gist.github.com/Masterditto/218b55c0bfb002c623c4eee6985eb067

[medariox]

Now do the same with a manual search.

[Masterditto]

https://gist.github.com/Masterditto/8a6de8873c5ad86f151fba3a28cf19b1

[medariox]

That's still not a manual search. A manual search starts with SEARCHQUEUE-MANUAL-.

[Masterditto]

Sorry! got it.. but clicking it returns nothing in DEBUG log other than pushing me to this website:

[p0psicles]

Click the force search button

[p0psicles]

It will star a new search.
Also you have SUSTANCE as a required word? Why.

[Masterditto]

Ok that made it appear in the list!

Log here:
DELETED

I have required word "Substance" becuz its the only sub group I wanna download from in this paticular TV show. Could I do this smarter somehow?

[p0psicles]

Ok then it will only download those.
It should have that picked up in a backlog search

[Masterditto]

It downloaded the Episode 02, but how can I tell it to look for these Substance? without me requiring to do a manual search everytime.
Tried going to "Black Lightning" TV show. Same problem - This time "DBRETAiL" required word

Did a Force manual search on Episode 2 and it found DBRETAiL.

Tried to make it auto download episode 3, but had to do force manual search again?

[sharkykh]

Didn't read the whole thread but results with dk subs are ignored by default. Try removing dk from the list of ignored subtitled results on the Search Settings config page.
Option is titled Ignore language names in subbed results

[Masterditto]

I already did a full clear there:

[Masterditto]

Just wonder why it does not pick these up automaticly. Really dont wanna do a "Force manual search" every episode :(
Which is the main purpose/job for Medusa to handle.

Hope someone has a fix for me :O

[Masterditto]

So I've now did what u asked. And surely enough a "Forced manuel search" does find Episode 2 here. Look at first picture, but why should I do a manual search on ALL episodes?
Going into episode 3 (2. picture below) I again have to do manuel search ?

This is most likely a bug or?

All TV series mentioned below is from "substance" group and from same tracker (DanishBits)
"Blindspot" and "The last ship" was found automaticly without a problem though...
Blindspot and The Flash was released same day.
"The Flash", "Arrow", "Mr. Mercedes", "The Walking Dead" was not found..

Can't seem to find the problem here. Help?

Please help me fix this! Love Medusa over old SickRage!

[medariox]

You most likely only want releases with danish subs, right? In that case you should just add DKsubs to required words. Regarding the issue you seem to have, without a full debug log (talking about at least 24h from when the episode was released) it is really hard to help you further.

[Masterditto]

Hi medaiox

Been trying having no required word for the show "Arrow" and it does not find the releases from "Substance" automaticly. I have to do a "Force manual search" before it shows up in the list - Like I talked about earlier. Take a look here:

BEFORE "Force Manual Search"

AFTER "Force Manual Search"

My debug log didn't go further than this in the web-interface:
https://gist.github.com/Masterditto/51b78727b75c096f4ad5d79f8217e7bf

"Danishbits" search provider does work, because its grabbing 90% of the content I also have MEDUSA search for.
Recently this was taken without any problems:
Kidding.S01E10.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL (2 hours ago - required word: DBRETAiL)
DCs.Legends.of.Tomorrow.S04E03.NORDiC.720p.WEB-DL.DD5.1.H.264-DBRETAiL (19 hours ago - required word: DBRETAiL)
The.Big.Bang.Theory.S12E08.Custom.DKsubs.720p.WEB-DL.x264-ENiGMA (2 days ago - required word: ENiGMA)

To me it could be fixed if Medusa could do its own "manuel force search" automaticly?
Makes no sense users should do this on every new episode :)
Hope you guys can fix this.

Regards

EDIT1:
Medusa has just found this torrent with required word "substance"
"The.Walking.Dead.S09E06.Custom.DKsubs.720p.WEB-DL.H264-SUBSTANCE"
But still not arrow? cant find the reason behind it :( hmm....

EDIT2:
"The.Flash.S05E05.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE" was not found unless I did a "Manual force search" on the episode.

Before

After

EDIT3:
Blindspot.S04E05.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE - Was found
Lethal.Weapon.S03\Lethal.Weapon.S03E07.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL - Was found

EDIT4:
The.Big.Bang.Theory.S12E07.Custom.DKsubs.720p.WEB-DL.x264-ENiGMA
The.Big.Bang.Theory.S12E09.Custom.DKsubs.720p.WEB-DL.x264-ENiGMA
This was not found - Had to do manual force search again here:

EDIT5:
Black.Lightning.S02E06.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL

And this
Gold.Rush.S09E07.NORDiC.720p.WEB-DL.AAC2.0.H.264-DBRETAiL

And this
DCs.Legends.of.Tomorrow.S04E05.NORDiC.720p.WEB-DL.DD5.1.H.264-DBRETAiL

ALL EDITS WORKS WHEN DOING "FORCE MANUAL SEARCH" help???

[jbaun]

I have the same problem with Medusa and Danishbits. Any news on a solution?

[p0psicles]

@Masterditto still an issue?
Normally these episodes should be found 1. through daily (rss) search and then 2. backlog search. We'll need debug logs for these. A force manual search is the same as a backlog search but for one specific episode. All results from a backlog search, should also be added to cache.

[Masterditto]

Yes im still doing "Force manual search" on many episodes. Waiting for u guys for a fix (I hope)

What more information can I provide u to help fix this?

[p0psicles]

If your missing a result. Manual start a backlog search. And share the debug log.

[Masterditto]

I could recommend Medusa to set it to 0 as default ? (IF this solves the issue) I promise to return if its working :)

[jbaun]

Hi. Mine was also set to 1. I have now set it to 0 and will also test this.

[Masterditto]

So far one problem.

Z.Nation.S05E09.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE
Released 2 hours ago.

Forcing backlog search didnt find it either. (I know it WILL find it if I again do a "Force manual search")

[p0psicles]

Plesase zip you Logs folder

[Masterditto]

application.zip

here is log file

[p0psicles]

Ok

[Masterditto]

Supergirl.S04E08.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL - Releases 14 hours ago was not found.

[p0psicles]

Just your last application.log?

[Masterditto]

Logs.zip

Here is logs after this Supergirl episode :)

[Masterditto]

UPDATE:

This was not found. Full screenshots and log file after I ran manage searches "Backlog" and "Daily".

Logs.zip

[XenoBIT78]

If you need more logs let me know im facing the same problem.. :)

[p0psicles]

Danishbits has a really fast paced RSS. It has 20 items. And on times they move through them within 15 minutes. We have a minimum interval of 10 minutes. But there is a check that makes sure that individual providers are not polled more often then what they are configured for (individually). There is a small issue, where sometimes the last search was (for example) 9 minutes and 58 seconds ago. Then it skips that provider for that "turn". And 10 minutes later, the provider is allowed to pull new results. So although the provider is supposed to pull every 10 min. In that case there will be a gap of 19 minutes and 58 seconds. Which can result in missing a few eps.

I'll discuss with the other devs, if we can do something about this.

@Masterditto you can also fix this, by asking danishbits if they are willing to extend their RSS to for ex 50 or 100 items.

[p0psicles]

Example of the actual RSS pulls:

application.log.1:2018-12-06 19:39:30 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 19:49:32 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 19:59:34 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 20:19:34 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 20:39:34 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 20:49:36 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:09:36 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:19:38 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:39:41 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:59:41 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 22:19:42 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]

[p0psicles]

You can see it often skips 20 minutes, where it should skip 10 now.

[Masterditto]

I contacted staff on Danishbits now. Will return with an answer for you :)

[p0psicles]

You can tell them, that if they extend the number of results, users can also extend the interval. Lowering the amount of hits on their api.

[Masterditto]

Ok, told them that too. And referenced them to this page to look themself :) Thx as always p0psicles and others for a great product!

[Masterditto]

p0p can u meet me on IRC for a moment?

[p0psicles]

I can now

[Masterditto]

I got reply from staff: RSS is changed to 50 now

So this should solve this issue or?
Anyways.. I'll keep monitering as always :)

[p0psicles]

Yeah i think that should solve it.
Also the change I'm making to daily search will also improve reliability.

[Masterditto]

Awesome p0p!

So far the first needed snatch has worked. I'll keep monitering and report back here for some time before we close the issue :)

[p0psicles]

Well we've made a number of nice improvements because of your help. So tnx for the help.

[XenoBIT78]

any special build for testing this fix ?

[p0psicles]

Develop branch already has two of the three improvements

[p0psicles]

Last one will be merged soon

[XenoBIT78]

Thanks..

Gr8 work :D it's much apreciated :)