BBC video from news page: youtube_dl.extractor.bbc.BBCCoUkIE.MediaSelectionError: notavailable #23232
Closed
5 tasks done
Comments
|
The same issue occurs with this URL. But this one is slightly different (I think I saw this earlier on one of their video-centric pages as well): |
|
Similar error encountered for the below video (published: 28 Nov 2019) on BBC's Video page. This is one of the headlining "Video Top Stories" at the time of this report. Video: Global .com URL | Alternate .co.uk URL Summary of Error Messages:
Log: |
|
BBC have updated the mediaselector. For mediaselector 5, However, mediaselector 6 now offers 720p HLS/DASH streams on |
|
Looks to me like they specify a Full HD (1920x1080) stream in |
|
Regarding the sample BBC.com/BBC.co.uk video URL mentioned in my initial comment above, the same video has also been published at the BBC Reel page. Below is a comparison of how Youtube-dl v2019.11.28 is handling the said video at the 2 URLs: vs. BBC Reel (BBC.com/reel/video/...): Youtube-dl is not able to automatically extract the video's PID ("no suitable InfoExtractor" error) for BBC Reel (as well as BBC Ideas/ BBC Earth etc.) videos. The BBC Reel video/playlist extraction issue was previously reported at #21870 & #18308. Using the workaround of manually specifying the PID, there are no errors encountered, but Youtube-dl fetches "video only" & "audio only" formats, which require user selection for merging on-the-fly. The default "best" format consists of just video visuals without any audio. (This wasn't the case for BBC Reel videos published before 27/28 Nov 2019.) Log: |
5 tasks
3 tasks
Closed
ThirumalaiK
pushed a commit
to ThirumalaiK/youtube-dl
that referenced
this issue
Jan 28, 2021
closes ytdl-org#23232 closes ytdl-org#23933 closes ytdl-org#26303 closes ytdl-org#26432 closes ytdl-org#26821 closes ytdl-org#27538
|
I'm trying to do something similar to download the one-minute news page here: https://www.bbc.com/news/av/10462520 Anyway, it says the URL is unsupported. I also tried all the examples on this issue but they all return What am I doing wrong? $ youtube-dl -F -v https://www.bbc.com/news/av/10462520
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-F', '-v', 'https://www.bbc.com/news/av/10462520']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.08.05
[debug] Python version 2.7.9 - Linux-4.9.24+-armv6l-with-debian-8.0
[debug] Proxy map: {}
[generic] 10462520: Requesting header
WARNING: Falling back on generic information extractor.
[generic] 10462520: Downloading webpage
[generic] 10462520: Extracting information
ERROR: Unsupported URL: https://www.bbc.com/news/av/10462520; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/generic.py", line 457, in _real_extract
doc = parse_xml(webpage)
File "/usr/lib/python2.7/dist-packages/youtube_dl/utils.py", line 1417, in parse_xml
return xml.etree.ElementTree.XML(s.encode('utf-8'), **kwargs)
File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1300, in XML
parser.feed(text)
File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1642, in feed
self._raiseerror(v)
File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1506, in _raiseerror
raise err
ParseError: not well-formed (invalid token): line 7, column 30
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 516, in extract_info
ie_result = ie.extract(url)
File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 170, in extract
return self._real_extract(url)
File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/generic.py", line 752, in _real_extract
raise ExtractorError('Unsupported URL: %s' % url)
ExtractorError: Unsupported URL: https://www.bbc.com/news/av/10462520; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update. |
Current versions are from 2021, not 2014, and for Debian 10 Buster with Python 3, not Debian 8 Jessie with Python 2. You might try installing a new package (and maybe, a newer OS?), as youtube-dl was only updated to handle the newer BBC method of embedding video within the last year or so. If you were on Debian 10 Buster, you could use the It might be possible to download that package and use it on your existing OS with dpkg -i, since Jessie does technically support a version of Python 3 (that it relies on now, rather than Python 2); however I am not sure this will work practically - and since LTS support for Jessie has ended, you are on thin ice - what if there is a bug in ffmpeg, and a file is crafted to exploit that? Unlikely, but possible. Extended LTS might help with the security side (though it uses "armel" rather than "armv6l" as it's architecture), but only until 2022. |
|
@GreenReaper Thank you for the insight. I am indeed using a Pi-Zero on jessie/debian 8. I had just installed it via UPDATE: I decided to remove the I did a Now everything works as expected. It even runs the most recent version: [debug] youtube-dl version 2021.04.07
[debug] Python version 3.4.2 (CPython) - Linux-4.9.24+-armv6l-with-debian-8.0
[debug] exe versions: avconv 11.12-6, avprobe 11.12-6, rtmpdump 2.4I was able to download the audio for the one-minute news segment using: youtube-dl -f mf_akamai-audio_eng=96000-0 -v https://www.bbc.com/news/av/10462520I picked format code ( |
|
I noticed that this stopped working recently. I upgraded This is the output: $ /usr/local/bin/youtube-dl -v -o /home/pi/git/motion/tmp/oneminute.m4a -f mf_akamai-audio_eng=96000-0 https://www.bbc.com/news/av/10462520
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-o', '/home/pi/git/motion/tmp/oneminute.m4a', '-f', 'mf_akamai-audio_eng=96000-0', 'https://www.bbc.com/news/av/10462520']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.06.06
[debug] Python version 3.4.2 (CPython) - Linux-4.9.24+-armv6l-with-debian-8.0
[debug] exe versions: avconv 11.12-6, avprobe 11.12-6, rtmpdump 2.4
[debug] Proxy map: {}
[bbc] 10462520: Downloading webpage
ERROR: Unable to extract playlist data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/lib/python3.4/dist-packages/youtube_dl/YoutubeDL.py", line 815, in wrapper
return func(self, *args, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/youtube_dl/YoutubeDL.py", line 836, in __extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python3.4/dist-packages/youtube_dl/extractor/common.py", line 534, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python3.4/dist-packages/youtube_dl/extractor/bbc.py", line 1255, in _real_extract
webpage, 'playlist data'),
File "/usr/local/lib/python3.4/dist-packages/youtube_dl/extractor/common.py", line 1012, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract playlist data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Checklist
Verbose log
Description
The image at the top of this news page turns into a video, which is not downloaded when accessing the page via youtube-dl. It works in the browser even if I open the window in a new private mode window.
I am in the UK using Virgin Media cable without a proxy. On right-clicking the video while playing I get:
The issue also occurred when using Python 3.7.3 and I believe a slightly-earlier version of youtube-dl.
The text was updated successfully, but these errors were encountered: