File download from https server does not work

[nightflyer88]

Basic Infos

• This issue complies with the issue POLICY doc.
• I have read the documentation at readthedocs and the issue is not addressed there.
• I have tested that the issue is present in current master branch (aka latest git).
• I have searched the issue tracker for a similar issue.
• If there is a stack dump, I have decoded it.
• I have filled out all fields below.

Platform

• Hardware: [ESP-12]
• Core Version: [2.6.3]
• Development Env: [Arduino IDE]
• Operating System: [MacOS]

Settings in IDE

• Module: [Nodemcu]
• Flash Mode: [qior]
• Flash Size: [4MB]
• lwip Variant: [v1.4]
• Reset Method: [nodemcu]
• Flash Frequency: [40Mhz]
• CPU Frequency: [160MHz]
• Upload Using: [SERIAL]
• Upload Speed: [115200] (serial upload only)

Problem Description

I want to download this file from an https server (github) with the ESP8266: https://github.com/nightflyer88/test/releases/download/V2.0/index.html.gz

But it doesn't work, the server responds with 404. Is there a certification problem?

I can load the file using the web browser on Mac, only it doesn't work on the ESP8266.

MCVE Sketch

/**
   BasicHTTPSClient.ino

    Created on: 20.08.2018

*/

#include <Arduino.h>

#include <ESP8266WiFi.h>
#include <ESP8266WiFiMulti.h>
//#include <WiFiClientSecure.h>
#include <WiFiClientSecureBearSSL.h>

#include <ESP8266HTTPClient.h>

const uint8_t fingerprint[20] = {0xCA, 0x06, 0xF5, 0x6B, 0x25, 0x8B, 0x7A, 0x0D, 0x4F, 0x2B, 0x05, 0x47, 0x09, 0x39, 0x47, 0x86, 0x51, 0x15, 0x19, 0x84};

ESP8266WiFiMulti WiFiMulti;

void setup() {

  Serial.begin(115200);
  Serial.setDebugOutput(true);

  for (uint8_t t = 4; t > 0; t--) {
    Serial.printf("[SETUP] WAIT %d...\n", t);
    Serial.flush();
    delay(1000);
  }

  WiFi.mode(WIFI_STA);
  WiFiMulti.addAP("..", "..");
}

void loop() {
  // wait for WiFi connection
  if ((WiFiMulti.run() == WL_CONNECTED)) {

    WiFiClientSecure client;
    client.setFingerprint(fingerprint);
    //client.setInsecure();
    client.connect("github.com", 443);

    HTTPClient https;
    https.setUserAgent("Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:72.0) Gecko/20100101 Firefox/72.0");
    https.setRedirectLimit(10);
    https.setFollowRedirects(true);

    Serial.print("[HTTPS] begin...\n");
    if (https.begin(client, "https://github.com/nightflyer88/test/releases/download/V2.0/index.html.gz")) {  // HTTPS

      //https.addHeader("Accept-Encoding", "gzip, deflate, br", false, true);

      Serial.print("[HTTPS] GET...\n");
      // start connection and send HTTP header
      int httpCode = https.GET();

      // httpCode will be negative on error
      if (httpCode > 0) {
        // HTTP header has been send and Server response header has been handled
        Serial.printf("[HTTPS] GET... code: %d\n", httpCode);

        // file found at server
        if (httpCode == HTTP_CODE_OK || httpCode == HTTP_CODE_MOVED_PERMANENTLY) {
          String payload = https.getString();
          Serial.println(payload);
        }
      } else {
        Serial.printf("[HTTPS] GET... failed, error: %s\n", https.errorToString(httpCode).c_str());
      }

      https.end();
    } else {
      Serial.printf("[HTTPS] Unable to connect\n");
    }
  }

  Serial.println("********************************************************** Wait 10s before next round...");
  delay(10000);
}

Debug Messages

SDK:2.2.2-dev(38a443e)/Core:2.6.3=20603000/lwIP:STABLE-2_1_2_RELEASE/glue:1.2-16-ge23a07e/BearSSL:89454af
[SETUP] WAIT 4...
scandone
state: 0 -> 2 (b0)
state: 2 -> 3 (0)
state: 3 -> 5 (10)
add 0
aid 2
cnt 

connected with Achtung Virus !! nicht anklicken���, channel 3
dhcp client start...
[SETUP] WAIT 3...
ip:192.168.1.31,mask:255.255.255.0,gw:192.168.1.1
[SETUP] WAIT 2...
[SETUP] WAIT 1...
BSSL:_connectSSL: start connection
BSSL:CERT: 30 82 07 42 30 82 06 2a a0 03 02 01 02 02 10 0a 06 30 42 7f 5b bc ed 69 57 39 65 93 b6 45 1f 30 0d 06 09 2a 86 48 86 f7 0d 01 01 0b 05 00 30 75 31 0b 30 09 06 03 55 04 06 13 02 55 53 31 15 30 13 06 03 55 04 0a 13 0c 44 69 67 69 43 65 72 74 20 49 6e 63 31 19 30 17 06 03 55 04 0b 13 10 77 77 77 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 31 34 30 32 06 03 55 04 03 13 2b 44 69 67 69 43 65 72 74 20 53 48 41 32 20 45 78 74 65 6e 64 65 64 20 56 61 6c 69 64 61 74 69 6f 6e 20 53 65 72 76 65 72 20 43 41 30 1e 17 0d 31 38 30 35 30 38 30 30 30 30 30 30 5a 17 0d 32 30 30 36 30 33 31 32 30 30 30 30 5a 30 81 c7 31 1d 30 1b 06 03 55 04 0f 0c 14 50 72 69 76 61 74 65 20 4f 72 67 61 6e 69 7a 61 74 69 6f 6e 31 13 30 11 06 0b 2b 06 01 04 01 82 37 3c 02 01 03 13 02 55 53 31 19 30 17 
BSSL:CERT: 06 0b 2b 06 01 04 01 82 37 3c 02 01 02 13 08 44 65 6c 61 77 61 72 65 31 10 30 0e 06 03 55 04 05 13 07 35 31 35 37 35 35 30 31 0b 30 09 06 03 55 04 06 13 02 55 53 31 13 30 11 06 03 55 04 08 13 0a 43 61 6c 69 66 6f 72 6e 69 61 31 16 30 14 06 03 55 04 07 13 0d 53 61 6e 20 46 72 61 6e 63 69 73 63 6f 31 15 30 13 06 03 55 04 0a 13 0c 47 69 74 48 75 62 2c 20 49 6e 63 2e 31 13 30 11 06 03 55 04 03 13 0a 67 69 74 68 75 62 2e 63 6f 6d 30 82 01 22 30 0d 06 09 2a 86 48 86 f7 0d 01 01 01 05 00 03 82 01 0f 00 30 82 01 0a 02 82 01 01 00 c6 3c aa f2 3c 97 0c 3a c1 4f 28 ad 72 70 7d d3 ce b9 b5 60 73 a4 74 9b 8a 77 46 fd 7a 98 42 4c c5 30 19 57 9a a9 33 0b e1 5d 4d 10 58 ca 77 99 c3 93 f3 f9 75 90 bc bf bb e0 95 ba 2e c5 8d 73 61 05 d3 10 84 a8 b3 89 b8 2f 73 8c f0 2a 6e be 
BSSL:CERT: ee ae 83 4b 82 11 b1 61 fd 77 61 da 9b 1b 9a 23 ff 8c 7e a2 01 06 dd d1 7f 53 96 08 c1 5a fa e7 c0 ca c8 44 8c 57 a7 a8 61 5f 66 0d 57 d3 b8 96 ac b6 4a 9c c1 ea e8 fb 96 40 29 f6 15 30 b5 04 b0 cc 05 b6 84 c3 24 59 95 7f a2 65 90 e5 b0 b3 1a 75 59 c4 3f 31 14 0a d5 cc aa 3a 85 05 52 06 32 96 07 61 df 27 82 0c f7 85 db 60 31 f0 09 50 c5 b7 1a 23 e1 b0 7d 02 f5 14 1e c9 cb e8 7e 2a 33 04 f6 51 3f 52 98 15 e9 0b 76 47 5c 4d 4a 6b c5 08 15 ae f8 d1 57 e9 ea 70 14 ff c9 45 b9 0c 7c bc f4 6d e6 05 52 f9 8c 80 bb 70 56 91 0f 4b 02 03 01 00 01 a3 82 03 79 30 82 03 75 30 1f 06 03 55 1d 23 04 18 30 16 80 14 3d d3 50 a5 d6 a0 ad ee f3 4a 60 0a 65 d3 21 d4 f8 f8 d6 0f 30 1d 06 03 55 1d 0e 04 16 04 14 c9 c2 53 61 66 9d 5f ab 25 f4 26 cd 0f 38 9a a8 49 ea 48 a9 30 25 06 
BSSL:CERT: 03 55 1d 11 04 1e 30 1c 82 0a 67 69 74 68 75 62 2e 63 6f 6d 82 0e 77 77 77 2e 67 69 74 68 75 62 2e 63 6f 6d 30 0e 06 03 55 1d 0f 01 01 ff 04 04 03 02 05 a0 30 1d 06 03 55 1d 25 04 16 30 14 06 08 2b 06 01 05 05 07 03 01 06 08 2b 06 01 05 05 07 03 02 30 75 06 03 55 1d 1f 04 6e 30 6c 30 34 a0 32 a0 30 86 2e 68 74 74 70 3a 2f 2f 63 72 6c 33 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 2f 73 68 61 32 2d 65 76 2d 73 65 72 76 65 72 2d 67 32 2e 63 72 6c 30 34 a0 32 a0 30 86 2e 68 74 74 70 3a 2f 2f 63 72 6c 34 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 2f 73 68 61 32 2d 65 76 2d 73 65 72 76 65 72 2d 67 32 2e 63 72 6c 30 4b 06 03 55 1d 20 04 44 30 42 30 37 06 09 60 86 48 01 86 fd 6c 02 01 30 2a 30 28 06 08 2b 06 01 05 05 07 02 01 16 1c 68 74 74 70 73 3a 2f 2f 77 77 77 2e 64 69 
BSSL:CERT: 67 69 63 65 72 74 2e 63 6f 6d 2f 43 50 53 30 07 06 05 67 81 0c 01 01 30 81 88 06 08 2b 06 01 05 05 07 01 01 04 7c 30 7a 30 24 06 08 2b 06 01 05 05 07 30 01 86 18 68 74 74 70 3a 2f 2f 6f 63 73 70 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 30 52 06 08 2b 06 01 05 05 07 30 02 86 46 68 74 74 70 3a 2f 2f 63 61 63 65 72 74 73 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 2f 44 69 67 69 43 65 72 74 53 48 41 32 45 78 74 65 6e 64 65 64 56 61 6c 69 64 61 74 69 6f 6e 53 65 72 76 65 72 43 41 2e 63 72 74 30 0c 06 03 55 1d 13 01 01 ff 04 02 30 00 30 82 01 7e 06 0a 2b 06 01 04 01 d6 79 02 04 02 04 82 01 6e 04 82 01 6a 01 68 00 76 00 a4 b9 09 90 b4 18 58 14 87 bb 13 a2 cc 67 70 0a 3c 35 98 04 f9 1b df b8 e3 77 cd 0e c8 0d dc 10 00 00 01 63 41 62 6d 0a 00 00 04 03 00 47 30 45 02 21 00 
BSSL:CERT: d1 66 9d fc 71 35 ac 58 7d 86 74 1a 5e fe e3 d3 5a 7b 2e fe 6e 01 10 2d be 74 87 2f 4b 29 19 62 02 20 08 fe 60 1a fe b2 cd a6 b3 c4 12 b6 37 01 9d 9a 6c ae 10 53 52 83 6a 40 45 b3 09 95 41 60 53 95 00 76 00 56 14 06 9a 2f d7 c2 ec d3 f5 e1 bd 44 b2 3e c7 46 76 b9 bc 99 11 5c c0 ef 94 98 55 d6 89 d0 dd 00 00 01 63 41 62 6d 2d 00 00 04 03 00 47 30 45 02 21 00 a2 ee 89 94 bd 82 e6 d1 bd 8b a1 bb 44 79 10 18 9e 52 28 ee 7e 89 c5 b6 1d ae d6 1d 98 f5 16 25 02 20 56 0c 35 01 9e 75 bc af 44 36 29 c1 83 6d 85 3f 16 fc d9 3b cd 0c ed 39 4f 5e e1 c5 74 42 d8 86 00 76 00 bb d9 df bc 1f 8a 71 b5 93 94 23 97 aa 92 7b 47 38 57 95 0a ab 52 e8 1a 90 96 64 36 8e 1e d1 85 00 00 01 63 41 62 6d df 00 00 04 03 00 47 30 45 02 21 00 a1 cd d4 ca 51 4d 8d f9 77 2a 70 ad 0e 25 8a cd 
BSSL:CERT: f0 46 32 9e 5a 15 c6 1a 38 c8 f9 3a 0e ad c4 3e 02 20 74 d1 f9 bb ca c2 dd 47 2c 95 05 78 07 da 34 6b 4c 36 d3 8a 26 0d 11 06 29 35 6e 12 9c 46 78 e4 30 0d 06 09 2a 86 48 86 f7 0d 01 01 0b 05 00 03 82 01 01 00 70 0f 5a 96 a7 58 e5 bf 8a 9d a8 27 98 2b 00 7f 26 a9 07 da ba 7b 82 54 4f af 69 cf bc f2 59 03 2b f2 d5 74 58 25 d8 1e a4 20 76 62 60 29 73 2a d7 dc cc 6f 77 85 6b ca 6d 24 f8 35 13 47 3f d2 e2 69 0a 9d 34 2d 7b 7b 9b cd 1e 75 d5 50 6c 3e cb 1c a3 30 b1 aa 92 07 a9 3a 76 76 45 bd 78 91 c4 ce 1a 9e 22 e4 0b 89 ba e6 8c c1 79 82 a3 b8 d4 c0 fc 1f 2d ed 4d 52 55 41 2a a8 3a 2c ad 07 72 ae 0a d2 c6 67 c4 4f 07 17 18 99 f7 65 a9 57 60 15 5a 34 4c 11 cf f6 cf 6b 21 36 80 ef c6 f1 54 63 26 35 39 ee bb c4 83 64 9b 24 0a 73 ec a0 48 16 73 c8 b9 d7 48 55 56 98 
BSSL:CERT: 7a f7 bb 97 5c 69 a4 06 18 04 78 da fe 98 76 be 22 2f 7f 07 77 87 4e 88 19 9a f8 55 ec 5c 12 2a 59 48 db 49 3e 15 5e 67 5a a2 5e ee cc 53 28 8c 0e 33 93 14 03 64 0b c5 e5 78 09 94 01 5a 75 fc 92 9d af ed 7a 29 
BSSL:Connected!
[HTTPS] begin...
[HTTP-Client][begin] url: https://github.com/nightflyer88/test/releases/download/V2.0/index.html.gz
[HTTP-Client][begin] host: github.com port: 443 url: /nightflyer88/test/releases/download/V2.0/index.html.gz
[HTTPS] GET...
[HTTP-Client][sendRequest] type: 'GET' redirCount: 0
[HTTP-Client] connect: already connected, reusing connection
[HTTP-Client] sending request header
-----
GET /nightflyer88/test/releases/download/V2.0/index.html.gz HTTP/1.1
Host: github.com
User-Agent: ESP8266HTTPClient
Connection: keep-alive
Accept-Encoding: identity;q=1,chunked;q=0.1,*;q=0
Content-Length: 0

-----
[HTTP-Client][handleHeaderResponse] RX: 'HTTP/1.1 302 Found'
[HTTP-Client][handleHeaderResponse] RX: 'Date: Sat, 18 Jan 2020 20:14:31 GMT'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Type: text/html; charset=utf-8'
[HTTP-Client][handleHeaderResponse] RX: 'Transfer-Encoding: chunked'
[HTTP-Client][handleHeaderResponse] RX: 'Server: GitHub.com'
[HTTP-Client][handleHeaderResponse] RX: 'Status: 302 Found'
[HTTP-Client][handleHeaderResponse] RX: 'Vary: X-PJAX'
[HTTP-Client][handleHeaderResponse] RX: 'Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream'
[HTTP-Client][handleHeaderResponse] RX: 'Cache-Control: no-cache'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: has_recent_activity=1; path=/; expires=Sat, 18 Jan 2020 21:14:30 -0000'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: logged_in=no; domain=.github.com; path=/; expires=Wed, 18 Jan 2040 20:14:31 -0000; secure; HttpOnly'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: _gh_sess=QnEzUU5zaHUxK0VSZnZmaEZ0ZzBVWlphQlRPRjl4Q3R1VUQ5OWpGL2hoUnlka09ZWGZGRGdMdjdpRzkzbDc5bUpHVlJ1RWxzSVdoTUdzbWNMdXN6bVpMcit2S0RRUXNJNm42TEx2T0hERmZ6SVN4c3dtcW9ENVE1YnY1VnRYZXZRbExuc0s1bm9SUDN0d0hNa01WeE5RPT0tLUhocVBtK085R3gyZXZ0R2w2ckVTSHc9PQ%3D%3D--110cf0f9377f64a3ab097dc5f3293e84ea90c314; path=/; secure; HttpOnly'
[HTTP-Client][handleHeaderResponse] RX: 'X-Request-Id: 2ad7eeb6-73ba-492f-944e-0c34f7871ed4'
[HTTP-Client][handleHeaderResponse] RX: 'Strict-Transport-Security: max-age=31536000; includeSubdomains; preload'
[HTTP-Client][handleHeaderResponse] RX: 'X-Frame-Options: deny'
[HTTP-Client][handleHeaderResponse] RX: 'X-Content-Type-Options: nosniff'
[HTTP-Client][handleHeaderResponse] RX: 'X-XSS-Protection: 1; mode=block'
[HTTP-Client][handleHeaderResponse] RX: 'Expect-CT: max-age=2592000, report-uri="https://api.github.com/_private/browser/errors"'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Security-Policy: default-src 'none'; base-uri 'self'; block-all-mixed-content; connect-src 'self' uploads.github.com www.githubstatus.com collector.githubapp.com api.github.com www.google-analytics.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com wss://live.github.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com; frame-ancestors 'none'; frame-src render.githubusercontent.com; img-src 'self' data: github.githubassets.com identicons.github.com collector.githubapp.com github-cloud.s3.amazonaws.com *.githubusercontent.com; manifest-src 'self'; media-src 'none'; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com'
[HTTP-Client][handleHeaderResponse] RX: 'Vary: Accept-Encoding'
[HTTP-Client][handleHeaderResponse] RX: 'X-GitHub-Request-Id: E6C6:12AE:1329874:1D133A7:5E236725'
[HTTP-Client][handleHeaderResponse] RX: ''
[HTTP-Client][handleHeaderResponse] code: 302
[HTTP-Client][handleHeaderResponse] Transfer-Encoding: chunked
[HTTP-Client][sendRequest] following redirect:: 'https://github-production-release-asset-2e65be.s3.amazonaws.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream' redirCount: 1
[HTTP-Client][end] still data in buffer (68), clean up.
[HTTP-Client][end] tcp keep open for reuse
[HTTP-Client][begin] url: https://github-production-release-asset-2e65be.s3.amazonaws.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][begin] host: github-production-release-asset-2e65be.s3.amazonaws.com port: 443 url: /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][sendRequest] type: 'GET' redirCount: 1
[HTTP-Client] connect: already connected, reusing connection
[HTTP-Client] sending request header
-----
GET /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream HTTP/1.1
Host: github-production-release-asset-2e65be.s3.amazonaws.com
User-Agent: ESP8266HTTPClient
Connection: keep-alive
Accept-Encoding: identity;q=1,chunked;q=0.1,*;q=0
Content-Length: 0

-----
[HTTP-Client][handleHeaderResponse] RX: 'HTTP/1.1 301 Moved Permanently'
[HTTP-Client][handleHeaderResponse] RX: 'Content-length: 0'
[HTTP-Client][handleHeaderResponse] RX: 'Location: https://github.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream'
[HTTP-Client][handleHeaderResponse] RX: ''
[HTTP-Client][handleHeaderResponse] code: 301
[HTTP-Client][sendRequest] following redirect:: 'https://github.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream' redirCount: 2
[HTTP-Client][end] tcp keep open for reuse
[HTTP-Client][begin] url: https://github.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][begin] host: github.com port: 443 url: /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][sendRequest] type: 'GET' redirCount: 2
[HTTP-Client] connect: already connected, reusing connection
[HTTP-Client] sending request header
-----
GET /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream HTTP/1.1
Host: github.com
User-Agent: ESP8266HTTPClient
Connection: keep-alive
Accept-Encoding: identity;q=1,chunked;q=0.1,*;q=0
Content-Length: 0

-----
[HTTP-Client][handleHeaderResponse] RX: 'HTTP/1.1 404 Not Found'
[HTTP-Client][handleHeaderResponse] RX: 'Date: Sat, 18 Jan 2020 20:14:32 GMT'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Type: text/html; charset=utf-8'
[HTTP-Client][handleHeaderResponse] RX: 'Transfer-Encoding: chunked'
[HTTP-Client][handleHeaderResponse] RX: 'Server: GitHub.com'
[HTTP-Client][handleHeaderResponse] RX: 'Status: 404 Not Found'
[HTTP-Client][handleHeaderResponse] RX: 'Vary: X-PJAX'
[HTTP-Client][handleHeaderResponse] RX: 'Cache-Control: no-cache'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: has_recent_activity=1; path=/; expires=Sat, 18 Jan 2020 21:14:32 -0000'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: _octo=GH1.1.1957086682.1579378472; domain=.github.com; path=/; expires=Tue, 18 Jan 2022 20:14:32 -0000'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: _gh_sess=RnVtMU4wZGN5OU5sdmFOUWNkb0JwaGlIdEw2MC8zWTFEZXFHdEFDZjlTdGpTMGdrenI4T3ZBSGtyNmhRMDBibU5PWW5vcUlQR2htem9DMmxMYk5DYmpsYUJwL0VnTXNXYytaNHMxeDlJM3crdDc2UldGeWJ5SFI4OHVjZzk3S3ZLOXYzY1N4d3hFQjdudm54c3dzYjRnPT0tLURST1lVaGEzMDVpSHlEaEh4UDEvaEE9PQ%3D%3D--a1c79406044787d94dbc38613f65d152e8bd6b4f; path=/; secure; HttpOnly'
[HTTP-Client][handleHeaderResponse] RX: 'X-Request-Id: 513878d7-f6bd-430d-8426-cbbd3f99d12a'
[HTTP-Client][handleHeaderResponse] RX: 'Strict-Transport-Security: max-age=31536000; includeSubdomains; preload'
[HTTP-Client][handleHeaderResponse] RX: 'X-Frame-Options: deny'
[HTTP-Client][handleHeaderResponse] RX: 'X-Content-Type-Options: nosniff'
[HTTP-Client][handleHeaderResponse] RX: 'X-XSS-Protection: 1; mode=block'
[HTTP-Client][handleHeaderResponse] RX: 'Referrer-Policy: origin-when-cross-origin, strict-origin-when-cross-origin'
[HTTP-Client][handleHeaderResponse] RX: 'Expect-CT: max-age=2592000, report-uri="https://api.github.com/_private/browser/errors"'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Security-Policy: default-src 'none'; base-uri 'self'; block-all-mixed-content; connect-src 'self' uploads.github.com www.githubstatus.com collector.githubapp.com api.github.com www.google-analytics.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com wss://live.github.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com; frame-ancestors 'none'; frame-src render.githubusercontent.com; img-src 'self' data: github.githubassets.com identicons.github.com collector.githubapp.com github-cloud.s3.amazonaws.com *.githubusercontent.com; manifest-src 'self'; media-src 'none'; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com'
[HTTP-Client][handleHeaderResponse] RX: 'X-GitHub-Request-Id: E6C6:12AE:1329988:1D134EA:5E236727'
[HTTP-Client][handleHeaderResponse] RX: ''
[HTTP-Client][handleHeaderResponse] code: 404
[HTTP-Client][handleHeaderResponse] Transfer-Encoding: chunked
[HTTPS] GET... code: 404
[HTTP-Client][end] still data in buffer (512), clean up.
pm open,type:2 0
[HTTP-Client][end] tcp keep open for reuse
********************************************************** Wait 10s before next round...

[devyte]

@liebman at a glance I see that there are redirects involved. If memory serves, you were involved with httpClient redirects in the past. Could you please help with this one?

[liebman]

Yes - this looks like a bug. From the log it's re-using the connection even tho the host changes and it should have closed and opened a new one. I'll try to look at this when I get home this afternoon.

[devyte]

@liebman thanks for the help!