net/http: bad handling of HEAD requests with a body

[neild]

HEAD requests may have a body, although RFC 7231 states that "some existing implementations" may reject a HEAD request which contains one.

The net/http package handles HEAD requests with a body in different ways:

• HTTP/1, non-chunked: return a 400 error, close the connection.
• HTTP/1, Content-Encoding: chunked: ignore the chunked body (trying to parse it as the next request on the connection). Clearly buggy. Not a request smuggling mechanism, since the chunked body data can never be a valid HTTP request.
• HTTP/2: close the stream with an error.

We should either support HEAD requests with a body in all circumstances, or fix the HTTP/1 chunked case and add a test for the HTTP/1 identity case. I think support, but I could be argued into always-reject on the grounds that nobody ever actually sends a body in a HEAD request.

Thanks to Bahruz Jabiyev, Tommaso Innocenti, Anthony Gavazzi, Steven Sprecher, and Kaan Onarlioglu for reporting this issue.

[gopherbot]

Change https://go.dev/cl/418614 mentions this issue: net/http: accept HEAD requests with a body

[gopherbot]

Change https://go.dev/cl/418634 mentions this issue: http2: accept HEAD requests with a body

[nightlyone]

@neild What can be gained in supporting such requests?

I would suggest to continue dropping the body and fix case 2 (trying to parse it as a next request) .

Supporting undefined behaviour seems like a road to incompatibilities.

Are you aware of a use case that relies on that is undefined behaviour or some IETF draft requiring this to work, so that the undefined behaviour becomes standardized soon?

[neild]

There's no undefined behavior here.

The semantics of HEAD requests with a body are undefined--there's no RFC that I know of that defines what that body means--but the mechanics of sending such a request are well-defined. HEAD responses are defined as having no body, but HEAD requests may have one.

The argument I see against supporting HEAD requests with a body is that nobody sends these in practice, so receiving one probably indicates a mistake or malicious behavior of some kind.

The argument for supporting them is that they're valid requests, and that it's more work to reject them than it is to just handle them.

The actual state of support for HEAD-with-a-body in net/http is a bit of a mess as described above, so we need to do something. (The one case I forgot to mention is client behavior: net/http handles sending HEAD-with-a-body fine in all cases I've tested, including HTTP/1, HTTP/2, identity encoding, and chunked encoding.)

[gopherbot]

Change https://go.dev/cl/432197 mentions this issue: all: update vendored golang.org/x/net

[bobby-stripe]

@gopherbot please consider this for backport to 1.19, it's a serious problems with no workaround.

[gopherbot]

Backport issue(s) opened: #56154 (for 1.19).

Remember to create the cherry-pick CL(s) as soon as the patch is submitted to master, according to https://go.dev/wiki/MinorReleases.

[gopherbot]

Change https://go.dev/cl/450515 mentions this issue: doc/go1.20: add release notes for net/http and net/http/httputil

[gopherbot]

Change https://go.dev/cl/457275 mentions this issue: [release-branch.go1.18] net/http: accept HEAD requests with a body

[gopherbot]

Change https://go.dev/cl/457438 mentions this issue: [release-branch.go1.19] net/http: accept HEAD requests with a body

[gopherbot]

Change https://go.dev/cl/457416 mentions this issue: [internal-branch.go1.18-vendor] http2: accept HEAD requests with a body

[gopherbot]

Change https://go.dev/cl/457357 mentions this issue: [internal-branch.go1.19-vendor] http2: accept HEAD requests with a body

[gopherbot]

Change https://go.dev/cl/457596 mentions this issue: [release-branch.go1.18] all: upgrade golang.org/x/net to v0.0.0-20221214163811-6143a133e5c9

[gopherbot]

Change https://go.dev/cl/457556 mentions this issue: [release-branch.go1.19] all: upgrade golang.org/x/net to v0.0.0-20221214163817-183621ab9c4e