response.text() crash if body contain non UTF-8 symbol

[Dexus77]

Long story short

Unfortunately the world is not perfect.
Server in body UTF-8 can return non UTF-8 character.

Content-Type: text/html; charset=utf-8

Error: utf-8' codec can't decode byte 0x80 in position 19404: invalid start byte

Expected behaviour

Actual behaviour

Steps to reproduce

Your environment

[kxepal]

I guess, for imperfect servers you should use .read() instead and satinize all the bad symbols in the way you think it's right. I don't think there is a good strategy to deal with non UTF-8 symbols in UTF-8 response except to raise an exception.

[Dexus77]

OK. Thanks for the quick reply.

[lock]

This thread has been automatically locked since there has not been
any recent activity after it was closed. Please open a new issue for
related bugs.

If you feel like there's important points made in this discussion,
please include those exceprts into that new issue.