requests: Upgrade to 2.26.0, add new (unvendored) deps

[mkoeppe]

(split out from #31280)

As noted in #31280 comment:65, this helps
for #30768 and hence for Python 3.10 compatibility.

Three packages are added, each becoming
a standard spkg.

charset-normalizer

Added under the name charset_normalizer.

"Charset Detection, for Everyone"

A library that helps you read text from an unknown
charset encoding.

[...] All IANA character set names for which the
Python core library provides codecs are supported.

idna

Support for the Internationalised Domain Names
in Applications (IDNA) protocol as specified
in RFC 5891. This is the latest version of the
protocol and is sometimes referred to as “IDNA 2008”.

This library also provides support
for Unicode Technical Standard 46,
Unicode IDNA Compatibility Processing.

This acts as a suitable replacement for the
“encodings.idna” module that comes with the
Python standard library, but which only supports
the old, deprecated IDNA specification (RFC 3490).

urllib3

a powerful, user-friendly HTTP client for Python.
[...]
urllib3 brings many critical features that are
missing from the Python standard libraries:

• Thread safety.
• Connection pooling.
• Client-side SSL/TLS verification.
• File uploads with multipart encoding.
• Helpers for retrying requests and dealing with HTTP redirects.
• Support for gzip, deflate, and brotli encoding.
• Proxy support for HTTP and SOCKS.
• 100% test coverage.

CC: @fchapoton @slel @dimpase

Component: packages: standard

Author: Matthias Koeppe

Branch/Commit: 8cc62de

Reviewer: Dima Pasechnik

Issue created by migration from https://trac.sagemath.org/ticket/32372

[mkoeppe]

Branch: u/mkoeppe/requests__upgrade_to_2_26_0__add_new__unvendored__deps

[mkoeppe]

Author: Matthias Koeppe

[mkoeppe]

New commits:

764b341	build/pkgs/chardet: New (unvendored from requests)
5b5e721	build/pkgs/idna: New (unvendored from requests)
649f5af	build/pkgs/urllib3: New (unvendored from requests)
b8cf517	build/pkgs/requests: Update to 2.26.0
b5dc185	build/pkgs/requests/dependencies: Add unvendored packages
9a05776	build/pkgs/urllib3: Update to 1.26.6

[mkoeppe]

Commit: 9a05776

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

fbb7da9	build/pkgs/idna: Update to 3.2
81af3bf	build/pkgs/requests/checksums.ini: Add upstream_url

[sagetrac-git]

Changed commit from 9a05776 to 81af3bf

[mkoeppe]

comment:4

requests 2.26.0 has switched from chardet to charset_normalizer
https://docs.python-requests.org/en/master/community/updates/#id1

[sagetrac-git]

Changed commit from 81af3bf to 8cc62de

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

8c8a766	build/pkgs/charset_normalizer: New, use it instead of chardet as a dependency of requests
8cc62de	build/pkgs/chardet: Remove

[slel]

comment:7

Would a round of github-actions be a good way
to start a review of this?

[fchapoton]

comment:8

I have launched one some hours ago. It should take 1 day or more.

https://github.com/sagemath/sagetrac-mirror/actions/runs/1153312296

[fchapoton]

comment:9

apparently, the github CI is not able to use the "upstream_url" for "charset_normalizer"

[mkoeppe]

comment:10

The download failure on ubuntu-trusty-standard https://github.com/sagemath/sagetrac-mirror/runs/3388617349?check_suite_focus=true

  [urllib3-1.26.6]   [xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx]
  [urllib3-1.26.6]   ERROR [transfer|run:135]: [Errno 403] SNI is required: '//pypi.io/packages/source/u/urllib3/urllib3-1.26.6.tar.gz'
  [urllib3-1.26.6]   ************************************************************************
  [urllib3-1.26.6]   Traceback (most recent call last):
  [urllib3-1.26.6]     File "/sage/build/bin/../sage_bootstrap/download/cmdline.py", line 126, in run_safe
  [urllib3-1.26.6]       run()

is new (and unrelated to #32403)

[mkoeppe]

comment:11

This appears to be from pypi/support#978 ("Deprecation of non-SNI compatible clients")

[mkoeppe]

comment:12

I've opened #32405 for this failure; it has no technical relation to the present ticket.

[dimpase]

Reviewer: Dima Pasechnik

[dimpase]

comment:14

lgtm

[mkoeppe]

comment:15

Thanks!

[vbraun]

Changed branch from u/mkoeppe/requests__upgrade_to_2_26_0__add_new__unvendored__deps to 8cc62de