Docker toomanyrequests limit reached on TravisCI

[peterjc]

Over on biopython/biopython-wheels#12 we've started running into a new Docker failure:

You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limits.

Quoting that URL:

On November 20, 2020, rate limits anonymous and free authenticated use of Docker Hub went into effect. Anonymous and Free Docker Hub users are limited to 100 and 200 container image pull requests per six hours.

Google results suggests that 100 anonymous pulls per 6 hours is per IP address, and thus easily hit from TravisCI.

The consensus seems to be register a Docker Hub account, and use something like this:

echo $DOCKERHUB_TOKEN | docker login --username $DOCKERHUB_USER --password-stdin

Assuming this is probably going to become standard practice for multibuild, we could be consistent about variable names? Presumably each project make its own DockerHub account?

[isuruf]

This happens only for the test image matthewbrett/trusty. manylinux docker images are in quay.io which doesn't have this limitation.

Easiest solution is to move matthewbrett/trusty to quay.io as well.

cc @matthew-brett

[peterjc]

I don't see where the current (non-quay.io) docker image locations are specified, perhaps a default?

[mattip]

The docker image for testing is specified staring here https://github.com/matthew-brett/multibuild/blob/devel/travis_linux_steps.sh#L121. Since the default for docker is to pull from docker hub, the line docker pull matthewbrett/trusty will pull from there. This should be changed to docker pull quay.io/matthewbrett/trusty or whatever the new image is called.

Note that by setting DOCKER_TEST_IMAGE this can be avoided, unfortunately the images I maintain on https://github.com/multi-build/docker-images are also pushed to https://hub.docker.com/u/multibuild

[peterjc]

So first suitable images need to identified on (or existing ones upload to) quay.io before we can change travis_linux_steps.sh to avoid pulling images from Docker Hub?

[mattip]

The images have been uploaded to quay.io and the defaults adjusted accordingly. Closing.