You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
By default, when no User-Agent is specified to zimit, no User-Agent is specified to browsertrix crawler and default one is hence used. Only a User-Agent suffix is passed (and hence appended by browsertrix) to
The problem with this is that:
we never know which User-Agent value is used in the end, it is not logged
we have too little control on this User-Agent, there is always a risk it might get broken at some point by a release
We think we should specify our own default User-Agent and pass it to browsertrix in all cases, to ensure reproducible / consistent behaviors.
This is also probably a mandatory change for #227 (or at least it makes it way easier to solve)
The text was updated successfully, but these errors were encountered:
By default, when no User-Agent is specified to zimit, no User-Agent is specified to browsertrix crawler and default one is hence used. Only a User-Agent suffix is passed (and hence appended by browsertrix) to
The problem with this is that:
We think we should specify our own default User-Agent and pass it to browsertrix in all cases, to ensure reproducible / consistent behaviors.
This is also probably a mandatory change for #227 (or at least it makes it way easier to solve)
The text was updated successfully, but these errors were encountered: