Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Change crawler default settings around userAgent and mobileDevice #292

Merged
merged 3 commits into from
Mar 27, 2024
Merged

Change crawler default settings around userAgent and mobileDevice #292

merged 3 commits into from
Mar 27, 2024

Commits on Mar 27, 2024

  1. Rollback previous changes around the presence of a default user-agent 

    - Remove default userAgent value
- Set a default mobileDevice
- Add back comments explaining that userAgent overrides other settings
- Add back logic around the computation of the userAgentSuffix instead
  of the userAgent
- Add new noMobileDevice argument to not set the default mobileDevice
    @benoit74
    benoit74 committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    3070fe9 View commit details
    Browse the repository at this point in the history

  2. Remove trailing characters when retrieving Browsertrix Crawler version

    @benoit74
    benoit74 committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    e244799 View commit details
    Browse the repository at this point in the history

  3. Upgrade Browsertrix Crawler to 1.0.3

    @benoit74
    benoit74 committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    728784d View commit details
    Browse the repository at this point in the history