发布

  • feat: add `forceUrlEncoding` option to `requestAsBrowser` (#1086)

    frostbyte_neo 发布于 2021-07-08 08:55:47 +00:00

    • fix: fallback to encoded URL in requestAsBrowser

    When request fails and we detect that calling encodeURI on the url would
    escape something, we now automatically fallback to such encoded url.

    Closes #679
    Related #658

    • refactor: add forceUrlEncoding option instead of automatic fallback to encoded urls

    • chore: try to increase test timeout to 1 minute

    • feat: add preNavigationHooks and postNavigationHooks to CheerioCrawler

    • chore: improve docs and naming

    • chore: improve changelog

    下载附件