github-featured / apify--crawlee

发布

0 发布 649 Git 标签

RSS 订阅源
  • v1.3.0-beta.9 442a7ac7db
    比较

    feat: add `forceUrlEncoding` option to `requestAsBrowser` (#1086)

    frostbyte_neo 发布于 2021-07-08 08:55:47 +00:00

    • fix: fallback to encoded URL in requestAsBrowser

    When request fails and we detect that calling encodeURI on the url would
    escape something, we now automatically fallback to such encoded url.

    Closes #679
    Related #658

    • refactor: add forceUrlEncoding option instead of automatic fallback to encoded urls

    • chore: try to increase test timeout to 1 minute

    • feat: add preNavigationHooks and postNavigationHooks to CheerioCrawler

    • chore: improve docs and naming

    • chore: improve changelog

    下载附件