github-featured / apify--crawlee

发布

0 发布 649 Git 标签

RSS 订阅源
  • v0.5.0 eb4bbfceae
    比较

    Adding kvstores datasets autoscaledpool etc... (#24)

    frostbyte_neo 发布于 2018-02-09 08:26:56 +00:00

    • Adding kvstores datasets autoscaledpool etc...

    • Adding a request class

    • Adding request list

    • Initial version of settings rotator

    • Adding test for load from external request list and regex

    • Adding test for load from external request list and regex

    • Adding getApifyProxyUrl

    • Adding Puppeteer Pool

    • Runnighn destroy automatically in autoscaled pool

    • Adding puppeteer crawler

    • Adding TODO

    • Adding a request queue

    • Adding a bluebird import into puppeteer_crawler

    • Adding a bluebird import into puppeteer_crawler

    • Commenting out pageHandleFunction check

    • Feedback to crawler SDK development, rewritten RequestList (#25)

    • Feedback to crawler SDK development, rewritten RequestList

    • Feedback to crawler SDK development

    • Adding comment

    • Documenting

    • Documenting

    • Documenting, finalizing based on PR

    • Implementing and documenting remaining classes

    • Updating client

    • Fixing puppeteer tests

    • Adding comment

    • Increasing version and adding some debug logs

    • Not killing instance twice

    • Commenting out part of the PuppeteerPool test

    下载附件