Jindřich Bär 6bcd06e668 feat: split enqueueLinks into extractLinks + addRequests (#4010) ...

Moves the `requestManager`-bound enqueueing logic into
`BasicCrawlerContext.addRequests`, and each DOM-aware crawler now
exposes its own `extractLinks()` plus an `enqueueLinks()` that composes
`extractLinks` + `addRequests`.

This aligns the JS implementation with what Python does, to some extent.

Closes #3081

2026-08-18 17:48:52 +02:00

..

crawler-plugins

feat: split enqueueLinks into extractLinks + addRequests (#4010)

2026-08-18 17:48:52 +02:00

accept_user_input.mdx

…

accept_user_input.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

add_data_to_dataset.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

add_data_to_dataset.ts

docs: improve examples (#2504)

2024-05-29 13:32:14 +02:00

basic_crawler.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

basic_crawler.ts

docs: improve examples (#2504)

2024-05-29 13:32:14 +02:00

cheerio_crawler.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

cheerio_crawler.ts

refactor!: Make AutoscaledPool internal (#3947)

2026-08-18 17:48:50 +02:00

crawl_all_links_cheerio.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

crawl_all_links_playwright.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

crawl_all_links_puppeteer.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

crawl_all_links.mdx

feat: split enqueueLinks into extractLinks + addRequests (#4010)

2026-08-18 17:48:52 +02:00

crawl_multiple_urls_cheerio.ts

chore: use biome for code formatting (#2301)

2024-05-22 11:00:43 +02:00

crawl_multiple_urls_playwright.ts

chore: use biome for code formatting (#2301)

2024-05-22 11:00:43 +02:00

crawl_multiple_urls_puppeteer.ts

chore: use biome for code formatting (#2301)

2024-05-22 11:00:43 +02:00

crawl_multiple_urls.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

crawl_relative_links_all.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

crawl_relative_links_same_domain.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

crawl_relative_links_same_hostname.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

crawl_relative_links.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

crawl_single_url.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

crawl_single_url.ts

…

crawl_sitemap_cheerio.ts

feat: robots.txt and sitemap.xml utils (#2214)

2023-12-19 14:08:20 +01:00

crawl_sitemap_playwright.ts

feat: robots.txt and sitemap.xml utils (#2214)

2023-12-19 14:08:20 +01:00

crawl_sitemap_puppeteer.ts

feat: robots.txt and sitemap.xml utils (#2214)

2023-12-19 14:08:20 +01:00

crawl_sitemap.mdx

docs: seo changes (#2588)

2024-07-30 19:13:58 +02:00

crawl_some_links.mdx

feat: split enqueueLinks into extractLinks + addRequests (#4010)

2026-08-18 17:48:52 +02:00

crawl_some_links.ts

feat: simplify enqueueLinks interface (#3533)

2026-08-18 17:48:50 +02:00

export_entire_dataset.mdx

docs: misc outdated/broken example scripts (#2079)

2023-09-14 13:16:21 +02:00

export_entire_dataset.ts

docs: misc outdated/broken example scripts (#2079)

2023-09-14 13:16:21 +02:00

file_download_stream.mdx

docs: file download examples (#2546)

2024-06-24 10:36:40 +02:00

file_download_stream.ts

chore: migrate from eslint/biome to oxlint/oxfmt (#3569)

2026-08-18 17:48:37 +02:00

file_download.mdx

docs: file download examples (#2546)

2024-06-24 10:36:40 +02:00

file_download.ts

chore: fix broken types in docs examples (#3287)

2026-08-18 17:48:34 +02:00

forms.mdx

docs: seo changes (#2588)

2024-07-30 19:13:58 +02:00

forms.ts

chore: use biome for code formatting (#2301)

2024-05-22 11:00:43 +02:00

http_crawler.mdx

docs: seo changes (#2588)

2024-07-30 19:13:58 +02:00

http_crawler.ts

refactor!: Make AutoscaledPool internal (#3947)

2026-08-18 17:48:50 +02:00

jsdom_crawler_react.ts

chore: use biome for code formatting (#2301)

2024-05-22 11:00:43 +02:00

jsdom_crawler.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

jsdom_crawler.ts

refactor!: Make AutoscaledPool internal (#3947)

2026-08-18 17:48:50 +02:00

map_and_reduce.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

map.ts

chore: use biome for code formatting (#2301)

2024-05-22 11:00:43 +02:00

playwright_crawler_firefox.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

playwright_crawler_firefox.ts

docs: add playwright + firefox example (#1535)

2022-09-12 15:48:58 +02:00

playwright_crawler.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

playwright_crawler.ts

feat: split enqueueLinks into extractLinks + addRequests (#4010)

2026-08-18 17:48:52 +02:00

puppeteer_capture_screenshot.mdx

docs: seo changes (#2588)

2024-07-30 19:13:58 +02:00

puppeteer_crawler_crawler_utils_snapshot.ts

…

puppeteer_crawler_page_screenshot.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

puppeteer_crawler_utils_snapshot.ts

…

puppeteer_crawler.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

puppeteer_crawler.ts

feat: split enqueueLinks into extractLinks + addRequests (#4010)

2026-08-18 17:48:52 +02:00

puppeteer_page_screenshot.ts

docs: update examples (#1406)

2022-07-20 01:53:07 +02:00

puppeteer_recursive_crawl.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

puppeteer_recursive_crawl.ts

feat: simplify enqueueLinks interface (#3533)

2026-08-18 17:48:50 +02:00

reduce.ts

chore: use biome for code formatting (#2301)

2024-05-22 11:00:43 +02:00

skip-navigation.mdx

docs: make some examples runnable via Apify (#2076)

2023-09-13 21:47:45 +02:00

skip-navigation.ts

refactor!: Overhaul the StorageClient interface (#3570)

2026-08-18 17:48:44 +02:00