unclecode dc5e2a84c9 fix(deep-crawl): best_first keeps boundary page at max_pages (#859) ...

best_first broke out of the batch generator BEFORE yielding the page that hit
max_pages, so it returned max_pages-1 results while BFS/DFS keep the boundary
page. Reorder _arun_best_first to yield the successful result first, then check
the limit and break. Add a parametrized boundary test asserting best_first (and
BFS as reference) yield exactly max_pages.

2026-06-10 04:30:22 +00:00

..

adaptive

…

adversarial

feat: Add DomainMapper for comprehensive domain URL discovery

2026-06-01 12:58:23 +00:00

async

feat: HTTP strategy detects and saves file downloads (CSV, PDF, etc.)

2026-03-16 14:03:43 +00:00

async_assistant

…

browser

…

cache_validation

…

cli

…

deep_crawling

fix(deep-crawl): best_first keeps boundary page at max_pages (#859)

2026-06-10 04:30:22 +00:00

deep_crwaling

…

docker

…

general

…

hub

…

integration

feat: Add DomainMapper for comprehensive domain URL discovery

2026-06-01 12:58:23 +00:00

loggers

…

mcp

…

memory

…

profiler

…

proxy

…

regression

feat: Add DomainMapper for comprehensive domain URL discovery

2026-06-01 12:58:23 +00:00

releases

…

unit

feat: Add DomainMapper for comprehensive domain URL discovery

2026-06-01 12:58:23 +00:00

__init__.py

…

check_dependencies.py

…

docker_example.py

…

test_arun_many.py

…

test_async_logger_stderr.py

fix(logger): route AsyncLogger output to stderr by default

2026-05-14 14:13:30 +03:00

test_bug_batch_1622_1786_1796.py

…

test_cdp_changes.py

…

test_cli_docs.py

…

test_cloud_bugs_batch.py

…

test_config_defaults.py

…

test_config_matching_only.py

…

test_config_selection.py

…

test_docker_api_with_llm_provider.py

…

test_docker.py

…

test_eval_security_adversarial.py

fix(security): block IPv6-mapped IPv4 SSRF bypass

2026-04-20 10:10:59 +00:00

test_issue_1043_mermaid_svg.py

fix: preserve mermaid diagram text from SVGs during scraping (#1043)

2026-03-22 11:43:54 +08:00

test_issue_1213_bm25_dedup.py

fix: deduplicate BM25ContentFilter output (#1213) (#1824)

2026-03-12 14:23:34 +08:00

test_issue_1370_1818_1762_1509.py

fix: screenshot distortion, deep crawl timeout/arun_many, CLI encoding (#1370, #1818, #1509, #1762)

2026-03-12 18:17:13 +08:00

test_issue_1484_css_selector.py

fix: css_selector ignored in LXML scraping for raw:// URLs (#1484)

2026-03-12 20:00:33 +08:00

test_issue_1594_mcp_sse.py

fix: MCP SSE endpoint crash — mount via raw ASGI Route (#1594)

2026-03-12 11:22:48 +00:00

test_issue_1611_llm_provider.py

fix: /llm per-request provider override, Redis config from host/port/password (#1611, #1817)

2026-03-12 15:53:04 +08:00

test_issue_1748_screenshot_scroll_delay.py

…

test_issue_1750_screenshot_scan_full_page.py

…

test_issue_1837_config_list.py

feat: expose arun_many config-list support in Docker API (#1837)

2026-03-23 09:56:53 +08:00

test_issue_1842_browser_none.py

fix: improve browser None guard in create_browser_context (#1842)

2026-03-22 10:45:38 +08:00

test_issue_1848_logger_serialize.py

fix: skip non-allowlisted types in serialization/deserialization (#1848)

2026-03-23 08:17:02 +08:00

test_issue_1850_mcp_sse.py

fix: MCP SSE endpoint crash on Starlette >=0.50 (#1850)

2026-03-23 08:55:41 +08:00

test_link_extractor.py

…

test_llm_extraction_parallel_issue_1055.py

…

test_llm_simple_url.py

…

test_llmtxt.py

…

test_main.py

…

test_markdown_generator_validation_1880.py

fix: validate markdown_generator type in CrawlerRunConfig to catch bad JSON format (#1880)

2026-03-29 07:39:28 +08:00

test_memory_macos.py

…

test_merge_head_data_scoring.py

…

test_multi_config.py

…

test_normalize_url.py

…

test_pr_1290_1668.py

…

test_pr_1435_redirected_status_code.py

…

test_pr_1463_device_scale_factor.py

…

test_pr_1795_1798_1734.py

…

test_prefetch_integration.py

…

test_prefetch_mode.py

…

test_prefetch_regression.py

…

test_preserve_https_for_internal_links.py

…

test_pyopenssl_security_fix.py

…

test_pyopenssl_update.py

…

test_raw_html_browser.py

…

test_raw_html_edge_cases.py

…

test_raw_html_redirected_url.py

…

test_scraping_strategy.py

…

test_source_sibling_selector.py

…

test_table_gfm_compliance.py

…

test_type_annotations.py

fix: correct arun() return type from RunManyReturn to CrawlResultContainer (#1898)

2026-04-06 21:35:17 +08:00

test_virtual_scroll.py

…

test_web_crawler.py

…

test_webhook_feature.sh

…

WEBHOOK_TEST_README.md

…