Adriane Boyd 0c25725359 Update Tokenizer.explain for special cases with whitespace (#13086) ...

* Update Tokenizer.explain for special cases with whitespace

Update `Tokenizer.explain` to skip special case matches if the exact
text has not been matched due to intervening whitespace.

Enable fuzzy `Tokenizer.explain` tests with additional whitespace
normalization.

* Add unit test for special cases with whitespace, xfail fuzzy tests again

2023-11-06 17:29:59 +01:00

..

__init__.py

Revert #4334

2019-09-29 17:32:12 +02:00

sun.txt

Revert #4334

2019-09-29 17:32:12 +02:00

test_exceptions.py

Configure isort to use the Black profile, recursively isort the spacy module (#12721)

2023-06-14 17:48:41 +02:00

test_explain.py

Update Tokenizer.explain for special cases with whitespace (#13086)

2023-11-06 17:29:59 +01:00

test_naughty_strings.py

Merge branch 'develop' into master-tmp

2020-09-04 13:15:36 +02:00

test_tokenizer.py

Configure isort to use the Black profile, recursively isort the spacy module (#12721)

2023-06-14 17:48:41 +02:00

test_urls.py

Configure isort to use the Black profile, recursively isort the spacy module (#12721)

2023-06-14 17:48:41 +02:00

test_whitespace.py

Merge branch 'develop' into master-tmp

2020-09-04 13:15:36 +02:00