1476 Commits

Author SHA1 Message Date
Jianlyu Chen fd1a2bdf69 Merge pull request #1596 from hanhainebula/master
Bump package version to 1.4.2
v1.4.2
2026-08-24 10:54:09 +08:00
hanhainebula cdeb62a825 Bump package version to 1.4.2 2026-08-24 10:53:07 +08:00
Jianlyu Chen 3f8b44a76d Merge pull request #1595 from hanhainebula/master
Fix Transformers 5 tokenizer compatibility
2026-08-24 10:48:44 +08:00
hanhainebula 71fa99750a Fix Transformers 5 tokenizer compatibility 2026-08-24 10:44:25 +08:00
Jianlyu Chen 7b7be6748d Merge pull request #1594 from hanhainebula/master
fix(reranker): normalize model mapping names
v1.4.1
2026-08-23 20:36:55 +08:00
hanhainebula 0752381a23 fix(reranker): normalize model mapping names 2026-08-23 20:35:16 +08:00
Jianlyu Chen 807fc3fcc5 Merge pull request #1593 from hanhainebula/master
fix(reranker): support transformers v5 tokenizer preparation
2026-08-23 20:26:09 +08:00
hanhainebula 0e924f5205 fix(reranker): support transformers v5 tokenizer preparation 2026-08-23 20:17:50 +08:00
Jianlyu Chen a26f9ef85f Merge pull request #1592 from hanhainebula/master
Fix Transformers 5 Trainer compatibility
2026-08-23 19:30:08 +08:00
Jianlyu Chen 981dac2d8d Merge pull request #1580 from Gui-Yue/fix-transformers-v5-gemma-import
Fix Gemma reranker imports with Transformers v5
2026-08-23 19:29:44 +08:00
hanhainebula 5894f91732 Fix Transformers 5 Trainer compatibility 2026-08-23 18:58:54 +08:00
zhengliu 292ad785de Update README.md 2026-08-14 14:16:02 +08:00
zhengliu 92f5289505 Update README_zh.md 2026-08-14 14:13:52 +08:00
Gui-Yue b5a492d86c Fix Gemma reranker imports with Transformers v5 2026-05-19 00:05:59 +08:00
Jianlyu Chen 7ed43d67ec Merge pull request #1575 from hanhainebula/master
documentation / docs (push) Has been cancelled
chore: update version to 1.4.0 in setup.py
v1.4.0
2026-04-22 23:57:32 +08:00
Jianlv Chen a4247c6c99 chore: update version to 1.4.0 in setup.py 2026-04-22 23:56:53 +08:00
Jianlyu Chen 8092277312 Merge pull request #1572 from lnxtree/master
feat(embedder): Add decoder-only pseudo_moe inference with domain routing support
2026-04-22 23:13:06 +08:00
lnxtree d82edd1ed1 fix: add DEFAULT_POOLING_METHOD to PseudoMoELLMEmbedder 2026-04-02 22:06:41 +08:00
lnxtree 0d27243941 test: Add examples of test scripts for pseudoMoE and coir pseudo-moe test entry 2026-04-02 21:19:50 +08:00
lnxtree ab7c252d62 feat(embedder): add decoder-only pseudo_moe inference with domain routing support
- pass domain_for_pseudo_moe through evaluation runner to embedder initialization
  - add new decoder-only embedder implementation for pseudo MoE models
2026-04-01 22:22:01 +08:00
Jianlyu Chen d190647310 Merge pull request #1570 from lnxtree/master
feat: add use_mrl interface of finetune for embedder and truncate_dim for inference of embedder(MRL)
2026-04-01 10:32:52 +08:00
lnxtree ac3e2390e0 feat: add use_mrl interface of finetune for embedder decode_only.icl and encoder_only.base 2026-03-31 21:15:00 +08:00
lnxtree 29d380b9e1 feat: add truncate_dim for evaluation and inference for embedder 2026-03-31 17:10:51 +08:00
lnxtree b09c37751d feat: add the 'use_mrl' interface to the finetune of embedder 2026-03-31 15:35:31 +08:00
Jianlyu Chen f17476f1b4 Merge pull request #1568 from lnxtree/feat-fix-embedder_use_bf16
fix(eval): pass use_bf16 through AbsEvalRunner.get_model and COIR evaluator model initialization
2026-03-27 11:02:15 +08:00
lnxtree 7e53f57f83 Merge branch 'FlagOpen:master' into feat-fix-embedder_use_bf16 2026-03-26 21:00:28 +08:00
lnxtree 2ff964ee32 fix(eval): pass use_bf16 through AbsEvalRunner.get_model and COIR evaluator model initialization 2026-03-26 20:59:03 +08:00
Jianlyu Chen 4bcfc6e180 Merge pull request #1567 from lnxtree/feat-fix-embedder_use_bf16
fix(m3): make bf16 inference/train loading safe and unify numpy conversion
2026-03-26 20:15:09 +08:00
lnxtree 2955a5a6e5 fix(m3): make bf16 inference/train loading safe and unify numpy conversion
- replace m3 embedder .cpu().numpy() paths with base _convert_to_numpy(...) for bf16-safe conversion
  - add torch_dtype plumbing in m3 runner model loading (AutoModel/colbert_linear/sparse_linear) to keep dtype behavior consistent
2026-03-26 19:14:12 +08:00
lnxtree d65ffb17b7 fix(embedder): add _convert_to_numpy in base class and guard bf16->numpy on non-cpu 2026-03-26 15:19:05 +08:00
Jianlyu Chen ac7a2747d3 Merge pull request #1566 from lnxtree/feat-fix-embedder_use_bf16
Feat(embedder) use bf16 and fix the interface of attn_implementation in embedder.decode_only
2026-03-26 14:32:19 +08:00
lnxtree 19edba7b08 feat: fix the interface of attn_implementation in embedder.decode_only.*.load_model and reranker.decode_only.*.load_model 2026-03-26 14:17:14 +08:00
lnxtree 6679caaf65 fix: code format for inference.embedder.decoder_only.icl 2026-03-26 14:00:41 +08:00
lnxtree 5d6fa9a69e fix: add bf16 interface to EncoderOnlyEmbedderM3Runner.get_model 2026-03-26 13:37:05 +08:00
lnxtree 90957832ac feat(embedder): add use_bf16 support and unify inference dtype behavior
add use_bf16 to auto embedder and all embedder constructors
2026-03-26 12:17:14 +08:00
Jianlyu Chen dbc600560b Merge pull request #1563 from therealmichaelberna/transformers-v5-compat
feat: add compatibility with transformers V5
2026-03-10 11:07:48 +08:00
Michael Jay Berna 94993fd299 added init.py to fix import errors 2026-03-09 18:12:33 +00:00
Michael Jay Berna 3893bf2e4e feat: add compatibility with transformers V5 2026-03-05 14:48:52 +00:00
Jianlyu Chen 6fd176266f Merge pull request #1553 from hanhainebula/master
add metric for evaluation: evaluate_recall_cap
2025-12-15 16:51:06 +08:00
hanhainebula d166f499de add metric for evaluation: evaluate_recall_cap 2025-12-15 16:50:02 +08:00
Jianlyu Chen bbc736f188 Merge pull request #1538 from hanhainebula/master
fix bug: pytrec_eval installation issue
2025-10-22 14:10:16 +08:00
hanhainebula 9e9cf5b37c fix bug: pytrec_eval installation issue 2025-10-22 14:09:47 +08:00
hanhainebula 90b12342b7 fix bug: pytrec_eval installation issue 2025-10-22 14:08:51 +08:00
Jianlyu Chen f7cee83657 Merge pull request #1535 from hanhainebula/master
update examples README: support BRIGHT evaluation
2025-10-10 21:13:34 +08:00
hanhainebula 5a5dd621fa update examples README: support BRIGHT evaluation 2025-10-10 21:12:56 +08:00
Jianlyu Chen 971236c869 Merge pull request #1534 from hanhainebula/master
Support evaluation: BRIGHT
2025-10-10 20:21:24 +08:00
hanhainebula 545f0d7fab update examples README: support BRIGHT evaluation 2025-10-10 20:20:48 +08:00
hanhainebula a1befaa641 support evaluation: BRIGHT 2025-10-10 19:17:30 +08:00
hanhainebula 53240c5283 support evaluation: BRIGHT 2025-10-10 16:50:42 +08:00
Jianlyu Chen c56fa29bc2 Merge pull request #1532 from hanhainebula/master
fix bug: safe dist.get_rank()
2025-09-23 23:03:53 +08:00