Files
Steven Liu cde8f1af2b [docs] Model merging (#1423)
* content

* code snippets

* api reference

* update

* feedback

* feedback
2024-02-15 08:13:54 -08:00

1.2 KiB

Model merge

PEFT provides several internal utilities for merging LoRA adapters with the TIES and DARE methods.

autodoc utils.merge_utils.prune

autodoc utils.merge_utils.calculate_majority_sign_mask

autodoc utils.merge_utils.disjoint_merge

autodoc utils.merge_utils.task_arithmetic

autodoc utils.merge_utils.ties

autodoc utils.merge_utils.dare_linear

autodoc utils.merge_utils.dare_ties