* Add multi-dictionary preprocessing and training
* Fix lang_map.json copy
* Add language embed (inject to txt_embed) for acoustic models
* Save language sequence in variance preprocessing
* Display merged phoneme groups properly in distribution plots
* Add multi-dictionary inference
* Save original phoneme texts for duration plots
* Fix duration plots displaying bug
* Explicit `languages` argument passing
* Add language embed (inject to txt_embed) for variance models
* Fix argument passing
* Add log for lang_map.json copy
* Add language embedding scale
* Add language embedding type
* Preprocessing: only apply lang embed on cross-lingual phonemes
* Inference: only apply lang embed on cross-lingual phonemes
* Revert "Add language embedding type"
This reverts commit 655e9ba9611861793297956e79ccbf329313d7f2.
* Revert lang_embed_scale
* Adapt ONNX exporters for multi-language models
* Refactor configuration schemas for datasets
* Add check of existence for merged phonemes
* Fix spk_id assignment
* Fix languages.json filename
* Fix `languages` key in dsconfig.yaml
* Set `use_lang_id` to false if there are no cross-lingual phonemes
* Support defining extra phonemes
* Refactor configs
* Prefer file copies in work_dir when loading dictionaries
* Fix cannot locate dictionary
* Fix unexpected loading error when dictionary changes
* Update toplevel.py (#219)
* Fix unexpected config passing
* Update lynxnet backbone (#228)
* Change the injection method of conditions on lynxnet (#225)
* update configurations for new-lynxnet
* update configurations for new-lynxnet
* update configurations for new-lynxnet
---------
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
* Improve fastspeech2 encoder using Rotary Position Embedding (RoPE) in multi-head self-attention (#234)
* update multi-head self attention with RoPE
* RoPE onnx (#230)
* fix requirements.txt (#233)
* fix rope for melody encoder
* support swiglu activation for ffn
* update dependencies
---------
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
* support mini-nsf-hifigan vocoder
* discard negative pad
* fix MHA inference using low torch version
* Fix missing phoneme list sorting
* Fix single-language dictionary parsing language tag
* Add `pitch_controllable` flag to vocoder exporter
(cherry picked from commit a6deb6b5c3)
* support noise injection
* Allow merging global phonemes and language-specific phonemes
* Check for conflicts between short names and global tags
* Finish documentation for multi-dictionary
---------
Co-authored-by: Anjo <87346264+AnAndroNerd@users.noreply.github.com>
Co-authored-by: yxlllc <33565655+yxlllc@users.noreply.github.com>
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
Co-authored-by: yxlllc <llc1995@sina.com>
* More metadata when binarize
* Picklable AttrDict
* Support other notion of 'sizes'
* Better strategy getter, Ds TB logger, and eval batch sampler.
* Add title to plots and specify figsize
* Unify batch sampler and bug fixes
* Batch and multi-device validation
* Fix imports
* Fix deadlock under multigpu and resume from ckpt
* Remove unnecessary if in base_dataset
* Move build loss to finish init and ft to build model
* Prevent repeated valid item
* Remove optimizer_idx to support lightning 2.1
* Warning message fix
* Fix val error when aux is off
* Rename fields in metadata and add doc
* Adjust respective duration logging for each speaker
* val persisent worker, module list ordering, update doc
---------
Co-authored-by: yqzhishen <yangqian_1015@icloud.com>
Kakaru