* Add multi-dictionary preprocessing and training
* Fix lang_map.json copy
* Add language embed (inject to txt_embed) for acoustic models
* Save language sequence in variance preprocessing
* Display merged phoneme groups properly in distribution plots
* Add multi-dictionary inference
* Save original phoneme texts for duration plots
* Fix duration plots displaying bug
* Explicit `languages` argument passing
* Add language embed (inject to txt_embed) for variance models
* Fix argument passing
* Add log for lang_map.json copy
* Add language embedding scale
* Add language embedding type
* Preprocessing: only apply lang embed on cross-lingual phonemes
* Inference: only apply lang embed on cross-lingual phonemes
* Revert "Add language embedding type"
This reverts commit 655e9ba9611861793297956e79ccbf329313d7f2.
* Revert lang_embed_scale
* Adapt ONNX exporters for multi-language models
* Refactor configuration schemas for datasets
* Add check of existence for merged phonemes
* Fix spk_id assignment
* Fix languages.json filename
* Fix `languages` key in dsconfig.yaml
* Set `use_lang_id` to false if there are no cross-lingual phonemes
* Support defining extra phonemes
* Refactor configs
* Prefer file copies in work_dir when loading dictionaries
* Fix cannot locate dictionary
* Fix unexpected loading error when dictionary changes
* Update toplevel.py (#219)
* Fix unexpected config passing
* Update lynxnet backbone (#228)
* Change the injection method of conditions on lynxnet (#225)
* update configurations for new-lynxnet
* update configurations for new-lynxnet
* update configurations for new-lynxnet
---------
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
* Improve fastspeech2 encoder using Rotary Position Embedding (RoPE) in multi-head self-attention (#234)
* update multi-head self attention with RoPE
* RoPE onnx (#230)
* fix requirements.txt (#233)
* fix rope for melody encoder
* support swiglu activation for ffn
* update dependencies
---------
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
* support mini-nsf-hifigan vocoder
* discard negative pad
* fix MHA inference using low torch version
* Fix missing phoneme list sorting
* Fix single-language dictionary parsing language tag
* Add `pitch_controllable` flag to vocoder exporter
(cherry picked from commit a6deb6b5c3)
* support noise injection
* Allow merging global phonemes and language-specific phonemes
* Check for conflicts between short names and global tags
* Finish documentation for multi-dictionary
---------
Co-authored-by: Anjo <87346264+AnAndroNerd@users.noreply.github.com>
Co-authored-by: yxlllc <33565655+yxlllc@users.noreply.github.com>
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
Co-authored-by: yxlllc <llc1995@sina.com>
* Drop support for discrete F0 embedding (reserved in ONNX exporter)
* Drop support for `interp_uv` configuration key
* Drop support for `train_set_name` and `valid_set_name` configuration keys
* Drop support for linear domain of random time stretching augmentation
* Drop support for `num_pad_tokens` configuration key
* Drop support for code backup before training
* Drop support for `ffn_padding` configuration key
* Drop support for random seeding
* Add placeholder to load old checkpoint
* Remove duplicate txt_embed layer (resuming may raise errors)
* Remove migration script and error message for transcriptions.txt
* Remove seed from batch shuffling
* Use direct access on some hparam keys
* Fix duplicate keys in YAML
* Rename `pndm_speedup` to `diff_speedup`
* Add `DeconstructedWaveform` class and base harmonic extraction algorithm (by yxlllc)
* Support tension in acoustic and variance models (experimental)
* Support Kth harmonic extraction
* Use square difference instead
* Support weighted multi-harmonic definition
* Unify all tension domains in one function
* Remove `hparams` from pitch extraction APIs
* Fix KeyError
* More metadata when binarize
* Picklable AttrDict
* Support other notion of 'sizes'
* Better strategy getter, Ds TB logger, and eval batch sampler.
* Add title to plots and specify figsize
* Unify batch sampler and bug fixes
* Batch and multi-device validation
* Fix imports
* Fix deadlock under multigpu and resume from ckpt
* Remove unnecessary if in base_dataset
* Move build loss to finish init and ft to build model
* Prevent repeated valid item
* Remove optimizer_idx to support lightning 2.1
* Warning message fix
* Fix val error when aux is off
* Rename fields in metadata and add doc
* Adjust respective duration logging for each speaker
* val persisent worker, module list ordering, update doc
---------
Co-authored-by: yqzhishen <yangqian_1015@icloud.com>
* Support training variance model with DS files
* Prefer full name matching
* Fix attribute error
* Fix NoneType error
* Add error message if attribute is missing
* Trim ds segment index suffix
* Skip parameter smoothing if loading from DS file
* Change energy and breathiness definition to dB
* Smoothen energy and breathiness
* Smoothen energy and breathiness (acoustic model)
* Update comments
* Support different values of `dilation_cycle_length`
* Add missing `torch.no_grad()`
* Update acoustic_binarizer.py
add "os.path.exists(path)" to determine whether to read "transcriptions.csv" or "transcriptions.txt".
* Update acoustic_binarizer.py
Delete Meta.json related code.
Use pathlib API replacement of os.path.
* 更新notebook
删除生成txt版transcriptions文件相关代码,删除meta.json相关代码。
* fix
多删了个换行,修复一下