* Refactor some binarizer modules
* Training framework
* Acoustic model training
* Restore config values
* Disable `shuffle_batches`
* Support saving weights only
* Fix metric candidates
* Support console color and wrap empty objects
* Support specifying log dir
* `dask.compute` everything at once to improve perf
* Support nested schedulers
* Support auto resuming from latest checkpoint
* Remove some default values
* Check for weights_only
* Support more flexible optimizer settings
* Fix stuck in DDP (probably)
* Use default monitor candidates
* Support `ReduceLROnPlateau` scheduler
* Require sync with validation for ReduceLROnPlateau
* Print metrics
* Add suggestion to change coverage check option
* Support fine-tuning and parameter freezing
* Move registries
* Edit message
* Fix high memory usage and epoch syncing
* Add `build_xxx_dataset` methods
* Simplify augmentation index
* Fix typo: compact -> compat
* Add rank in file pattern to avoid conflict
* `torch.load` with weights_only=True
* Change to rank_zero_info
* sync_dist=True
* Fix `rank_zero_only.rank` needs to be set before use
* Try to optimize message
* Try to optimize message
* Try to optimize message
* Fix config check failure
* Fix overlapping points on TensorBoard when accumulate_grad_batches > 1
* Support EMA (experimental)
* Rename file
* Rename embedding
* Add comments and type hints
* Clean up and re-organize code
* Rename file
* Rename `used` to `enabled`
* Remove redundant wrapper method
* Fix voicing extraction
* Add augmentation flag and check
* Update tensorboard logging
* Add multi-dictionary preprocessing and training
* Fix lang_map.json copy
* Add language embed (inject to txt_embed) for acoustic models
* Save language sequence in variance preprocessing
* Display merged phoneme groups properly in distribution plots
* Add multi-dictionary inference
* Save original phoneme texts for duration plots
* Fix duration plots displaying bug
* Explicit `languages` argument passing
* Add language embed (inject to txt_embed) for variance models
* Fix argument passing
* Add log for lang_map.json copy
* Add language embedding scale
* Add language embedding type
* Preprocessing: only apply lang embed on cross-lingual phonemes
* Inference: only apply lang embed on cross-lingual phonemes
* Revert "Add language embedding type"
This reverts commit 655e9ba9611861793297956e79ccbf329313d7f2.
* Revert lang_embed_scale
* Adapt ONNX exporters for multi-language models
* Refactor configuration schemas for datasets
* Add check of existence for merged phonemes
* Fix spk_id assignment
* Fix languages.json filename
* Fix `languages` key in dsconfig.yaml
* Set `use_lang_id` to false if there are no cross-lingual phonemes
* Support defining extra phonemes
* Refactor configs
* Prefer file copies in work_dir when loading dictionaries
* Fix cannot locate dictionary
* Fix unexpected loading error when dictionary changes
* Update toplevel.py (#219)
* Fix unexpected config passing
* Update lynxnet backbone (#228)
* Change the injection method of conditions on lynxnet (#225)
* update configurations for new-lynxnet
* update configurations for new-lynxnet
* update configurations for new-lynxnet
---------
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
* Improve fastspeech2 encoder using Rotary Position Embedding (RoPE) in multi-head self-attention (#234)
* update multi-head self attention with RoPE
* RoPE onnx (#230)
* fix requirements.txt (#233)
* fix rope for melody encoder
* support swiglu activation for ffn
* update dependencies
---------
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
* support mini-nsf-hifigan vocoder
* discard negative pad
* fix MHA inference using low torch version
* Fix missing phoneme list sorting
* Fix single-language dictionary parsing language tag
* Add `pitch_controllable` flag to vocoder exporter
(cherry picked from commit a6deb6b5c3)
* support noise injection
* Allow merging global phonemes and language-specific phonemes
* Check for conflicts between short names and global tags
* Finish documentation for multi-dictionary
---------
Co-authored-by: Anjo <87346264+AnAndroNerd@users.noreply.github.com>
Co-authored-by: yxlllc <33565655+yxlllc@users.noreply.github.com>
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
Co-authored-by: yxlllc <llc1995@sina.com>
* Drop support for discrete F0 embedding (reserved in ONNX exporter)
* Drop support for `interp_uv` configuration key
* Drop support for `train_set_name` and `valid_set_name` configuration keys
* Drop support for linear domain of random time stretching augmentation
* Drop support for `num_pad_tokens` configuration key
* Drop support for code backup before training
* Drop support for `ffn_padding` configuration key
* Drop support for random seeding
* Add placeholder to load old checkpoint
* Remove duplicate txt_embed layer (resuming may raise errors)
* Remove migration script and error message for transcriptions.txt
* Remove seed from batch shuffling
* Use direct access on some hparam keys
* Fix duplicate keys in YAML
* Rename `pndm_speedup` to `diff_speedup`
* Add `DeconstructedWaveform` class and base harmonic extraction algorithm (by yxlllc)
* Support tension in acoustic and variance models (experimental)
* Support Kth harmonic extraction
* Use square difference instead
* Support weighted multi-harmonic definition
* Unify all tension domains in one function
* Remove `hparams` from pitch extraction APIs
* Fix KeyError
* More metadata when binarize
* Picklable AttrDict
* Support other notion of 'sizes'
* Better strategy getter, Ds TB logger, and eval batch sampler.
* Add title to plots and specify figsize
* Unify batch sampler and bug fixes
* Batch and multi-device validation
* Fix imports
* Fix deadlock under multigpu and resume from ckpt
* Remove unnecessary if in base_dataset
* Move build loss to finish init and ft to build model
* Prevent repeated valid item
* Remove optimizer_idx to support lightning 2.1
* Warning message fix
* Fix val error when aux is off
* Rename fields in metadata and add doc
* Adjust respective duration logging for each speaker
* val persisent worker, module list ordering, update doc
---------
Co-authored-by: yqzhishen <yangqian_1015@icloud.com>
* Support training variance model with DS files
* Prefer full name matching
* Fix attribute error
* Fix NoneType error
* Add error message if attribute is missing
* Trim ds segment index suffix
* Skip parameter smoothing if loading from DS file
* Change energy and breathiness definition to dB
* Smoothen energy and breathiness
* Smoothen energy and breathiness (acoustic model)
* Update comments
* Support different values of `dilation_cycle_length`
* Add missing `torch.no_grad()`
* Update acoustic_binarizer.py
add "os.path.exists(path)" to determine whether to read "transcriptions.csv" or "transcriptions.txt".
* Update acoustic_binarizer.py
Delete Meta.json related code.
Use pathlib API replacement of os.path.
* 更新notebook
删除生成txt版transcriptions文件相关代码，删除meta.json相关代码。
* fix
多删了个换行，修复一下
yqzhishen