James Reed
fafc827d64
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com> Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
27 lines
530 B
ReStructuredText
27 lines
530 B
ReStructuredText
Pipeline Parallelism
|
|
====================
|
|
|
|
Model Specification
|
|
--------------------
|
|
.. autoclass:: deepspeed.pipe.PipelineModule
|
|
:members:
|
|
|
|
.. autoclass:: deepspeed.pipe.LayerSpec
|
|
:members:
|
|
|
|
.. autoclass:: deepspeed.pipe.TiedLayerSpec
|
|
:members:
|
|
|
|
.. autoclass:: deepspeed.runtime.pipe.ProcessTopology
|
|
:members:
|
|
|
|
Training
|
|
--------
|
|
.. automodule:: deepspeed.runtime.pipe.engine
|
|
:members:
|
|
|
|
Extending Pipeline Parallelism
|
|
------------------------------
|
|
.. automodule:: deepspeed.runtime.pipe.schedule
|
|
:members:
|