461d641f00
fix an outdated doc wrt CUDA_VISIBLE_DEVICES ( #7058 )
...
@jeffra and I fixed this many years ago, so bringing this doc to a
correct state.
---------
Signed-off-by: Stas Bekman <stas@stason.org >
2025-02-20 15:27:54 +00:00
5e16f255a6
docs: fix HF links ( #6780 )
...
The current link
https://huggingface.co/docs/transformers/main_classes/deepspeed is very
unhelpful.
It turns out in the past it had some guides:
https://huggingface.co/docs/transformers/v4.27.1/main_classes/deepspeed#shared-configuration
Later it's refreshed and moved to
https://huggingface.co/docs/transformers/deepspeed
2024-11-25 10:10:08 -08:00
405b6d5e33
Add the accelerator setup guide link in Getting Started page ( #6452 )
...
Add the link of
https://www.deepspeed.ai/tutorials/accelerator-setup-guide/ into the
installation section in Getting Started page so that users can easily
find the doc.
Signed-off-by: roger feng <roger.feng@intel.com >
2024-08-28 16:55:33 +00:00
1041c8a172
Add documentation for launcher without SSH ( #6455 )
...
#5728
---------
Co-authored-by: Logan Adams <loadams@microsoft.com >
2024-08-28 15:28:10 +00:00
d1f1d45f4b
Update broken link in docs ( #4822 )
...
resolves #4821
2023-12-15 13:02:17 -08:00
6580a2db17
Allow user to select name of .deepspeed_env ( #4006 )
...
* formatting
* Formatting
* arg formatting
* Allow user to select file
* Add docs
* Switch environment variable name to to match other existing envvars
* Handle if the user enters a path or a filename
* Clarify in docs that you can enter either a file or a path
2023-07-20 22:41:58 +00:00
044dd0e2c3
Fix url in getting-started guide (docs) ( #3768 )
2023-06-19 11:23:00 -07:00
908d616072
Website posts and tutorial improvements ( #1799 )
...
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
2022-03-11 15:00:32 -08:00
ac71a1a461
[docker] simplify and update rocm dockerfile ( #1819 )
2022-03-09 15:23:27 -08:00
d0ab722427
Various small documentation text improvements ( #1665 )
...
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
2022-01-03 10:28:43 -08:00
6924d840ac
adjust azureml-examples links ( #1015 )
...
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
2021-06-08 09:33:26 -07:00
14a50c68c3
add ds integrations ( #963 )
...
Co-authored-by: Sean Naren <sean@grid.ai >
Co-authored-by: Sean Naren <sean@grid.ai >
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
2021-04-27 15:18:22 -07:00
c83e49f9ed
update lr scheduler doc for doing per step or epoch update ( #913 )
...
* update lr scheduler doc for doing per step or epoch update
* work
* trigger build
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com >
2021-04-14 14:31:39 -07:00
ab5534fc4c
Add link to AML examples. ( #916 )
...
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
2021-04-02 13:53:30 -07:00
7f03282c51
[debug utils] see_memory_usage fixes ( #890 )
...
* see_memory_usage fixes
* didn't expect pt-1.2
* fix the order of things
* fix the order of things
2021-03-25 05:49:11 -07:00
9e9f8cbed0
[doc] launcher ( #868 )
...
As discussed in https://github.com/microsoft/DeepSpeed/issues/662 this PR modifies the doc:
* explains what to use instead of CUDA_VISIBLE_DEVICES
* puts the `--hostfile` cl arg in the correct place in the invocation script
Fixes: https://github.com/microsoft/DeepSpeed/issues/662
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
2021-03-18 08:58:23 -07:00
7eb083c221
document the requirement to call for all ranks ( #801 )
2021-02-26 13:07:23 -08:00
828d75bad7
document deepspeed.initialize() ( #644 )
...
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
2021-01-08 10:39:39 -08:00
7435b2f10a
Ability to initialize distributed backend outside deepspeed runtime ( #608 )
2020-12-17 23:17:19 -08:00
17f36f1b2e
[doc] typo fix and clarification ( #563 )
...
This PR:
* fixes a misspelled method name
* also `( () )` doesn't read too well, until one reads the code and understands that it's not a formatting bug. I proposed to simply say that it's a callable object.
2020-11-27 21:05:27 -08:00
31f46feee2
DeepSpeed JIT op + PyPI support ( #496 )
...
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com >
Co-authored-by: Reza Yazdani <reyazda@microsoft.com >
2020-11-12 11:51:38 -08:00
01726ce2b8
Add 1-bit Adam support to DeepSpeed ( #380 )
...
* 1-bit adam (#353 )
Co-authored-by: Jeff Rasley <jerasley@microsoft.com >
Co-authored-by: Your Name <you@example.com >
Co-authored-by: tanghl1994 <htang14@ur.rochester.edu >
Co-authored-by: Hank <tanghl1994@gmail.com >
Co-authored-by: root <root@node2x12b.cs.rochester.edu >
Co-authored-by: Ammar Ahmad Awan <awan.ammar@microsoft.com >
2020-09-09 14:37:37 -07:00
97c5427372
Fixing a typo ( #303 )
2020-07-28 14:24:12 -07:00
f2ac7eafd5
ZeRO-2 ( #217 )
...
Updates for ZeRO stage 2 + ZeRO stage 1 w. RS
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com >
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com >
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com >
Co-authored-by: Elton Zheng <eltonz@microsoft.com >
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com >
Co-authored-by: yuxionghe <yuxhe@microsoft.com >
Co-authored-by: Arash Ashari <arashari@microsoft.com >
2020-05-19 01:00:53 -07:00
a0cd61e857
Moved environment variable docs. ( #203 )
2020-04-27 14:27:04 -07:00
1496247a19
JSON configuration cleanup. ( #151 )
...
* Better config filename
* Clean up configuration ToC
2020-03-18 10:09:41 -07:00
b84a1fa410
Web edits ( #147 )
2020-03-18 00:30:51 -07:00
4d735946b8
Web edits ( #146 )
...
* Add coming soon to posts
* Add what's new section to main page
2020-03-17 18:23:59 -07:00
5042dc0085
drafting Jekyll webpage ( #143 )
2020-03-17 13:49:48 -07:00
Stas Bekman