github-featured/microsoft--unilm
2
0
Fork 0
Code Issues Pull Requests Deployments Models Agent Notes Packages Projects Releases Wiki Activity

Create README.md

Browse Source
This commit is contained in:
gitnlp
2023-12-21 12:44:27 +08:00
committed by GitHub
parent fba678d743
commit 01d91f0496
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
longnet/README.md
+9
View File
@@ -0,0 +1,9 @@
# LongNet: Scaling Transformers to 1,000,000,000 Tokens
- Code release: [https://github.com/microsoft/torchscale](https://github.com/microsoft/torchscale)
- July 2023: release preprint [LongNet: Scaling Transformers to 1,000,000,000 Tokens](https://arxiv.org/abs/2307.02486)
<p>
<a href="https://github.com/microsoft/torchscale/blob/main/LICENSE"><img alt="MIT License" src="https://img.shields.io/badge/license-MIT-blue.svg" /></a>
<a href="https://pypi.org/project/torchscale"><img alt="MIT License" src="https://badge.fury.io/py/torchscale.svg" /></a>
</p>