openai/gsm8k 已完整同步
Dataset Card for GSM8K
Table of Contents
- Dataset Description
- Dataset Summary
- Supported Tasks
- Languages
- Dataset Structure
- Data Instances
- Data Fields
- Data Splits
- Dataset Creation
- Curation Rationale
- Source Data
- Annotations
- Personal and Sensitive Information
- Considerations for Using the Data
- Social Impact of Dataset
- Discussion of Biases
- Other Known Limitations
- Additional Information
- Dataset Curators
- Licensing Information
- Citation Information
Dataset Description
- Homepage: https://openai.com/blog/grade-school-math/
- Repository: https://github.com/openai/grade-school-math
- Paper: https://arxiv.org/abs/2110.14168
- Leaderboard: [Needs More Information]
- Point of Contact: [Needs More Information]
Dataset Summary
GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of question answering on basic mathematical problems that require multi-step reasoning.
- These problems take between 2 and 8 steps to solve.
- Solutions primarily involve performing a sequence of elementary calculations using basic arithmetic operations (+ − ×÷) to reach the final answer.
- A bright middle school student should be able to solve every problem: from the paper, "Problems require no concepts beyond the level of early Algebra, and the vast majority of problems can be solved without explicitly defining a variable."
- Solutions are provided in natural language, as opposed to pure math expressions. From the paper: "We believe this is the most generally useful data format, and we expect it to shed light on the properties of large language models’ internal monologues""
Supported Tasks and Leaderboards
This dataset is generally used to test logic and math in language modelling. It has been used for many benchmarks, including the LLM Leaderboard.
Languages
The text in the dataset is in English. The associated BCP-47 code is en.
Dataset Structure
Data Instances
For the main configuration, each instance contains a string for the grade-school level math question and a string for the corresponding answer with multiple steps of reasoning and calculator annotations (explained [here](https://github.com/openai/gr
7 个文件
浏览文件数据集版权信息
本数据集的许可证为 MIT License。如有违反相关条款,请联系 WEHUB,我们将及时处理。 查看许可证
通过 WeHub CLI 下载当前数据集快照。下列命令会固定为当前页面展示的数据版本(如果页面提供版本)。文件字节由本机直连存储下载,浏览器不会签发或保存下载链接。
前置要求
需要 Node.js 18 及以上,以及 npm(或 npx)。
1. 安装 CLI
npm install -g wehub-cli@latest
2. 下载此数据集
wehub datasets download ds_openai_gsm8k_0d4b62d539 --revision 740312add88f781978c0658806c59bc2815b9866 --output ./ds_openai_gsm8k_0d4b62d539
若中断或部分失败,在同一目录重新执行同一命令即可续传。默认会校验 SHA-256。
免全局安装
npx --yes wehub-cli@latest datasets download ds_openai_gsm8k_0d4b62d539 --revision 740312add88f781978c0658806c59bc2815b9866 --output ./ds_openai_gsm8k_0d4b62d539
高级选项
以下为 wehub datasets download 已支持的参数示例:
强制重新下载,不复用已校验的本地文件
wehub datasets download ds_openai_gsm8k_0d4b62d539 --revision 740312add88f781978c0658806c59bc2815b9866 --output ./ds_openai_gsm8k_0d4b62d539 --overwrite
仅包含匹配路径
wehub datasets download ds_openai_gsm8k_0d4b62d539 --revision 740312add88f781978c0658806c59bc2815b9866 --output ./ds_openai_gsm8k_0d4b62d539 --include "*.jsonl"
排除匹配路径
wehub datasets download ds_openai_gsm8k_0d4b62d539 --revision 740312add88f781978c0658806c59bc2815b9866 --output ./ds_openai_gsm8k_0d4b62d539 --exclude "*.md"
提高并发下载数
wehub datasets download ds_openai_gsm8k_0d4b62d539 --revision 740312add88f781978c0658806c59bc2815b9866 --output ./ds_openai_gsm8k_0d4b62d539 --jobs 8
完整帮助:wehub datasets download --help