数据集 / m-a-p/FineFineWeb

m-a-p/FineFineWeb 已完整同步

FineFineWeb: A Comprehensive Study on Fine-Grained Domain Web Corpus

arXiv: Coming Soon

Project Page: Coming Soon

Blog: Coming Soon

Data Statistics

Domain (#tokens/#samples) Iteration 1 Tokens Iteration 2 Tokens Iteration 3 Tokens Total Tokens Iteration 1 Count Iteration 2 Count Iteration 3 Count Total Count
aerospace 5.77B 261.63M 309.33M 6.34B 9100000 688505 611034 10399539
agronomy 13.08B 947.41M 229.04M 14.26B 15752828 2711790 649404 19114022
artistic 178.25B 5.79B 3.75B 187.80B 314279703 16113512 9957104 340350319
astronomy 5.20B 134.39M 54.66M 5.38B 7596521 357647 145832 8100000
atmospheric_science 2.80B 102.04M 259.25M 3.16B 5709537 267789 525969 6503295
automotive 36.72B 436.34M 911.65M 38.07B 60239679 1166729 1535882 62942290
beauty 19.10B 671.88M 1.01B 20.78B 34787376 1808382 2201810 38797568
biology 85.84B 371.29M 776.99M 86.99B 81413569 995384 1350348 83759301
celebrity 9.63B 706.41M 4.22B 14.56B 19831188 1803788 7949240 29584216
chemistry 27.80B 588.92M 131.46M 28.52B 31188189 1499085 328038 33015312
christianity 47.72B 403.68M 732.55M 48.86B 55013147 1349874 2021458 58384479
civil_engineering 8.85B 1.27B 402.91M 10.52B 13591632 2683940 940742 17216314
communication_engineering 9.21B 3.60B 327.66M 13.14B 13001767 5959526 746495 19707788
computer_science_and_technology 194.46B 3.95B 4.76B 203.16B 278420434 10263521 8654255 297338210
design 96.58B 3.80B 450.00M 100.82B 190275603 16653588 2090515 209019706
drama_and_film 19.12B 10.86B 206.27M 30.19B 33117478 18443259 564251 52124988
economics 205.01B 1.23B 2.63B 208.87B 263965085 3874091 5505880 273345056
electronic_science 30.19B 7.76B 482.62M 38.43B 42745767 12572747 1115605 56434119
entertainment 152.92B 1.67B 5.06B 159.65B 256935144 5801081 9648023 272384248
environmental_science 56.98B 1.48B 920.77M 59.37B 84500393 3557056 1966731 90024180
fashion 18.72B 977.27M 264.01M 19.96B 53465628 3926500 1346988 58739116
finance 146.39B 327.45M 1.13B 147.85B 187797764 1295893 3058801 192152458
food 56.10B 136.32M 978.91M 57.22B 96485838 613875 3051981 100151694
gamble 30.12B 696.52M 158.48M 30.98B 24909037 770540 164168 25843745
game 43.47B 2.36B 2.68B 48.51B 65680699 4670033 3720700 74071432
geography 110.18B 1.16B 192.67M 111.53B 161677214 3835932 559447 166072593
health 191.20B 427.93M 18.43B 210.06B 215747152 1291215 23975955 241014322
history 45.27B 1.56B 1.69B 48.52B 55710432 4167508 3463033 63340973
hobby 150.23B 42.78B 44.05B 237.06B 276636362 81360893 71407735 429404990
hydraulic_engineering 57.36M 75.40M 3.65M 136.41M 135079 163299 13453 311831
instrument_science 5.35B 2.02B 165.43M 7.54B 8307736 2904274 462256 11674266
journalism_and_media_communication 440.98B 21.00B 1.55B 463.53B 645801807 50657668 4909008 701368483
landscape_architecture 3.07B 557.66M 64.76M 3.70B 5613141 1138409 166526 6918076
law 128.58B 455.19M 2.38B 131.42B 166473205 1660944 6145032 174279181
library 57.16B 5.01B 36.56M 62.21B 86592305 10440991 153014 97186310
literature 71.07B 7.01B 67.53B 145.61B 71191075 13247806 54760578 139199459
materials_science 17.79B 1.11B 303.66M 19.20B 22136519 1663376 708384 24508279
mathematics

66109 个文件

浏览文件

数据集版权信息

本数据集的许可证为 Apache License 2.0。如有违反相关条款，请联系 WEHUB，我们将及时处理。 查看许可证