Files
shiyu1994 569f89ac07 [CUDA] Multi-GPU for CUDA Version (#6138)
* initialize nccl

* change year in header

* add implementation of nccl gbdt

* add nccl topology

* clean up

* clean up

* set nccl info

* support quantized training with categorical features on cpu

* remove white spaces

* add tests for quantized training with categorical features

* skip tests for cuda version

* fix cases when only 1 data block in row-wise quantized histogram construction with 8 inner bits

* remove useless capture

* fix inconsistency of gpu devices

* fix creating boosting object from file

* change num_gpu to num_gpus in test case

* fix objective initialization

fix lint errors

* fix c++ compilation warning

* fix lint errors

* fix compilation warnings

* change num_gpu to num_gpus in R test case

* add nccl synchronization in tree training

* fix global num data update

* fix ruff-format issues

* use global num data in split finder

* explicit initialization of NCCLInfo members

* fix compilation

* use CUDAVector

* use CUDAVector

* merge master

* use CUDAVector

* use CUDAVector for cuda tree and column data

* update gbdt

* changes for cuda tree

* use CUDAVector for cuda column data

* disable cuda by default

* fix single machine gbdt

* clean up

* fix typo

* fix lint issues

* use num_gpu instead of num_gpus

* fix compilation error

* fix cpp lint errors

* fix reset config for cuda data partition

* fix subrow copy in cuda column data

* fix cmakelint errors

* Update include/LightGBM/config.h

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* Update include/LightGBM/config.h

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* Update include/LightGBM/cuda/cuda_nccl_topology.hpp

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* Update include/LightGBM/config.h

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* Update src/treelearner/cuda/cuda_data_partition.cu

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* Update src/treelearner/cuda/cuda_data_partition.cu

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* Update src/treelearner/cuda/cuda_leaf_splits.cu

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* remove WARPSIZE before #6086 is merged

* Update src/treelearner/cuda/cuda_leaf_splits.cu

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* update docs

* Update src/treelearner/cuda/cuda_leaf_splits.cu

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* update documentation to indicate supporting of multi-node multi-gpu training of CUDA version

* add header guard

* update document for parameters

* fix lint errors

* fix header ordering

* update Nccl to NCCL

---------

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>
2026-03-02 13:18:31 +08:00
..