发布

  • [CPU support] Optionally bind each rank to different cores on host (#2881)

    frostbyte_neo 发布于 2023-04-12 23:00:34 +00:00

    • add fallback path for kernels used in megatron

    • temporary numactl WA for SPR 56core

    • adapt core allocation according to number of ranks

    • add switch to turn on numactl

    • detect number of cores on the system

    • allow select a subset of the cores on the system to bind

    • remove unneeded changes

    • use current_env to set OMP_NUM_THREADS in subprocess

    • add test for ds_arguments

    • change --bind_cores_to_rank option to store_true

    • add test for parse_range_list

    • add comment for parse range list

    • add test for parse range list, rewrite parse_range_list

    • fix format error

    • fix format

    • add -m parameter to numactl when necessary

    • Check KMP_AFFINITY to avoid conflict with numactl

    • fix format

    • negative case for parse_range_list

    • detect whether numactl is installed before use numactl to bind cores

    • check numactl with package manager of distro


    Co-authored-by: sdp sdp@aia-sdp-spr-108864.jf.intel.com
    Co-authored-by: Olatunji Ruwase olruwase@microsoft.com

    下载附件