NVIDIA 集体通信库 (NCCL) 文档¶
目录
- NCCL 概述
- 设置
- 使用 NCCL
- NCCL API
- 通信器创建和管理函数
- ncclGetLastError
- ncclGetErrorString
- ncclGetVersion
- ncclGetUniqueId
- ncclCommInitRank
- ncclCommInitAll
- ncclCommInitRankConfig
- ncclCommInitRankScalable
- ncclCommSplit
- ncclCommFinalize
- ncclCommDestroy
- ncclCommAbort
- ncclCommGetAsyncError
- ncclCommCount
- ncclCommCuDevice
- ncclCommUserRank
- ncclCommRegister
- ncclCommDeregister
- ncclMemAlloc
- ncclMemFree
- 集体通信函数
- 组调用
- 点对点通信函数
- 类型
- 用户定义的归约运算符
- 通信器创建和管理函数
- 从 NCCL 1 迁移到 NCCL 2
- 示例
- NCCL 和 MPI
- 环境变量
- 系统配置
- NCCL_SOCKET_IFNAME
- NCCL_SOCKET_FAMILY
- NCCL_SOCKET_RETRY_CNT
- NCCL_SOCKET_RETRY_SLEEP_MSEC
- NCCL_SOCKET_NTHREADS
- NCCL_NSOCKS_PERTHREAD
- NCCL_CROSS_NIC
- NCCL_IB_HCA
- NCCL_IB_TIMEOUT
- NCCL_IB_RETRY_CNT
- NCCL_IB_GID_INDEX
- NCCL_IB_ADDR_FAMILY
- NCCL_IB_ADDR_RANGE
- NCCL_IB_ROCE_VERSION_NUM
- NCCL_IB_SL
- NCCL_IB_TC
- NCCL_IB_FIFO_TC
- NCCL_IB_RETURN_ASYNC_EVENTS
- NCCL_OOB_NET_ENABLE
- NCCL_OOB_NET_IFNAME
- NCCL_UID_STAGGER_THRESHOLD
- NCCL_UID_STAGGER_RATE
- NCCL_NET
- NCCL_NET_PLUGIN
- NCCL_TUNER_PLUGIN
- NCCL_PROFILER_PLUGIN
- NCCL_IGNORE_CPU_AFFINITY
- NCCL_CONF_FILE
- NCCL_DEBUG
- NCCL_DEBUG_FILE
- NCCL_DEBUG_SUBSYS
- NCCL_COLLNET_ENABLE
- NCCL_COLLNET_NODE_THRESHOLD
- NCCL_TOPO_FILE
- NCCL_TOPO_DUMP_FILE
- NCCL_SET_THREAD_NAME
- 调试
- NCCL_P2P_DISABLE
- NCCL_P2P_LEVEL
- NCCL_P2P_DIRECT_DISABLE
- NCCL_SHM_DISABLE
- NCCL_BUFFSIZE
- NCCL_NTHREADS
- NCCL_MAX_NCHANNELS
- NCCL_MIN_NCHANNELS
- NCCL_CHECKS_DISABLE
- NCCL_CHECK_POINTERS
- NCCL_LAUNCH_MODE
- NCCL_IB_DISABLE
- NCCL_IB_AR_THRESHOLD
- NCCL_IB_QPS_PER_CONNECTION
- NCCL_IB_SPLIT_DATA_ON_QPS
- NCCL_IB_CUDA_SUPPORT
- NCCL_IB_PCI_RELAXED_ORDERING
- NCCL_IB_ADAPTIVE_ROUTING
- NCCL_IB_ECE_ENABLE
- NCCL_MEM_SYNC_DOMAIN
- NCCL_CUMEM_ENABLE
- NCCL_CUMEM_HOST_ENABLE
- NCCL_NET_GDR_LEVEL (以前为 NCCL_IB_GDR_LEVEL)
- NCCL_NET_GDR_READ
- NCCL_NET_SHARED_BUFFERS
- NCCL_NET_SHARED_COMMS
- NCCL_SINGLE_RING_THRESHOLD
- NCCL_LL_THRESHOLD
- NCCL_TREE_THRESHOLD
- NCCL_ALGO
- NCCL_PROTO
- NCCL_NVB_DISABLE
- NCCL_PXN_DISABLE
- NCCL_P2P_PXN_LEVEL
- NCCL_RUNTIME_CONNECT
- NCCL_GRAPH_REGISTER
- NCCL_LOCAL_REGISTER
- NCCL_LEGACY_CUDA_REGISTER
- NCCL_SET_STACK_SIZE
- NCCL_GRAPH_MIXING_SUPPORT
- NCCL_DMABUF_ENABLE
- NCCL_P2P_NET_CHUNKSIZE
- NCCL_P2P_LL_THRESHOLD
- NCCL_ALLOC_P2P_NET_LL_BUFFERS
- NCCL_COMM_BLOCKING
- NCCL_CGA_CLUSTER_SIZE
- NCCL_MAX_CTAS
- NCCL_MIN_CTAS
- NCCL_NVLS_ENABLE
- NCCL_IB_MERGE_NICS
- NCCL_MNNVL_ENABLE
- NCCL_RAS_ENABLE
- NCCL_RAS_ADDR
- NCCL_RAS_TIMEOUT_FACTOR
- 系统配置
- 故障排除