II.
LibraryProcess overview
Reference · livelib-process:gpu-programming--gpu-cluster-computing
specializations/gpu-programming/gpu-cluster-computing overview
GPU Cluster Computing - Process for scaling GPU workloads across distributed clusters using MPI, NCCL, and GPU-Direct technologies.
Attributes
displayName
specializations/gpu-programming/gpu-cluster-computing
description
GPU Cluster Computing - Process for scaling GPU workloads across distributed clusters
using MPI, NCCL, and GPU-Direct technologies.
libraryPath
library/specializations/gpu-programming/gpu-cluster-computing.js
specialization
gpu-programming
references
- - NCCL Documentation: https://docs.nvidia.com/deeplearning/nccl/
- - GPU-Direct: https://developer.nvidia.com/gpudirect
- - MPI with CUDA: https://docs.nvidia.com/cuda/cuda-c-best-practices-guide/
example
const result = await orchestrate('specializations/gpu-programming/gpu-cluster-computing', {
projectName: 'distributed_training',
numNodes: 8,
gpusPerNode: 4,
communicationLib: 'nccl'
});
usesAgents
- hpc-domain-expert
Outgoing edges
lib_applies_to_domain1
- domain:scientific-computing·DomainScientific Computing
lib_belongs_to_specialization1
- specialization:gpu-programming·Specialization
lib_implements_workflow1
- workflow:performance-profiling-cycle·WorkflowPerformance Profiling Cycle
lib_involves_role2
- role:computational-scientist·RoleComputational Scientist
- role:ml-engineer·RoleMachine Learning Engineer
lib_requires_skill_area2
- skill-area:cuda-kernels·SkillAreaCUDA Kernel Programming
- skill-area:compute-shaders·SkillAreaCompute Shaders
uses_agent1
- lib-agent:gpu-programming--hpc-domain-expert·LibraryAgenthpc-domain-expert
Incoming edges
None.