II.
LibraryProcess overview
Reference · livelib-process:gpu-programming--multi-gpu-programming
specializations/gpu-programming/multi-gpu-programming overview
Multi-GPU Programming - Process for scaling applications across multiple GPUs within a single node or across multiple nodes. Covers workload distribution, inter-GPU communication, and synchronization.
Attributes
displayName
specializations/gpu-programming/multi-gpu-programming
description
Multi-GPU Programming - Process for scaling applications across multiple GPUs within a single node
or across multiple nodes. Covers workload distribution, inter-GPU communication, and synchronization.
libraryPath
library/specializations/gpu-programming/multi-gpu-programming.js
specialization
gpu-programming
references
- - NCCL Documentation: https://docs.nvidia.com/deeplearning/nccl/
- - Multi-GPU Programming Guide: https://docs.nvidia.com/cuda/cuda-c-programming-guide/
example
const result = await orchestrate('specializations/gpu-programming/multi-gpu-programming', {
projectName: 'distributed_training',
numGpus: 4,
communicationPattern: 'all-reduce',
scalingStrategy: 'data-parallel'
});
usesAgents
- multi-gpu-systems-expert
Outgoing edges
lib_applies_to_domain1
- domain:scientific-computing·DomainScientific Computing
lib_belongs_to_specialization1
- specialization:gpu-programming·Specialization
lib_implements_workflow1
- workflow:performance-profiling-cycle·WorkflowPerformance Profiling Cycle
lib_involves_role2
- role:computational-scientist·RoleComputational Scientist
- role:ml-engineer·RoleMachine Learning Engineer
lib_requires_skill_area2
- skill-area:cuda-kernels·SkillAreaCUDA Kernel Programming
- skill-area:compute-shaders·SkillAreaCompute Shaders
uses_agent1
- lib-agent:gpu-programming--multi-gpu-systems-expert·LibraryAgentmulti-gpu-systems-expert
Incoming edges
None.