Tag: parallel-computing
All the articles with the tag "parallel-computing".
CUDA Programming (7): Parallel Reduction and Kernel Optimization Techniques
A comprehensive case study on optimizing parallel reduction in CUDA, covering Roofline modeling, control divergence, shared memory bank conflicts, loop unrolling, warp shuffle instructions, and thread coarsening.
CUDA Programming (3): A Vector Addition Example
A practical hands-on guide to implementing vector addition in CUDA C++, covering memory allocation, kernel invocation syntax, and compilation with nvcc.
CUDA Programming (2): CUDA Programming Model
A foundational overview of the CUDA programming model, detailing thread hierarchies (threads, blocks, grids, warps), logical memory spaces, and execution scheduling mechanisms.