100 DAYS OF GPU Course preview

MODULE 05 / Days 41-50

Profiling and optimization

All lessons
  1. 41
    Reading an Nsight Systems timelineHow do I read an Nsight Systems timeline?
    run logged
  2. 42
    Reading an Nsight Compute reportHow do I read an Nsight Compute report?
    run logged
  3. 43
    Optimizing CUDA matmul, steps 1 to 3How do I optimize a CUDA matrix multiplication kernel?
    run logged
  4. 44
    Optimizing CUDA matmul, steps 4 to 6How do I get a CUDA matmul close to cuBLAS speed?
    run logged
  5. 45
    Occupancy is not the goalDoes higher occupancy make a CUDA kernel faster?
    run logged
  6. 46
    Reading PTX and SASS, and which one runsWhat is the difference between PTX and SASS in CUDA?
    run logged
  7. 47
    Fast math, FMA and precision, one flag at a timeWhat does -use_fast_math actually do in CUDA, and what does it cost?
    run logged
  8. 48
    CUDA kernel fusion and what a launch really costsWhen does fusing CUDA kernels actually make them faster?
    run logged
  9. 49
    Building a roofline for your GPUHow do I build a roofline model for my own GPU?
    run logged
  10. 50
    The CUDA performance checklist, in diagnostic orderMy CUDA kernel is slow. What do I check first?
    run logged