CUDA Fundamentals For Systems Interviews
A compact review of host/device code, grids, blocks, warps, memory hierarchy, synchronization, and CUDA compilation.
Read articleTechnical notes on scientific computing, performance engineering, and the systems ideas behind research software.
A compact review of host/device code, grids, blocks, warps, memory hierarchy, synchronization, and CUDA compilation.
Read articleReview notes for explaining GPU kernels through thread mapping, memory access, synchronization, and bottleneck hypotheses.
Read articleA walkthrough of Michael-Scott queues, CAS linearization points, memory ordering, ABA, and hazard-pointer reclamation.
Read articleThe thread-pool layer around a queue: packaged tasks, futures, stop tokens, condition variables, graceful shutdown, and lifecycle locks.
Read articleHow bit-packing, M4RI-style table methods, layout experiments, and Fenwick-tree CTMC checks fit into one engineering loop.
Read articleA systems-oriented refresher on reverse-mode autodiff, micrograd-style scalar graphs, PyTorch vocabulary, and GPU placement.
Read article