flash-decoding

Star

Here are 2 public repositories matching this topic...

bong-water-water-bong / rocm-cpp

Star

⚠️ MIGRATED → https://github.com/bong-water-water-bong/1bit — monorepo

amd hip gpu-computing rocm cpp20 bitnet llm-inference flash-decoding strix-halo gfx1151 1-58-bit ternary-llm

Updated Jul 4, 2026
C++

JohnScheuer / flash-decoding-bench

Star

Benchmark comparing Flash-Decoding-style chunked KV-parallel attention against standard SDPA at decode time (q_len=1) on RTX 2070, measuring the crossover point where KV-parallelism outperforms fused attention kernels.

benchmarking cuda pytorch transformer decode attention kv-cache long-context llm-inference flash-attention flash-decoding mlsystems

Updated Jul 19, 2026
Python

Improve this page

Add a description, image, and links to the flash-decoding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the flash-decoding topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

flash-decoding

Here are 2 public repositories matching this topic...

bong-water-water-bong / rocm-cpp

JohnScheuer / flash-decoding-bench

Improve this page

Add this topic to your repo