FastLM
Popular repositories Loading
-
CXL-SpecKV
CXL-SpecKV Public[FPGA'26 Best Paper Nomination] CXL-SpecKV: A Disaggregated FPGA Speculative KV-Cache for Datacenter LLM Serving
-
CSV-Decode
CSV-Decode PublicCSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
Python 12
-
tinyserve-vllm
tinyserve-vllm Public[ACM MM 2025 Oral] TinyServe: Query-Aware Page Allocation Optimization
Repositories
- CongShed Public
Breaking the Interconnect Bottleneck in LLM Serving via Congestion-Aware Scheduling over Heterogeneous Interconnects
- SemToken Public
[*SEM 2026 Oral] SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language Models
-
- Thoughts-as-Planning Public
Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning
-
- CSV-Decode Public
CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
- CXL-SpecKV Public
[FPGA'26 Best Paper Nomination] CXL-SpecKV: A Disaggregated FPGA Speculative KV-Cache for Datacenter LLM Serving
- HSGM Public
[ICPADS 2025 Oral, *SEM 2025 Oral] HSGM: Hierarchical Segment-Graph Memory for Scalable Long-Text Semantics
Top languages
Loading…
Most used topics
Loading…