Efficient Memory Management for Large Language Model Serving with PagedAttention
Kwon et al. · September 2023 · arXiv
A concrete example of how memory management shapes AI serving efficiency. PagedAttention and vLLM show why systems software matters alongside the hardware.
