mstar.engine.resources.kv

Modules

bounded
config	What a model declares about a KV cache: its shape, its spec, its step.
keys	Page keys for cross-request prefix reuse.
page_copier	Page copies between KV caches: the device cache and the host page pool, or two device caches (CUDA IPC KV transfer).
plan	The KV plan: what KVManager.plan hands its dependents.
prefix_index	The prefix index: which cached page holds which key, and which to drop first.
ring	Ring KV storage: a fixed horizon of frame slots, overwritten in place.