Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
jmalicki
3 months ago
|
parent
|
context
|
favorite
| on:
KVarN: Native vLLM backend for KV-cache quantizati...
And with the help of AI, pointing at AI at this paper and saying "making a vLLM PR from this paper" tends to work surprisingly well, even if you need to nudge it a little bit along the way.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: