Minsoo Kim (@minsoo2333) / X

I'll be in San Diego for #NeurIPS2025 If you’re interested in edge (AR glasses, Mobile device) friendly KV cache management for streaming video, please come by and say hi! Poster : Thu, Dec 4 (11am–2pm PST), Exhibit Hall C,D,E #4817 Paper: arxiv.org/abs/2506.15745

Minsoo Kim

@minsoo2333

Sep 23, 2025

Thanks to AK for sharing our paper! 🙏 We introduce EpiCache, a training-free KV cache management method that enables multi-turn dialogue on memory-constrained devices. 📱 Done as an @Apple intern, with gratitude to my collaborators! Read more here: arxiv.org/abs/2509.17396

AK

@_akhaliq

Sep 23, 2025

Apple presents EpiCache Episodic KV Cache Management for Long Conversational Question Answering

Minsoo Kim

@minsoo2333

Nov 8, 2024

How can #LLMs process/prefill infinitely long contexts on memory-constrained devices? (mobile-devices📱) 🚀 Excited to present our @Qualcomm work at #emnlp2024! InfiniPot: Infinite Context Processing on Memory-Constrained LLMs (arxiv.org/abs/2410.01518) ✨ Key features: -

Minsoo Kim

@minsoo2333

Aug 14, 2024

How should we set LoRA "rank" in Quantization-aware PEFT? (e.g., QLoRA) - 💡2-bit Q Error shows intrinsically higher rank than 3/4-bit, but interestingly, not every sublayer requires it. - 🛠️ RA-LoRA dynamically adjusts ranks based on Q-error characteristics of each sublayer.