Efficient and Privacy Aware Edge Cloud Collaborative Inference for Large Language Models
arXiv:2607.13093v4 Announce Type: replace-cross Abstract: On-device LLM inference faces a trilemma of response latency, limited hardware resources and user privacy. Full cloud inference delivers strong computing power but exposes user prompts and dialogue data, while standalone on-device inference i