Juju Radar
论文库

DeepSeek-V4.1-Flash:分别压缩全局与持久缓存

DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

输入处理与生成分别激活80亿与160亿参数;全局KV缓存890字节/token约为前代对应部分1/4,持久缓存约1/8。比例不等于整机显存或API价格,稀疏选择及近似重建仍存在边界条件。

首次公开:2026-09-17 · 收录:2026-09-20

作者

DeepSeek-AI;Xu, Anyi;Li, B.;Lin, Bangcai;Xue, Bing;Xian, BingCheng;Xu, Bingzheng;Wu, Bochao;Zhang, Bowei;Deng, Boyi;Yu, C. C.;Jin, Chao;Lin, Chaofan;Dong, Chen;Wang, Chenbing;Feng, Chenfan;Lu, Chengda;Zhao, Chenggang;Deng, Chengqi;Zhang, Chengyuan;Xu, Chenhao;Zhao, Chenqi;Shao, Chenze;Wang, Chuhao;Zhang, Chuqi;Dai, Damai;Yang, Dejian;Chen, Deli;Huang, Di;Wu, Di;Li, Donghao;Li, Erhang;Fu, Eric;Zhou, F.;Zhou, Fangwei;Lin, Fangyun;Yuan, Fangzhou;Xia, Feiyu;Dai, Fucong;Hao, Guangbo;Li, Guanglin;Chen, Guanting;Cao, Guoai;Fan, Guofan;Meng, Guolai;Li, Guowei;Zhang, Haichuan;Ma, Haiyang;Shen, Haiyang;Li, Han;Yu, Han;Zhang, Han;Deng, Hangyuan;Xu, Hanwei;Xu, Hanxiang;Zhong, Hanxun;Guo, Hao;Jiang, Hao;Li, Hao;Qin, Hao;Wen, Haodong;Liang, Haofen;Huang, Haofeng;Liu, Haohua;Zhang, Haoling;Luo, Haoming;Yang, Haoran;Xu, Haotian;Yuan, Haotian;Huang, Haoting;Luo, Haowen;Cai, Haoyang;Chen, Haoyu;Ji, Haozhe;Zhang, Hengran;Wang, Hengrui;Wu, Hengxu;Ding, Honghui;Tang, Hongxuan;Wang, Huadong;Cao, Huanqi;Gao, Huazuo;Qu, Hui;Zeng, Hui;Yang, J.;Jin, J. H.;Zhang, J. H.;Zou, J. X.;Yu, Jia;Zhou, Jiahui;Chen, Jiajun;Huang, Jialiang;Zhao, Jialin;Tang, Jiamin;Zhou, Jian;Tong, Jianan;Li, Jianwen;Zhu, Jiaqi;Wang, Jiarui;Ye, Jiasheng;Li, Jiashi;Xu, Jiaxin;Ding, Jiaying;Lu, Jibai;Hu, Jiewen;Yan, Jin;Zhai, Jincheng;Chen, Jingchang;Hu, Jingcheng;Zhou, Jingli;Xu, Jingsheng;Xiang, Jingting;Yun, Jingyan;Yuan, Jingyang;Cheng, Jingyuan;Zhu, Jinhua;Wang, Jinpeng;Chen, Jinyi;Hu, Jinyi;Yu, Jiping;Guo, Jueliang;Pei, Junbo;Sun, Junbo;Jiang, Junguang;Qiu, Junjie;Zhou, Junkang;Liu, Junqi;Li, Junren;Li, Junxian;Song, Junxiao;Guo, Junyi;Dong, Kai;Chen, Kaifeng;Gao, Kaige;Guan, Kang;Yuan, Kangdong;Hong, Ke;Xu, Ke;Zhao, Kefan;Ji, Kexin;Zhang, Kexin;Zhou, Kexing;Yu, Kuai;Zhang, Lan;Wang, Lean;Zhang, Lecong;Wang, Lei;Gao, Letian;Zhao, Liang;Xu, Liansheng;Guo, Lihua;Luo, Lingxiao;Fu, Lingyue;Deng, Litao;Wang, Litong;Zhang, Liyue;Chen, Longhao;Chen, Lu;Huang, Luotian;Ma, Luyao;Wang, Luyao;Di, M. S.;Mei, Max;Ye, Menghao;Cui, Miao;Zhang, Mingchuan;Zhang, Minghua;Tang, Minghui;Zhang, Mingjing;Wei, Mingqi;Chen, Mingshu;Liu, Mingxing;Zhou, Mingxu;Xu, Mingyu;Yang, Mingyu;Wang, Mingze;Chen, Muyang;Shentu, Ni;Wang, Ning;Ning, Niufang;Huang, Panpan;Cong, Peixin;Wang, Peiyi;Xin, Peiyuan;Ren, Pengfei;Yan, Pengfei;Zhang, Pengle;Kang, Qi;Tang, Qi;Wang, Qiancheng;Li, Qiang;Zhu, Qihao;Li, Qingyang;Chen, Qinyu;Du, Qiushi;Guo, Qizhou;Xu, Rongxian;Ding, Rui;Hu, Rui;Tian, Rui;Yu, Rui;Zhu, Ruidong;Xu, Ruifan;Yang, Ruihan;Xia, Ruihang;Lu, Ruijie;Geng, Ruilin;Hong, Ruipeng;Ge, Ruiqi;Zhang, Ruisong;Sun, Ruize;Pan, Ruizhe;Wang, Runji;Chen, Runqian;Xu, Runxin;Tian, Ruohong;Shen, Ruomeng;Zhang, Ruoyu;X., Ryan;Liu, S. H.;Lu, Shanghao;Zhou, Shangyan;Chen, Shanhuang;Cai, Shaofei;Nie, Shaoheng;Chen, Shaoyuan;Hu, Shengding;Lin, Shengkai;Ran, Shengwen;Liu, Shengyu;Jia, Shengyuan;Bai, Shi;Feng, Shi;Xu, Shicheng;Liu, Shichun;Hu, Shiqiang;Ma, Shirong;Wang, Shiyu;Feng, Shiyuan;Gong, Shufan;Lin, Shuhan;Yu, Shuiping;Zhou, Shunfeng;Yang, Shuo;Wang, Shuomeng;Guo, Shuting;Pan, Shuting;Yu, Shuying;Cao, Sinuo;Lin, Siyi;Chen, Sizhe;Chen, Songyang;Zhou, Songyang;Ni, Tao;Yun, Tao;Jin, Tian;Pei, Tian;Ye, Tian;Lin, Tianle;Ji, Tianran;Cui, Tianyi;Yue, Tianyuan;Yu, Tingting;Xiong, Tongrui;Zeng, Wangding;Liu, Wei;Zhang, Wei;Xu, Weibin;Zeng, Weihao;Zhao, Weilin;Liu, Wen;Liang, Wenfeng;Pang, Wenjie;Luo, Wenjing;Yao, Wenjing;Gao, Wenjun;Shao, Wenkai;Yang, Wenkai;Zhang, Wenli;Wang, Wenlu;Huang, Wenlve;Yan, Wenqian;Zhang, Wentao;Gao, Xi;He, Xiang;Li, Xiang;Li, Xiangli;Wang, Xiangwen;Zhang, Xiangying;Wei, Xiankui;Bi, Xiao;Liu, Xiaodong;Wang, Xiaohan;Qu, Xiaojian;Chen, Xiaokang;Zhang, Xiaokang;Nie, Xiaotao;Zou, Xiaoyao;Li, Xiaoyuan;Guo, Xicheng;Chu, Xieting;Cheng, Xin;Liu, Xin;Xie, Xin;Xu, Xinbo;Liu, Xingchao;Liu, Xingchen;Yu, Xingkai;Li, Xingyou;Yao, Xintong;Chen, Xinyang;Jiang, Xinyong;Yang, Xinyu;Yang, Xinyu;Chen, Xu;Wang, Xuanyu;Zhong, Xubei;Su, Xuecheng;Liu, Xuejie;Lin, Xuheng;Fan, Xujie;Zhao, Xuncheng;Fu, Xuwei;Yan, Y. C.;Jiang, Y. H.;Wu, Y. T.;M., Y. W.;Wang, Y. Z.;Gao, Yafei;Yang, Yang;Zhang, Yang;Ma, Yanru;Huang, Yanwen;Li, Yao;Li, Yao;Meng, Yao;Zhao, Yao;Sun, Yaofeng;Wang, Yaohui;Ye, Yaoyang;Yin, Yehang;Wu, Yexinrui;Qian, Yi;Tao, Yi;Yu, Yi;Zhang, Yichao;Jiang, Yichen;Wang, Yicheng;Ding, Yifan;Shi, Yifan;Peng, Yifeng;Zhai, Yifeng;Wu, Yijia;Xiong, Yiliang;Wang, Yilun;He, Ying;Zhou, Ying;Luo, Yingjia;Zhong, Yinmin;Wang, Yiping;Wang, Yisong;Zhang, Yixiang;Chen, Yixiao;Tan, Yixuan;Wei, Yixuan;Ma, Yiyang;Yang, Yiyao;Liu, Yiyuan;Cai, Yizai;Wei, Yizhen;Wang, Yizhi;Yang, Yonglun;Zhuo, Yongqi;Guo, Yongqiang;Wu, Yongtong;Wu, Yu;Zhang, Yu;Bian, Yuan;Cheng, Yuan;Ou, Yuan;Sun, Yuan;Xu, Yuanfan;Sun, Yuanhang;Li, Yuanhao;Liu, Yuchen;Yao, Yuchen;Han, Yudong;Wang, Yuduan;Wu, Yuhan;Meng, Yuhao;Zou, Yuheng;Li, YuKun;Wang, Yunchuan;Xiao, Yunfan;Xiong, Yunfan;Chen, Yupeng;Cao, Yuqian;Wang, Yuqian;Chen, Yuqing;Zhang, Yushun;Lin, Yutong;Xiao, Yuwei;Gu, Yuxian;Chen, Yuxiang;Huang, Yuxiang;Luo, Yuxiang;You, Yuxiang;Chen, Yuxin;Xiang, Yuxin;Liu, Yuxuan;Zhou, Yuxuan;Zhou, Yuyang;Guo, Yuzhe;Huang, Yuzhen;Bai, Yuzhuo;Z., Z. Y.;Ni, Zanlin;Wang, Zehao;Zhao, Zehua;Ren, Zehui;Zhao, Zejun;Sha, Zhangli;Wang, Zhanying;Zhang, Zhaochen;Du, Zhaoshuai;Fu, Zhe;Xu, Zhean;Xie, Zhenda;Liu, Zheng;Zhang, Zhengyan;Dong, Zhenhua;Hao, Zhewen;Wang, Zhibang;Gou, Zhibin;Ma, Zhicheng;Li, Zhihao;Shao, Zhihong;Huang, Zhihuan;Li, Zhijie;Lu, Zhirui;Huang, Zhixian;Chen, Zhixuan;Chen, Zhixuan;Pan, Zhixuan;Wu, Zhiyu;Ren, Zhizhou;He, Zhu;Li, Zhuoshu;Zhang, Zhuping;Xu, Zian;Wang, Zihao;Gu, Zihui;Zhu, Zijia;Zhang, Zili;Li, Zilin;Hou, Zilong;Lyu, Zilong;Wang, Ziqiao;Xie, Ziwei;Zhang, Ziya;Gao, Ziyi;Pan, Zizheng;Li, Zonglin;Yao, Zongqing;Chen, Zui;Wu, Zuofan;Ling, Chenchen;Hou, Chengyu;Chen, Chong;Li, D.;Qi, Di;Ji, Dongjie;Wei, Fang;Xia, Fanyi;Xie, Fei;Tan, Feiyi;Guo, Hailong;Zhai, Haiyan;Zhou, Hui;Tan, Huihui;Li, Huijie;Luo, Jia;Song, Jia;Cai, Jialu;Liang, Jian;Zhou, Jiangting;Gao, Jiaqi;Shao, Jiayi;Chen, Jie;Yang, Jieyu;Chen, Jin;Zhang, Jingde;Zhou, Jingzi;Wang, Jinqian;Liu, Jinyang;Sun, JinZhao;Ling, Junhua;Zheng, Junmin;Yang, Kaicheng;Xu, Ke;Su, Le;Xia, Leyi;Ding, Liangfeng;Zhuo, Lin;Ma, Linwang;Zhu, Linyan;Cai, Liyu;Yao, Luqi;Zhang, M. K.;Li, Meng;Lin, Miao;Wang, Miaojun;Zhang, Min;Li, Mingming;Wang, Mingming;Yin, Mingze;Han, Minmin;Cao, Nan;Wang, Ning;Ma, Ningxin;Wang, Panpan;Lin, Peihan;Sun, Peng;Zhang, Peng;Ying, Qian;Xiang, Qiang;Wang, Qiao;Mao, Qingmiao;Jiang, Qiwei;Jin, Rongli;Chen, Ruyi;Tao, Sha;Sun, Shangmian;Wu, Shaoqing;Zou, Shichao;Lei, Si;Zhang, Tianyang;Sun, Tianyu;Yin, Tingting;Xiao, W. L.;An, Wei;Li, Wei;Wang, Wei;Lin, Weiwei;Hou, Wenqing;Lin, X.;Meng, Xiangfei;Huang, Xianzhu;Peng, Xiao;Li, Xiaoqian;Zhang, Xiaoting;Sun, Xiaowen;Wang, Xiaoxiang;Ye, Xiaoyu;Zhang, Xinrou;Zhang, Xinyu;Cao, Xue;Chen, Xueyin;Zhou, Yanan;Xu, Yanhong;Xia, Yao;Xu, Yao;Shao, Yi;Zhang, Yihong;Ma, Yiling;Tang, Ying;Lou, Yining;Chen, Yiru;Piao, Yishi;Chen, Yixuan;Xiong, Yong;Xuan, Yuchen;Yang, Yuehan;Xu, Yuer;Zha, Yukun;Ma, Yunxian;Lin, Yuping;Yan, Yuting;Xie, Yutong;Sheng, Yuwen;Zhu, Yuxuan;Zhang, Zekai;Ju, Zhe;Lin, Zhenzhen;Gao, Zheren;Sun, Zheyang;Yan, Zhigang;Wu, Zhongyu;Wang, Zi;Qu, Zihua;Yan, Ziling;Wan, Ziyi

相关期次:2026-09-20 精选

阅读笔记

Juju Radar · 2026-09-20

DeepSeek-V4.1-Flash 已在9月10日发布,这次补看的是随后公开的技术报告。长任务 Agent 会不断读文件、日志和历史记录,输入往往比输出更重。报告把“读完输入”和“生成回答”分开设计:每个输入 token 激活约80亿参数,生成阶段则约160亿。

另一处重点是键值缓存,也就是模型为避免重复计算而保留的中间状态。跨层复用与低精度存储,让常驻显存的全局缓存降到每个 token 890字节,约为 DeepSeek-V4-Flash 对应部分的四分之一。这个比例只指该类缓存,不能理解成整套模型只需四分之一显存。

对放在主机内存或硬盘里的持久缓存,论文又采用局部滑动窗口状态重建,报告体积约降到前代的八分之一。它是在存储和重新计算之间作取舍,也不意味着一次 API 调用的价格会自动降到八分之一。

这篇最值得读的是成本怎样分摊:哪些输入只处理一次,哪些状态可以复用,哪些可以需要时再算。作者也提醒,稀疏选择失误和近似状态重建,在尚未充分测试的边界条件下仍可能影响能力。权重可以获取,实际收益还要放进具体的长任务中检验。

近期补看;编辑重要度9.0/10。AI辅助整理,未独立复现。
原文:https://arxiv.org/abs/2609.19969
本期资料:https://www.asteronline.cn/juju-radar/2026-09-20/

笔记记录收录当期的判断。阅读一手材料不等于独立复现;后续进展请以原始来源为准。