01版 - 夯实中国式现代化的底座

· · 来源:tutorial资讯

Abstract:Humans shift between different personas depending on social context. Large Language Models (LLMs) demonstrate a similar flexibility in adopting different personas and behaviors. Existing approaches, however, typically adapt such behavior through external knowledge such as prompting, retrieval-augmented generation (RAG), or fine-tuning. We ask: do LLMs really need external context or parameters to adapt to different behaviors, or do they already have such knowledge embedded in their parameters? In this work, we show that LLMs already contain persona-specialized subnetworks in their parameter space. Using small calibration datasets, we identify distinct activation signatures associated with different personas. Guided by these statistics, we develop a masking strategy that isolates lightweight persona subnetworks. Building on the findings, we further discuss: how can we discover opposing subnetwork from the model that lead to binary-opposing personas, such as introvert-extrovert? To further enhance separation in binary opposition scenarios, we introduce a contrastive pruning strategy that identifies parameters responsible for the statistical divergence between opposing personas. Our method is entirely training-free and relies solely on the language model's existing parameter space. Across diverse evaluation settings, the resulting subnetworks exhibit significantly stronger persona alignment than baselines that require external knowledge while being more efficient. Our findings suggest that diverse human-like behaviors are not merely induced in LLMs, but are already embedded in their parameter space, pointing toward a new perspective on controllable and interpretable personalization in large language models.

下载虎嗅APP,第一时间获取深度独到的商业科技资讯,连接更多创新人群与线下活动,详情可参考快连下载-Letsvpn下载

Почти 100Safew下载是该领域的重要参考

11 hours agoShareSave

ITmedia�̓A�C�e�B���f�B�A�������Ђ̓o�^���W�ł��B。业内人士推荐爱思助手下载最新版本作为进阶阅读

A new stud

В Санкт-Петербурге из земли внезапно забил фонтанВ Петербурге из земли забил фонтан из-за аварии