arXiv cs.AI· Kai Yi Ji·· 10 小时前AI 评分31
权重空间编程能否改变模型习得的伦理优先级?
Can Weight-Space Programming Alter Learned Ethical Priorities?
AI 导读
一项研究通过权重编辑改变概念监督文本模型的拟合选择权重,使推翻正式承诺所需收益高于普通承诺,在六个独立训练的文本读取器上,该编辑在 100% 的目标普通冲突和 83.3% 的目标正式冲突中按两种顺序均选择较大群体,同时保留源模型在较小冲突上的成功率和事实准确性。
正文 · 原文
Abstract:We investigate whether a weight edit can alter how a model trades off honoring a commitment against benefiting more people. In a concept-supervised text model, we alter fitted choice weights so that the benefit required to override a formal pledge is larger than for an ordinary promise. Across six independently trained text readers, the edit selects the larger group in both orders on 100% of targeted ordinary conflicts and 83.3% of targeted formal conflicts. It preserves the source model's success rates on smaller conflicts and its factual accuracy. The remaining formal-conflict failures coincide with errors reading a beneficiary number. A separate classifier demonstrates why this distinction matters: reusing a factual answer passes an unconditional choice test but fails to preserve small-gap promises. In a YOLO11n pilot on COCO128, a bias edit increased small-target matches from 3/43 to 9/43, and an equivalent score calibration reproduced the retained detections. These exploratory results show a way to test selective changes to learned priorities in a model with an exposed trade-off mechanism. Whether the method can discover such changes in less structured language models remains open.
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.24330 [cs.CV] |
| (or arXiv:2611.24330v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.24330 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Kai Yi Ji [view email]
[v1]
Wed, 18 Nov 2026 12:31:23 UTC (412 KB)
来源:arXiv cs.AI · arxiv.org