跳到正文
arXiv cs.AI· Kai Yi Ji·· 10 小时前AI 评分31

权重空间编程能否改变模型习得的伦理优先级?

Can Weight-Space Programming Alter Learned Ethical Priorities?

AI 导读

一项研究通过权重编辑改变概念监督文本模型的拟合选择权重,使推翻正式承诺所需收益高于普通承诺,在六个独立训练的文本读取器上,该编辑在 100% 的目标普通冲突和 83.3% 的目标正式冲突中按两种顺序均选择较大群体,同时保留源模型在较小冲突上的成功率和事实准确性。

正文 · 原文

View PDF HTML (experimental)

Abstract:We investigate whether a weight edit can alter how a model trades off honoring a commitment against benefiting more people. In a concept-supervised text model, we alter fitted choice weights so that the benefit required to override a formal pledge is larger than for an ordinary promise. Across six independently trained text readers, the edit selects the larger group in both orders on 100% of targeted ordinary conflicts and 83.3% of targeted formal conflicts. It preserves the source model's success rates on smaller conflicts and its factual accuracy. The remaining formal-conflict failures coincide with errors reading a beneficiary number. A separate classifier demonstrates why this distinction matters: reusing a factual answer passes an unconditional choice test but fails to preserve small-gap promises. In a YOLO11n pilot on COCO128, a bias edit increased small-target matches from 3/43 to 9/43, and an equivalent score calibration reproduced the retained detections. These exploratory results show a way to test selective changes to learned priorities in a model with an exposed trade-off mechanism. Whether the method can discover such changes in less structured language models remains open.
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2611.24330 [cs.CV]
  (or arXiv:2611.24330v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2611.24330

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Kai Yi Ji [view email]
[v1] Wed, 18 Nov 2026 12:31:23 UTC (412 KB)

来源:arXiv cs.AI · arxiv.org