Mistral CEO 称强大 AI 模型应回归公共所有
Mistral CEO 主张,LLM 预训练汲取了互联网上本为公共福祉免费开放的内容,AI 公司却将其训练成强大模型再高价卖回,因此强大模型应作为开放权重回归公共所有、供任何人免费下载使用。他认为对全部训练数据主张强版权并不可行,因为 LLM 与人类一样是学习后综合新内容而非完美复制原文。
There’s a way of thinking about the ethics of building LLMs which deserves much more attention:
During pretraining of LLMs we distill vast amounts of humanity’s collective work from the internet into the model’s weights. When that knowledge was created, we were not aware that LLMs would be possible. The content was released for others to read freely, essentially as a common good. This includes not only all of our writing, but also the vast amounts of open source code on platforms like GitHub.
Once LLMs were discovered, AI companies were able to access the content easily (in the trillions of tokens), train powerful models and then sell them back to us for hundreds of billions of dollars. They took something we released for free for the common good, and then turned it into trillion-dollar companies to primarily benefit themselves. Coding models in particular, trained from GitHub, are very useful and highly profitable.
At the same time, I believe that we can’t make a strong copyright claim on all of the training data. LLMs, similar to humans, do not perfectly reproduce the source text, but rather learn from it and then synthesize new content. If we wanted to forbid LLMs from learning from it, we would need to answer why humans are allowed to do the same.
There is an elegant way to resolve this tension: We should return the resulting models to the commons, releasing them openly for anyone to download and use freely. This way the data is not repurposed for a few people’s profit, but merely transformed into a more useful form for society. This is the core idea behind open-weight models, which are gathering momentum and are starting to rival the models of proprietary AI labs.
After working in the AI industry for many years, building many LLMs, I’ve come to strongly believe that this is the right point of view.
Although most people today don’t seem to think along these lines, I believe that in the fullness of time this will become the majority opinion and the current state of AI development will look odd in retrospect. Provided the models haven’t taken over at that point.
来源:RadarAI · aihot.news