跳到正文
Simon Willison·· 10 天前AI 评分12

Ben Affleck 谈机器学习与视觉特效中的卷积神经网络

Quoting Ben Affleck

AI 导读

Ben Affleck 表示自己从胶片转向数字后对视觉特效产生兴趣,并因此会写一些"很烂的 Python 脚本"。他解释视觉特效流程多年来一直包含机器学习:用卷积神经网络处理张量(每帧每像素 RGB 值等数值化图像),实现边缘检测与特征提取,从而更容易抠出绿幕并替换背景。他称卷积神经网络是 Transformer 的前身,区别在于后者能同时进行更多计算。

正文 · 原文

7th October 2026

I've always been kind of into computers since I was young. And then when film started to move from analog film to digital, I became more interested in that aspect of it. And the visual effects workflow for many years has included machine learning.

So I can write like pretty shitty Python scripts and stuff like that because with convolutional neural networks, which were the sort of precursors to what the transformer can do, which is just much more computation simultaneously, you would do things like look at what's called a tensor, which is just the numerical translation of a visual image in numbers — like the batch number, the frame number, the red, green, and blue values of each pixel in each frame.

And a tensor, you use a convolutional neural network to identify patterns in that that would reveal what's called edge detection or feature extraction, which is just identifying patterns enough to know like this is where the window ledge is, so we can more easily take the green screen image out and replace it with something.

— Ben Affleck, Pythonista

来源:Simon Willison · simonwillison.net