面壁智能展示社区项目 esp32-eye：用 MiniCPM-V 4.7 双模型方案识别猫咪饮水

OpenBMB· @OpenBMB · X·2026-11-05 21:30· 36 分钟前AI 评分43

AI 导读

面壁智能展示社区项目 esp32-eye：用 MiniCPM-V 4.7 双模型方案识别并记录多只猫的饮水事件。ESP32-S3 摄像头将画面传到 MacBook，MiniCPM-V 4.7 1B 本地负责检测画面中是否有猫并过滤帧，MiniCPM-V 4.7 35B-A3B 再比对参考照片确认身份。四猫家庭三天内人工核对 89 次饮水事件，猫身份全部识别正确。

正文 · 原文

🐱 Who’s been drinking from the water bowl? MiniCPM-V helps keep track.

Our ambassador @emwstudio built esp32-eye, an open-source monitor that recognizes individual cats and logs their daily drinking events, using MiniCPM-V 4.7, two ESP32-S3 boards, and a MacBook. 💧

From camera feed to daily counts, here’s how it works:
📷 Capture: An ESP32-S3 camera streams video from beside the water bowl to the MacBook.
⚡ Detect: MiniCPM-V 4.7 1B runs locally on the MacBook to check whether a cat is in view, filtering frames before calling the larger model.
🔍 Identify: MiniCPM-V 4.7 35B-A3B checks the scene and compares reference photos to identify the cat.
📊 Track: A separate ESP32-S3 AMOLED display shows live video and each cat’s daily count. The system also saves event clips with audio.

🐾 In a home setup with four cats, @emwstudio reports 89 manually checked drinking events over three days, with all cat identities correctly recognized.

A practical example of complementary models at work: an intelligent model handles frequent detection, while a larger model handles identity confirmation.

We love seeing our community turn MiniCPM’s visual understanding into creative tools for everyday life. What would you build? 💙

🎬 Watch @emwstudio’s demo on Instagram:
http://instagram.com/reel/De9kUrooQlR

🛠️ Explore @emwstudio’s project:
http://github.com/emwstudio/esp32-eye

🚀 Build with MiniCPM-V:
GitHub: http://github.com/OpenBMB/MiniCPM-V
🤗 Hugging Face: http://huggingface.co/openbmb/MiniCPM-V-4.7-35B-A3B

#MiniCPM #OpenBMB #ESP32 #OpenSource

来源：OpenBMB · x.com