arXiv cs.AI· Antonio Manjavacas, David Su\'arez-Caro, Alejandro Campoy-Nieves, Guillermo Rey, Gonzalo Satr\'ustegui, Miguel Molina-Solana·· 23 小时前AI 评分26
深度强化学习用于热泵与地暖控制:端到端案例研究
Deep Reinforcement Learning for Heat Pump and Underfloor Heating Control: An End-to-End Case Study
AI 导读
一项端到端案例研究将深度强化学习(DRL)控制器部署到真实住宅的集成地暖-热泵(UFH-HP)系统中,先在仿真中筛选算法与配置,再用真实住宅数字孪生训练智能体,表现最佳的智能体无需在线微调即直接部署。结果显示控制器在保持室内温度处于设定舒适区间的同时,动态调节热泵供水温度和地暖阀门开度,验证了在有人居住建筑中部署 DRL 控制器的可行性,并揭示了从数字环境迁移到真实供暖系统的鲁棒性与实际挑战。
正文 · 原文
Abstract:Efficient control of underfloor heating (UFH) systems coupled with heat pumps (HPs) is challenging due to the high thermal inertia of buildings and the slow dynamic response of UFH systems. Deep Reinforcement Learning (DRL) offers a data-driven control approach capable of simultaneously optimizing energy consumption and thermal comfort. However, the application of DRL-based controllers in occupied buildings under real operating conditions remains limited. This work presents and end-to-end case study (development, evaluation, and real-world deployment) of a DRL-based controller for an integrated UFH-HP system. First, a simulation-based pilot study was conducted to assess different DRL algorithms, control strategies, and configurations. Subsequently, a digital twin of a real residential building was developed and used to train DRL agents under simulated operating conditions. The best-performing agent was then deployed in the physical building without additional online fine-tuning. The results show that the controller successfully maintained indoor temperatures within the prescribed comfort limits while dynamically adjusting the HP supply temperature and UFH valve positions. These findings demonstrate the feasibility of deploying DRL controllers in occupied buildings and highlight their robustness and the practical challenges associated with transferring control policies from digital environments to real heating systems.
| Comments: | Preprint submited to journal |
| Subjects: | Artificial Intelligence (cs.AI); Systems and Control (eess.SY) |
| ACM classes: | I.2.8; J.2 |
| Cite as: | arXiv:2611.23063 [cs.AI] |
| (or arXiv:2611.23063v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.23063 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Antonio Manjavacas [view email]
[v1]
Tue, 17 Nov 2026 16:54:25 UTC (6,989 KB)
来源:arXiv cs.AI · arxiv.org