Fault-Aware Hybrid MPC-Reinforcement Learning Framework for Adaptive Sensor Bias Handling in Industrial Furnace Temperature Control

Bibi Amna; Muhammad Zeeshan; Kiran Raheel

Author(s)

Bibi Amna Department of Electrical Engineering, CECOS University of IT & Emerging Technology, Peshawar 25000, Pakistan

Muhammad Zeeshan Department of Electrical & Electronics Engineering, Karadeniz Technical University, Trabzon 61080, Türkiye

Kiran Raheel Department of Electrical Engineering, CECOS University of IT & Emerging Technology, Peshawar 25000, Pakistan

Abstract

Temperature control in industrial furnaces is an important issue in view of product quality and efficiency. In the presence of sensor bias faults, the performance of the controller declines due to the use of incorrect feedback data. This paper presents a hybrid system of Model Predictive Control (MPC) combined with Reinforcement Learning (RL) for the detection and compensation of sensor bias faults in the control system of the furnace temperature. It uses MPC to achieve stable tracking performance as well as the creation of residuals, which indicate sensor abnormalities. It also includes a supervisory Deep Q-Network (DQN) agent, which chooses the best tuning strategy of MPC from the set of available options on the basis of tracking and residuals. The proposed methodology was tested on a simulated system in MATLAB/Simulink with the use of constant, periodic, and multilevel reference temperature profiles with both negative and positive sensor bias. The training procedure took 57 episodes in the case of negative bias and 77 episodes in the absence of any faults when a constant reference is provided. Other types of the reference temperature profile were more difficult to be learned by the DQN agent. They took 120 episodes without achieving convergence.

Publication Details

Page(s) 23-48

DOI DOI not available

Published Journal: The Sciencetech, Volume: 7, Issue: 2, Year: 2026

Request the full text from PASTIC

Keywords

Temperature Regulation, Model predictive control, Sensor Bias Fault, Deep Q-Network, Reinforcement Learning, Fault-Tolerant Control, Industrial Furnace

References

AlRijeb M. F. S.,Othman M. L.,Ishak A.,Hassan M. K.,Albaker B. M. .2025 .Machine learning-driven soft sensor implementation for real-time fault detection in CDU of oil refinery. , 15(1) : 20425-20432.

Amin A. A.,Iqbal M. S.,Shahbaz M. H. .2024 .Development of intelligent fault-tolerant control systems with machine learning, deep learning, and transfer learning algorithms: A review. Expert Systems with Applications, 238 : 121956.

Amin A. A.,Mubarak A.,Waseem S. .2025 .Application of physicsinformed neural networks in fault diagnosis and fault-tolerant control design for electric vehicles: A review. Measurement, 246 : 116728.

Bagla G.,Patwardhan S. C.,Valluru J. .2023 .Intelligent state estimation for fault tolerant integrated frequent RTO and adaptive nonlinear MPC. Journal of Process Control, 131 : 103092.

Bertsekas D. P. .2024 .Model predictive control and reinforcement learning: A unified framework based on dynamic programming. IFAC Journal of Systems and Control., : .

Camacho E. F.,Alba C. B. .2023 .Model predictive control (3rd ed. , : .

Dai B.,Wang F.,Chang Y.,Chu F.,Song S. .2024 .Process modelassisted optimization control method based on model predictive control and deep reinforcement learning for coordinated control system in coal-fired power unit. IEEE Transactions on Automation Science and Engineering, 22 : 228-239.

Du P.,Wilhite B.,Kravaris C. .2024 .Model-based fault diagnosis for safety-critical chemical reactors: An experimental study. Journal, 70(12) : .

El-Mahdy M. H.,Awad M. I.,Maged S. A. .2024 .Deep-learningbased design of active fault-tolerant control for automated manufacturing systems subjected to faulty sensors. Transactions of the Institute of Measurement and Control, 46(12) : 2289-2299.

Escobar-Jiménez R. F.,Garcí J.,Gómez-Aguilar J. F. .2023 .Sensor fault-tolerant control for an internal combustion engine. International Journal of Adaptive Control and Signal Processing, 38(1) : 1-20.

Federici L.,Benedikter B.,Furfaro R. .2025 .Reinforcement learning enhanced model predictive control for autonomous planetary landing. AAS Conference Proceedings., : .

Gros S.,Zanon M. .2020 .Data-driven economic NMPC using reinforcement learning. IEEE Transactions on Automatic Control, 65(2) : 636-648.

Ham H.,Ah H. .2025 .A survey on safe model predictive control and reinforcement learning. Journal of Control Robotics Systems., : .

Han X.,Rammal R.,He M.,Li Z.,Cabassud M.,Dahhou B. .2023 .Dynamic and sensor fault tolerant control for an intensified heatexchanger/reactor. European Journal of Control, 69 : 100736.

Hewing L.,Wabersich K. P.,Menner M.,Zeilinger M. N. .2020 .Learning-based model predictive control: Toward safe learning in control. Annual Review of Control, Robotics, and Autonomous Systems, 3 : 269-296.

Hosseini S. A.,Salahshoor K. .2024 .A reinforcement learning-based fault tolerant control design approach using the double Q-learning algorithm. , : 184-202.

Jiang H.,Xu F.,Wang X.,Wang S. .2023 .Active fault-tolerant control based on model predictive control and reinforcement learning for quadcopter with actuator faults. IFAC-PapersOnLine, 56(2) : 11853-11860.

Leite D.,Andrade E.,Rativa D.,Maciel A. M. A. .2025 .Fault detection and diagnosis in Industry 4.0: A review on challenges and opportunities. Sensors, 25(1) : 60.

Li H.,Qiu T. .2024 .Supply responsive scheduling for ethylene cracking furnace systems based on deep reinforcement learning. AIChE Journal, 70(12) : .

Lillicrap T. P.,Hunt J. J.,Pritzel A.,Heess N.,Erez T.,Tassa Y.,Silver D.,Wierstra D. .2016 .Continuous control with deep reinforcement learning. International Conference on Learning Representations (ICLR)., : .

Liu G.,Li X.,Chen W. .2025 .Research progress on data-driven industrial fault diagnosis methods. Sensors, 25(9) : 2952.

Mallick S. .2025 .Reinforcement learning-based model predictive control for greenhouse climate control. Energy Reports., : .

Mesbah A. .2016 .Stochastic model predictive control: An overview and perspectives for future research. IEEE Control Systems Magazine, 36(6) : 30-44.

Mnih V.,Kavukcuoglu K.,Silver D.,Rusu A. A.,Veness J.,Bellemare M. G.,Graves A.,Riedmiller M.,Fidjeland A. K.,Ostrovski G.,Petersen S.,Beattie C.,Sadik A.,Antonoglou I.,King H.,Kumaran D.,Wierstra D.,Legg S.,Hassabis D. .2015 .Human-level control through deep reinforcement learning. Nature, 518(7540) : 529-533.

Morato M. M.,Felix M. S. .2024 .Data science and model predictive control: A survey of recent advances on data-driven MPC algorithms. Journal of Process Control, 144 : 103327.

Nievas N.,Bernaus A.,Bonada F.,Echeverria L.,Domingo X. .2024 .Reinforcement learning for autonomous process control in Industry 4.0: Advantages and challenges. Applied Artificial Intelligence, 38(1) : .

Osoko E. A.,Rahmon S. O. .2023 .Reinforcement learning-based control improves efficiency and precision in smart manufacturing robotics. World Journal of Advanced Engineering and Technology., : .

Qin S. J.,Badgwell T. A. .2003 .A survey of industrial model predictive control technology. Control Engineering Practice, 11(7) : 733-764.

Rawlings J. B.,Mayne D. Q.,Diehl M. .2020 .Model predictive control: Theory, computation, and design. Nob Hill Publishing., : .

Razmi D. .2025 .Reinforcement learning-driven dynamic model predictive control for adaptive real-time multi-agent management of microgrids. International Journal of Electrical Power and Energy Systems., : .

Saeed A.,Khan M. A.,Obidallah W. J.,Jawed S. .2025 .Deep learning based approaches for intelligent industrial machinery health management and fault diagnosis in resource-constrained environments. Scientific Reports, 15 : 1114.

Schaal S.,Atkeson C. G.,Vijayakumar S. .2019 .Scalable techniques from nonparametric statistics for real-time robot learning. IEEE Robotics & Automation Magazine, 26(1) : 50-64.

Ahmed Seid,Abubakar Y.,Arif A. A.,Al-Badour A. F. M.,F. A. A. F. M. .2025 .Advances in fault detection techniques for automated manufacturing systems in industry 4.0. , 11 : 1564846.

Mamani Soza,K. M. Soza,Romo & Prado,A. J. & Prado .2025 .Integrating model predictive control with deep reinforcement learning for robust control of thermal processes with long time delays. Processes, 13(6) : 1627.

Sutton R. S.,Barto A. G. .2018 .Reinforcement learning: An introduction (2nd ed. , : .

Tian H.,Tang J.,Wang T. .2024 .Furnace temperature model predictive control based on particle swarm rolling optimization for municipal solid waste incineration. Sustainability, 16(17) : 7670.

Wan Y.,Xu Q.,Dragičević T. .2025 .Reinforcement learning-based predictive control for power electronic systems. IEEE Transactions on Industrial Electronics., : .

Wang S.,Li H.,Shi H.,Sun Q.,Li P. .2024 .Dynamic output feedback robust MPC hybrid fault-tolerant control for discrete uncertain systems: A switching control strategy. International Journal of Control, 98(7) : 1518-1531.

Zhang R.,Xue A.,Gao F. .2014 .Temperature control of industrial coke furnace using novel state space model predictive control. IEEE Transactions on Industrial Informatics, 10(4) : 2084-2092.