|
Research Topics
My research interests lie in deep reinforcement learning, multi-agent systems, and home energy management. I am particularly interested in developing sample-efficient, generalizable, and safe RL algorithms for coordinating heterogeneous smart home energy devices. Representative papers are highlighted.
|
Generalizable Zero-Shot Home Energy Management via Representation Learning and Behavioral Cloning
Xiao Du,
Fengji Luo,
Juntao Hu,
Wei Zhou,
Junhao Wen
Applied Soft Computing, 2026
[Paper]
Abstract
Deep reinforcement learning (DRL) is widely used in home energy management for its ability to handle nonlinearity and uncertainty. However, its reliance on trial-and-error interaction makes early unsafe and inefficient behaviors impractical in real households. To address this, we propose RB-ZeroHEM, a zero-shot knowledge transfer framework based on representation learning and behavioral cloning. RB-ZeroHEM employs contrastive learning to extract stable, physics-aligned representations of household energy dynamics from historical control trajectories, enabling clustering-based similarity measurement without hand-crafted features. For a new household, it identifies the most similar source cases and clones a deployable policy requiring zero target-environment interactions. Experiments on 12 simulated households driven by real-world energy data demonstrate that when transferring to physically similar environments, RB-ZeroHEM reduces discomfort ratio by 33% and electricity costs by 15% compared to rule-based control, while achieving 81% of the grid energy savings of the best online DRL method with zero interactions.
|
Causally Aligned Multi-Agent Reinforcement Learning for Coordinated Control of Heterogeneous Home Energy Devices
Xiao Du,
Fengji Luo,
Juntao Hu,
Wei Zhou,
Junhao Wen
IEEE Internet of Things Journal, 2026
[Paper]
Abstract
Deep reinforcement learning (DRL) has emerged as a promising paradigm for home energy management systems (HEMS) due to its model-free nature and ability to handle complex dynamics. However, existing DRL-based approaches typically employ a unified reward function that aggregates multiple objectives into a single scalar, failing to account for the heterogeneous roles of controllable energy devices (CEDs) and their distinct causal relationships with control objectives. This leads to reward misattribution, where CEDs with simpler constraints dominate the optimization process while critical components such as battery storage remain underutilized. To address this challenge, we propose a causally aligned multi-agent reinforcement learning (MARL) framework that explicitly models CED-objective causal pathways using a structural causal model (SCM). A causal surgery procedure decomposes shared objectives into CED-specific variants, enabling individualized reward signals aligned with each CED s causal responsibility. The proposed HR-MASAC algorithm features a multi-head centralized critic for learning vectorized Q-values and agent-specific entropy coefficients for heterogeneous exploration. Experiments across diverse home scenarios demonstrate that our method achieves 40.1% cost reduction and 57.1% comfort improvement over unified-reward baselines, with robust performance under sensor noise and household heterogeneity.
|
Multienergy Management Control Schedule Design Method for Parallel Hybrid Electric Turbofan Engine under Different Flight Conditions
Jiajie Chen,
Feifan Yu,
Xiao Du,
Xinmin Chen,
Jiqiang Wang,
Xiaokang Sun
Journal of Aerospace Engineering, 2026
[Paper]
Abstract
In the parallel hybrid electric propulsion system (PHEPS), the integrated electric power system serves as an augmenter to the conventional turbomachinery. In order to maximize the performance improvement for the original aeroengine components, this study presents a novel multienergy management control schedule design method for each different flight condition. Through digital simulation and hardware in the loop simulation based on a parallel hybrid geared turbofan engine (PH-GTF) model, results show that compared with the baseline GTF engine, the PH-GTF propulsion system exhibits significant performance improvements: 31% reduction in compressor airflow losses, 5% and 2% surge margin improvements in the low-pressure compressor during accelerated/decelerated transients, and 18.8% fuel savings under the cruise condition.
|
Fusion-Based Dual-Task Architecture for Predicting the Remaining Useful Life of an Aeroengine
Xiao Du,
Jiajie Chen,
Jiqiang Wang,
Haibo Zhang,
Junhao Wen
Journal of Aerospace Engineering, 2025
[Paper]
Abstract
This paper proposes a fusion-based dual-task architecture that jointly performs degradation pattern recognition and remaining useful life prediction for aeroengines, achieving improved prediction accuracy through multi-source information fusion.
|
A Novel Method of Vibration Control for Internal and External Cases of Aero-Engines Based on Geometric Design Method
Ran An,
Jiajie Chen,
Xiao Du,
Haibo Zhang,
Jiqiang Wang
Journal of Nanjing University of Aeronautics and Astronautics, 2023
[Paper]
Abstract
Because of the complexity of the structure and the instability of the external air flow, a lot of vibration problems will inevitably occur during the operation of aero-engine. Aiming at the vibration problem of the whole aero-engine, a general dynamic model of rotor-support-casing vibration transmission is established according to the actual structure of the aero-engine and the summary of experience. Moreover, starting from the vibration control problem of the internal and external casing of aero-engine, a new control algorithm (geometric design method) is used in this paper to design the vibration reduction controller in the limited frequency domain. In the case of limited sensors and actuator, the controller will be used to try to control the vibration of multiple outputs (ie, the inner and outer casings of the aero-engine), and compare the vibration reduction effect with the vibration reduction controller designed by the classical control theory method (PID). Finally, the simulation model is built and verified by Matlab/Simulink. The results show that the geometric design method can intuitively obtain the existence, uniqueness and optimality of the optimal controller in the limited frequency domain, and the optimal vibration reduction control for the main control object can be as high as 25dB. Compared with traditional control methods, geometric design method has
obvious advantages.
|
Fault Detection of Aero-Engine Sensor Based on Inception-CNN
Xiao Du,
Jiajie Chen,
Haibo Zhang,
Jiqiang Wang
Aerospace, 2022
[Paper]
Abstract
The aero-engine system is complex, and the working environment is harsh. As the fundamental component of the aero-engine control system, the sensor must monitor its health status. Traditional sensor fault detection algorithms often have many parameters, complex architecture, and low detection accuracy. Aiming at this problem, a convolutional neural network (CNN) whose basic unit is an inception block composed of convolution kernels of different sizes in parallel is proposed. The network fully extracts redundant analytical information between sensors through different size convolution kernels and uses it for aero-engine sensor fault detection. On the sensor failure dataset generated by the Monte Carlo simulation method, the detection accuracy of Inception-CNN is 95.41%, which improves the prediction accuracy by 17.27% and 12.69% compared with the best-performing non-neural network algorithm and simple BP neural networks tested in the paper, respectively. In addition, the method simplifies the traditional fault detection unit composed of multiple fusion algorithms into one detection algorithm, which reduces the complexity of the algorithm. Finally, the effectiveness and feasibility of the method are verified in two aspects of the typical sensor fault detection effect and fault detection and isolation process.
|
Nonlinear Control Design of Aero-Engine Based on NGMV
Xiao Du,
Xiao Wang,
Jiqiang Wang
Proceedings of 2021 Chinese Intelligent Systems Conference, 2021
[Paper]
Abstract
Complex and strong nonlinearity are important characteristics of aero-engines, and they often work in harsh environments. How to design a simple, stable, and small-calculation nonlinear controller applying appropriate nonlinear theory is a great challenge. Aiming at this challenge, a controller design method based on Nonlinear Generalized Minimum Variance (NGMV) be proposed by this paper. The NGMV controller of an aero-engine is designed and implemented, and its excellent control performance is proved by comparison with the traditional PI controller.
|
Just Make It Happen (JMIH)
Aero-engine health management digital twin simulation platform「航空发动机健康管理数字孪生仿真平台」
|
Chongqing University, Chongqing, China
PhD in Software Engineering • Sep. 2023 to Now
|
 |
Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
M.E. in Energy and Power Engineering • Sep. 2020 to Apr. 2023
|
 |
Chongqing University, Chongqing, China
B.E. in Renewable Energy Science and Engineering • Sep. 2015 to Jan. 2019
|
 |
|
Service
Reviewer: 22nd International Conference on Principles of Knowledge Representation and Reasoning (2025), Digital Signal Processing, Chinese Journal of Aeronautics
Student President in Chongqing Student Association of China Computer Federation (CCF), 2026-Present
|
|
Awards
First Class Academic Scholarship (NUAA), 2021-2023
Outstanding Master Graduate (NUAA), 2023
Outstanding Communist Youth League cadre (NUAA), 2022
Outstanding Graduate Cadre (NUAA) 2021
Second Prize in Energy Conservation and Emission Reduction Competition (CQU) 2018
Bronze Award of "Shusheng Vanguard" Innovation and Entrepreneurship Competition (CQU)
2018
Outstanding Self-dependent and Self-motivated Individual (Chongqing City) 2017
Outstanding Innovative and Entrepreneurial Individual (CQU) 2016
Outstanding Communist Youth League Member (CQU) 2016
Outstanding Officer of the School's Youth League Committee (CQU) 2016
Outstanding Student (CQU) 2015
Outstanding Student Cadre (CQU) 2015
Third Prize in the Publicity Activity (CQU) 2015
Second Group Award in "Jingying" Youth League School (CQU) 2015
Advanced Individuals of Student Association (CQU) 2015
|
|