1.
Jafri, Meesam; Kumar, Pankaj; Srivastava, Suraj; Jagannatham, Aditya K.; Hanzo, Lajos
Robust Hybrid Beamforming in Cooperative Cell-Free mmWave MIMO Networks Relying on Imperfect CSI Journal Article
In: IEEE Transactions on Vehicular Technology, vol. 74, no. 8, pp. 12590–12602, 2025, ISSN: 1939-9359.
Abstract | Links | BibTeX | Tags: Antenna arrays, Array signal processing, cell-free networks, Channel estimation, cooperative beamforming, CSI uncertainty, Downlink, Millimeter wave communication, MIMO, mmWave, Radio frequency, robust beamforming, Uncertainty, Uplink, Vectors
@article{jafri_robust_2025,
title = {Robust Hybrid Beamforming in Cooperative Cell-Free mmWave MIMO Networks Relying on Imperfect CSI},
author = {Meesam Jafri and Pankaj Kumar and Suraj Srivastava and Aditya K. Jagannatham and Lajos Hanzo},
url = {https://ieeexplore.ieee.org/document/10945645},
doi = {10.1109/TVT.2025.3555484},
issn = {1939-9359},
year = {2025},
date = {2025-08-01},
urldate = {2025-10-08},
journal = {IEEE Transactions on Vehicular Technology},
volume = {74},
number = {8},
pages = {12590–12602},
abstract = {A low-complexity robust cooperative hybrid beamformer is designed for both the downlink and uplink of cell-free millimeter wave (mmWave) multiple-input-multiple-output (MIMO) networks, while considering realistic imperfect channel state information (CSI). To begin with, a second-order cone program (SOCP)-based robust fully-digital beamformer (FDBF) is designed for minimizing the worst-case interference for the downlink of multiple-input-single-output (MISO) systems. Subsequently, we develop a Bayesian learning (BL) framework for determining both the analog and digital components of the hybrid transmit precoder (TPC) from the FDBF. The above designs are subsequently extended to employing eigenvector perturbation theory for constructing the robust TPC for the cell-free mmWave MIMO downlink, where the users have multiple receive antennas (RAs). Furthermore, the multi-dimensional covariance fitting (MCF) framework is harnessed for designing the robust TPC of the corresponding uplink. Finally, the efficiency of the proposed TPC designs is evaluated by simulation results both in terms of their ability to mitigate the multi-user interference (MUI), and improving the spectral efficiency achieved. Additionally, the proposed designs are shown to be computationally efficient and equivalent to a minimum variance hybrid beamformer.},
keywords = {Antenna arrays, Array signal processing, cell-free networks, Channel estimation, cooperative beamforming, CSI uncertainty, Downlink, Millimeter wave communication, MIMO, mmWave, Radio frequency, robust beamforming, Uncertainty, Uplink, Vectors},
pubstate = {published},
tppubtype = {article}
}
A low-complexity robust cooperative hybrid beamformer is designed for both the downlink and uplink of cell-free millimeter wave (mmWave) multiple-input-multiple-output (MIMO) networks, while considering realistic imperfect channel state information (CSI). To begin with, a second-order cone program (SOCP)-based robust fully-digital beamformer (FDBF) is designed for minimizing the worst-case interference for the downlink of multiple-input-single-output (MISO) systems. Subsequently, we develop a Bayesian learning (BL) framework for determining both the analog and digital components of the hybrid transmit precoder (TPC) from the FDBF. The above designs are subsequently extended to employing eigenvector perturbation theory for constructing the robust TPC for the cell-free mmWave MIMO downlink, where the users have multiple receive antennas (RAs). Furthermore, the multi-dimensional covariance fitting (MCF) framework is harnessed for designing the robust TPC of the corresponding uplink. Finally, the efficiency of the proposed TPC designs is evaluated by simulation results both in terms of their ability to mitigate the multi-user interference (MUI), and improving the spectral efficiency achieved. Additionally, the proposed designs are shown to be computationally efficient and equivalent to a minimum variance hybrid beamformer.
2.
Qi, Jiaju; Lei, Lei; Jonsson, Thorsteinn; Hanzo, Lajos
Electric Bus Charging Schedules Relying on Real Data-Driven Targets Based on Hierarchical Deep Reinforcement Learning Journal Article
In: IEEE Access, vol. 13, pp. 99415–99433, 2025, ISSN: 2169-3536.
Abstract | Links | BibTeX | Tags: {>}Deep reinforcement learning, Batteries, charging control, Costs, deep reinforcement learning, electric bus, Electricity, hierarchical reinforcement learning, Real-time systems, Schedules, Scheduling, Stochastic processes, Uncertainty, Vehicle-to-grid
@article{qi_electric_2025,
title = {Electric Bus Charging Schedules Relying on Real Data-Driven Targets Based on Hierarchical Deep Reinforcement Learning},
author = {Jiaju Qi and Lei Lei and Thorsteinn Jonsson and Lajos Hanzo},
url = {https://ieeexplore.ieee.org/document/11006647},
doi = {10.1109/ACCESS.2025.3571211},
issn = {2169-3536},
year = {2025},
date = {2025-01-01},
urldate = {2025-10-08},
journal = {IEEE Access},
volume = {13},
pages = {99415–99433},
abstract = {The charging scheduling problem of Electric Buses (EBs) is investigated based on Deep Reinforcement Learning (DRL). A Markov Decision Process (MDP) is conceived, where the time horizon includes multiple charging and operating periods in a day, while each period is further divided into multiple time steps. To overcome the challenge of long-range multi-phase planning with sparse reward, we conceive Hierarchical DRL (HDRL) for decoupling the original MDP into a high-level Semi-MDP (SMDP) and multiple low-level MDPs. The Hierarchical Double Deep Q-Network (HDDQN)-Hindsight Experience Replay (HER) algorithm is proposed for simultaneously solving the decision problems arising at different temporal resolutions. As a result, the high-level agent learns an effective policy for prescribing the charging targets for every charging period, while the low-level agent learns an optimal policy for setting the charging power of every time step within a single charging period, with the aim of minimizing the charging costs while meeting the charging target. It is proved that the flat policy constructed by superimposing the optimal high-level policy and the optimal low-level policy performs as well as the optimal policy of the original MDP. Since jointly learning both levels of policies is challenging due to the non-stationarity of the high-level agent and the sampling inefficiency of the low-level agent, we divide the joint learning process into two phases and exploit our new HER algorithm to manipulate the experience replay buffers for both levels of agents. Numerical experiments are performed with the aid of real-world data to evaluate the performance of the proposed algorithm.},
keywords = {{>}Deep reinforcement learning, Batteries, charging control, Costs, deep reinforcement learning, electric bus, Electricity, hierarchical reinforcement learning, Real-time systems, Schedules, Scheduling, Stochastic processes, Uncertainty, Vehicle-to-grid},
pubstate = {published},
tppubtype = {article}
}
The charging scheduling problem of Electric Buses (EBs) is investigated based on Deep Reinforcement Learning (DRL). A Markov Decision Process (MDP) is conceived, where the time horizon includes multiple charging and operating periods in a day, while each period is further divided into multiple time steps. To overcome the challenge of long-range multi-phase planning with sparse reward, we conceive Hierarchical DRL (HDRL) for decoupling the original MDP into a high-level Semi-MDP (SMDP) and multiple low-level MDPs. The Hierarchical Double Deep Q-Network (HDDQN)-Hindsight Experience Replay (HER) algorithm is proposed for simultaneously solving the decision problems arising at different temporal resolutions. As a result, the high-level agent learns an effective policy for prescribing the charging targets for every charging period, while the low-level agent learns an optimal policy for setting the charging power of every time step within a single charging period, with the aim of minimizing the charging costs while meeting the charging target. It is proved that the flat policy constructed by superimposing the optimal high-level policy and the optimal low-level policy performs as well as the optimal policy of the original MDP. Since jointly learning both levels of policies is challenging due to the non-stationarity of the high-level agent and the sampling inefficiency of the low-level agent, we divide the joint learning process into two phases and exploit our new HER algorithm to manipulate the experience replay buffers for both levels of agents. Numerical experiments are performed with the aid of real-world data to evaluate the performance of the proposed algorithm.