Neural Networks in Hybrid Precoding for Millimeter Wave Massive MIMO Systems
Jing Yang, Kai Chen, Xiaohu Ge, Yonghui Li, Lin Tian

TL;DR
This paper explores mapping hybrid precoding in mmWave massive MIMO systems to multi-layer neural networks, proposing a decomposition algorithm and analyzing the impact on system performance and energy efficiency.
Contribution
It introduces a novel approach to design hybrid precoding using neural networks by decomposing the baseband precoding matrix and evaluates its feasibility and performance impact.
Findings
Optimal number of users minimizes performance deterioration
Decomposition causes slight deterioration in throughput and energy efficiency
Proposed method is feasible for neural network-based hybrid precoding
Abstract
Neural networks have been applied to the physical layer of wireless communication systems to solve complex problems. In millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems, hybrid precoding has been considered as an energy-efficient technology to replace fully-digital precoding. The way of designing hybrid precoding in mmWave massive MIMO systems by multi-layer neural networks has not been investigated. Based on further decomposing the baseband precoding matrix, an idea is proposed in this paper to map hybrid precoding structure to a multi-layer neural network. Considering the deterioration in the throughput and energy efficiency of mmWave massive MIMO systems, the feasibility of the proposed idea is analyzed. Moreover, a singular value decomposition (SVD) based decomposing (SVDDE) algorithm is proposed to evaluate the feasibility of the proposed idea.…
| Parameters | Values |
| Bandwidth | 1 GHz |
| Transmission Power | 5 W |
| Path loss exponent | 4.6 |
| The number of multipath | 20 |
| Efficiency of PAs | 38 % |
| Power of a phase shifter | 12 mW |
| Power of an RF chain | 57 mW |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMillimeter-Wave Propagation and Modeling · Microwave Engineering and Waveguides · Antenna Design and Analysis
11institutetext: School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, Hubei, China
11email: [email protected]
22institutetext: School of Electrical and Information Engineering, University of Sydney, Sydney, Australia
33institutetext: Beijing Key Laboratory of Mobile Computing and Pervasive Devices, Institute of Computing Technology, Chinese Academy of Sciences, China
Neural Networks in Hybrid Precoding for Millimeter Wave Massive MIMO Systems††thanks: This work was supported by the National Key Research and Development Program of China under Grant 2017YFE0121600.
Jing Yang 11 0000-0003-4639-6592
Kai Chen 11
Xiaohu Ge 11 0000-0002-3204-5241
Yonghui Li 22
Lin Tian 33
Abstract
Neural networks have been applied to the physical layer of wireless communication systems to solve complex problems. In millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems, hybrid precoding has been considered as an energy-efficient technology to replace fully-digital precoding. The way of designing hybrid precoding in mmWave massive MIMO systems by multi-layer neural networks has not been investigated. Based on further decomposing the baseband precoding matrix, an idea is proposed in this paper to map hybrid precoding structure to a multi-layer neural network. Considering the deterioration in the throughput and energy efficiency of mmWave massive MIMO systems, the feasibility of the proposed idea is analyzed. Moreover, a singular value decomposition (SVD) based decomposing (SVDDE) algorithm is proposed to evaluate the feasibility of the proposed idea. Simulation results indicate that there is an optimal number of users which can minimize the performance deterioration. Moreover, the simulation results also show that slight deterioration in the throughput and energy efficiency of mmWave massive MIMO systems is caused by further decomposing the baseband precoding matrix. In other words, further decomposing the baseband precoding matrix is a feasible way to map the hybrid precoding structure to a multi-layer neural network.
Keywords:
Neural networks Millimeter wave Massive MIMO Hybrid precoding.
1 Introduction
The design and optimization of the fifth generation (5G) wireless communication system become challenging, due to the expectation of satisfying the key performance indicators (KPIs) in 5G usage scenarios, such as 100 Mbit/s user experienced data rate, 10 Gbit/s peak data rate, 1 millisecond (ms) over-the-air latency and connectivity density [1, key-2]. Combining the millimeter wave (mmWave) communication and massive multiple-input multiple-output (MIMO) technology is a feasible solution to meet the KPIs [2]. Meanwhile, the signal processing of baseband units (BBUs) becomes more complicated in 5G base stations (BSs) [3]. In this case, it is intractable to optimize the real-time hybrid precoding in multi-user mmWave massive MIMO systems [4, 5]. Neural networks, one of the technologies in artificial intelligence (AI), have shown the great application value to solve complex and intractable problems in image recognition, automatic control and healthcare [6, 7, 8]. Therefore, it is attractive to apply neural networks to design hybrid precoding for multi-user mmWave massive MIMO systems.
Some studies have already investigated the application of neural networks for the physical layer of wireless communication systems. The work in [9] proposed a procedure to predict channel characteristics of mmWave massive MIMO systems, based on convolutional neural networks. Moreover, the predicted results in [9] showed the well matching with the real channel characteristics. In the channel estimation of mmWave massive MIMO systems, the estimation with the help of neural networks was better than the state-of-the-art compressed sensing algorithms [10]. In addition to the channel estimation, neural networks were also used for the modulation classification of raw IQ samples, which achieved competitive accuracy [11]. Considering the unmanageable joint optimization problem of the coverage and capacity in mmWave massive MIMO systems, the authors in [12] enhanced the service coverage and the spectrum efficiency by applying neural networks to solve the joint optimization problem. Combining the distributed massive MIMO with neural networks, more accurate results of user positioning had been achieved [13], which paves the way for network operators to provide better context-aware communication services. It is emerging in designing the physical layer of 5G wireless communication systems by neural networks. The work in [14] provided a comprehensive survey of applications which uses multi-layer neural networks to solve problems in cellular networks. Based on the results in [14], the existing studies, related to the application of neural networks in the physical layer of cellular networks, is divided into five categories, i.e., signal detection, modulation classification, error correction, interference alignment management and anti-jamming. Applications of neural networks in wireless communication systems remain to be explored.
Precoding is one of the key technologies in the physical layer of massive MIMO systems to improve the spectrum efficiency. Considering the high cost of radio frequency (RF) chains in mmWave band for fully-connected precoding, hybrid precoding is proposed in mmWave massive MIMO systems [15]. The topology of the fully-connected phase shifter network in hybrid precoding structure is similar to neural networks. To our knowledge, studies related to design hybrid precoding by multi-layer neural networks have not appeared in the available literature. Inspired by this vacancy in knowledge, the objective of this paper is proposing an idea to map the hybrid precoding structure to multi-layer neural networks. The idea is based on the further decomposition of the baseband precoding matrix in hybrid precoding. Furthermore, an SVD-based decomposing (SVDDE) algorithm is proposed to evaluate the feasibility of the proposed idea. The simulation results show that the performance deterioration in the throughput and energy efficiency of mmWave massive MIMO systems can be caused when the baseband precoding matrix in hybrid precoding is further decomposed. In this case, modeling the hybrid precoding structure as multi-layer neural networks is feasible in mmWave massive MIMO systems.
The rest of this paper is outlined as follows. Section II describes the system model. In Section III, an idea is proposed to map hybrid precoding to a multi-layer neural network. Moreover, the feasibility of the proposed idea is analyzed. Section IV provides the simulation results. Finally, conclusions are drawn in Section V.
2 System Model
As shown in Fig. 1, single antenna users are served by the mmWave massive MIMO system with fully-connected hybrid precoding. The BS is equipped with antennas and RF chains. Moreover, the values of , and satisfy . The phase shifter network in Fig. 1 contains phase shifters (PSs). The baseband precoding matrix is denoted as and the RF precoding matrix is denoted as . The downlink channel matrix is , where is the downlink channel vector between the BS and the user. The received signal at the user is given as
[TABLE]
where is transmitted signal vector for users satisfying , () is the transmitted signal for the user. is the noise received by the user. and satisfy where is the transmission power.
The Saleh-Valenzuela channel model is considered as the mmWave channel model [16] and is given as
[TABLE]
where is the total number of multipath between the BS and users. The large-scale fading coefficient is denoted as , where is the path loss exponent of mmWave and is the distance between the BS and the user [17]. is the complex gain of signals at the multipath [18]. The array response vector of the uniform linear array (ULA) in Fig. 1 is written as
[TABLE]
where is the azimuth angle of signals at the multipath, is the wavelength of mmWave, is the inter-antenna spacing.
3 The Neural Network in Hybrid Precoding
3.1 The Mapping of A Multi-Layer Neural Network
Most of the studies related to neural networks are training software-based neural networks. Few works have been done in training hardware-based neural networks to achieve learning [19]. In fully-connected hybrid precoding structure (Fig. 1), the phase shifter network has similar topology to neural networks. Furthermore, the baseband precoding processing in BBUs is described as the matrix-vector multiplication , which is similar to the mathematic model of neural networks, i.e., the multiplication between weight matrices and input data vectors. It is reasonable to map the hybrid precoding structure in Fig. 1 to a one-layer neural network in Fig. 2a.
The essence of precoding is the signal processing between the input data streams and antennas array. The input data streams and antennas array are treated as the input layer and output layer, respectively, for the equivalent neural network in Fig. 2. In Fig. 2a, the hybrid precoding structure in mmWave massive MIMO systems is mapped to a single-hidden-layer neural network, whose weight matrices are and . In hybrid precoding, the digital precoding can adjust both the amplitude and phase of signals and the RF precoding can only change the phase of signals, which implies that the mapped neural network in Fig. 2a has two weight matrices with different properties. There is no denying that multi-layer neural networks commonly have better performance than one layer neural networks. It is reasonable to map the hybrid precoding structure to a multi-layer neural networks. More than two weight matrices are needed in mapping the hybrid precoding structure to a multi-layer neural network. In addition to matrices and , new weight matrices have to be obtained.
Hybrid precoding is proposed by decomposing fully-digital precoding into a digital baseband precoding and an analog RF precoding. Inspired by the decomposition of fully-digital precoding, an idea that mapping the hybrid precoding structure to a multi-layer neural network is proposed. The baseband precoding matrix is first decomposed into two new sub-matrices. These new sub-matrices are treated as new weight matrices for a two-layer neural network in Fig. 2b. Different from software-based neural networks and hardware-based neural networks, the equivalent neural network in Fig. 2b is a software-hardware hybrid neural network which consists of a software-based neural network in BBUs and a hardware-based neural network in the phase shifter network. Software-based neural networks have been widely implemented. In contrast, the implementation of hardware-based neural networks still has knotty technical problems. One formidable challenge for implementations of the hardware-based neural network in Fig. 2 is to achieve learning in the phase shifter network. Considering that the software-hardware hybrid neural network has not been implemented, we only investigate the feasibility of the proposed idea.
Considering that the proposed idea is based on further decomposing , we speculate on the feasibility of the proposed idea by using existing methods, due to the difficulty of implementing the software-hardware hybrid neural network. The proposed idea is feasible at the case that the performance deterioration, caused by the decomposition of , is slight in the throughput and energy efficiency of mmWave massive MIMO systems. Considering a widely used approach to decompose , the decomposition algorithm should be proposed and the impact of further decomposing on the throughput and energy efficiency of mmWave massive MIMO systems with hybrid precoding structure has to be analyzed. The throughput and energy efficiency of mmWave massive MIMO systems is derived in the following.
The received signal-to-interference-plus-noise ratio (SINR) at the user is calculated as
[TABLE]
where is the column vector of . Thus, the throughput for the BS to simultaneously serve users is presented by
[TABLE]
where is the bandwidth.
In Fig. 1, the mmWave massive MIMO system with hybrid precoding structure consists of power amplifiers (PAs), the phase shifter network, RF chains and BBUs. The total power consumption of the mmWave massive MIMO system is
[TABLE]
where is the power of PAs, is the efficiency of PAs [20, 21]. The power consumption of the phase shifter network is , where is the power of a single PS. The power consumption of RF chains is , where is the power of one RF chain. The power consumed by BBUs can be obtained by
[TABLE]
where the first term is the power consumption of the multiplication in precoding processing, is the number of floating-point operations for the multiplication . The second term in (7) is the power consumption of the precoding algorithm used in BBUs, is the number of floating-point operations for the precoding algorithm. The coherence bandwidth and coherence time of mmWave frequency are denoted as and , respectively. The typical values of and in mmWave massive MIMO systems are and , respectively [22, 23]. is defined as the computation efficiency of BBUs, whose typical value is [24].
Based on (5) and (6), the energy efficiency of the mmWave massive MIMO system with hybrid precoding structure is denoted as
[TABLE]
3.2 The Decomposition Based on SVD
Assuming that the BS has the perfect channel state information (CSI), the near-optimal baseband precoding matrix for maximizing the is equivalent zero-forcing (ZF) precoding [4] which is given by
[TABLE]
where is the equivalent downlink channel matrix for users, is the optimal RF precoding matrix which can be written as linear combination of , e.g., vectors with different as columns of [15]. is a diagonal matrix to normalize . The singular value decomposition (SVD) is widely used to decompose a matrix. Accordingly, the SVD of is considered as the decomposition approach to investigate the feasibility of the proposed idea. Define the SVD of as , where is a left singular vector matrix and is a right singular vector matrix. is a diagonal matrix containing the nonzero singular values of in decreasing order, i.e., . Set and , is rewritten as . Decomposing into two sub-matrices and , a new hidden layer is added to the equivalent neural network which is a two-layer neural network in Fig. 2b. Moreover, both matrices and are treated as the weight matrices for the two-layer neural network.
Combining the mmWave communication and massive MIMO technologies in 5G BSs complicates the real-time signal processing in BBUs. Moreover, the number of floating-point operations in precoding processing has been increased, which increases the power consumption of BBUs [3]. Considering that the power consumption of BBUs has a great impact on the energy efficiency of mmWave massive MIMO systems, the decomposition of should not increase the power consumption of BBUs, i.e., not increasing the number of floating-point operations in hybrid precoding. The number of floating-point operations for multiplications and are and , respectively. The additional number of floating-point operations in hybrid precoding processing is denoted as . When is decomposed into two sub-matrices and , and which indicates that the number of floating-point operations is increased. Therefore, another two matrices and have to be constructed to make , i.e., the number of floating-point operations in the multiplication is less than or equal to the number of floating-point operations in the multiplication .
The SVD of can be rewritten as
[TABLE]
where is the column vector of and is the row vector of . Based on (10), and are constructed as
[TABLE]
and
[TABLE]
where is the number of column and row vectors in and . The number of floating-point operations for the multiplication is . Considering the constraint , i.e.,, the value of satisfies
[TABLE]
Based on (13), the value of is smaller than , which indicates that the multiplication is the approximation of the multiplication . Define the square of the Euclidean distance as the error , which is derived as
[TABLE]
Based on (14), the smaller the value of is, the larger the error will be. Furthermore, the performance deterioration in the throughput of mmWave massive MIMO systems depends on the value of . Considering that the value of is a positive integer, the maximum value of is given as
[TABLE]
where is the floor function of a real number , i.e., outputs the greatest integer which is less than or equal to . When , is the smallest. On the contrary, is the largest for . An SVD-based decomposing (SVDDE) algorithm is proposed in the following to decompose the baseband precoding matrix into two sub-matrices. The proposed SVDDE algorithm is given as follows.
3.3 Computational Complexity Analysis
The number of floating-point operations is considered as the computational complexity. One of the input in Algorithm 1 is the near-optimal baseband precoding matrix , which is obtained by consuming floating-point operations. The SVD, in the first step of Algorithm 1, needs floating-point operations [25]. Moreover, the number of floating-point operations in generating two matrices and is . Therefore, the computational complexity of Algorithm 1 is .
Based on the computational complexity of Algorithm 1, the computation power of BBUs is calculated and the total power consumption of the mmWave massive MIMO system is obtained. Therefore, the performance deterioration in the energy efficiency of mmWave massive MIMO systems can be analyzed.
4 Simulation Results
In this section, simulation results are provided to show the impact of decomposing on the throughput and energy efficiency of mmWave massive MIMO systems with hybrid precoding structure. The carrier frequency is assumed to be 28 GHz. Moreover, there are 256 antennas and 60 RF chains in the mmWave massive MIMO system. Other default values of parameters in the mmWave massive MIMO system are listed in Table 1.
Fig. 3 shows the error with respect to the number of users, considering different numbers of RF chains. The results in Fig. 3 indicate that the value of first decreases with the number of users. However, there is an inflection point, i.e., for and for , where the value of starts increasing instead. Based on the results in Fig. 3, there is an optimal number of users which can minimize the error. It is possible to use multi-layer neural networks to optimize the number of RF chains to minimize the error for different numbers of users.
In Fig. 4, the throughput as a function of the number of users is illustrated when different numbers of RF chains is considered. Moreover, the equivalent ZF algorithm is simulated for performance comparison. The results in Fig. 4 indicates that the further decomposition of the baseband precoding matrix, based on the SVDDE algorithm, causes the performance deterioration in the throughput of mmWave massive MIMO systems with hybrid precoding structure. Based on the results in Fig. 4, the gap between the equivalent ZF algorithm and the SVDDE algorithm in terms of the throughput is shrunk when the number of users is increased. Therefore, a slight performance deterioration in the throughput of multi-user mmWave massive MIMO systems is caused by further decomposing the baseband precoding matrix.
Fig. 5 illustrates the energy efficiency with respect to the number of users, considering different numbers of RF chains. Based on the results in Fig. 5, the energy efficiency decreases with the number of users. One of two reasons for the decreasing of the energy efficiency is ascribed to the deterioration of the throughput in Fig. 4. Based on (7), increasing the number of users grows the power consumption on BBUs, which is another reason for the decreasing of the energy efficiency. The gap between the equivalent ZF algorithm and the SVDDE algorithm in terms of the energy efficiency is narrowing with increasing the number of users in Fig. 5. Therefore, a slight performance deterioration in the energy efficiency of multi-user mmWave massive MIMO systems is caused by further decomposing the baseband precoding matrix.
5 Conclusions
In this paper, an idea of further decomposing the baseband precoding matrix is proposed to map the hybrid precoding structure in mmWave massive MIMO systems to a multi-layer neural network. Moreover, an SVDDE algorithm is proposed to evaluate the feasibility of the proposed idea. Simulation results indicated that there is an optimal number of users which can minimize the performance deterioration. The existence of the optimal number of users shows the opportunity of applying multi-layer neural networks to design hybrid precoding. Moreover, simulation results also show that slight performance deterioration in the throughput and energy efficiency of mmWave massive MIMO systems is caused by further decomposing the baseband precoding matrix of hybrid precoding structure. Therefore, it is feasible to map the hybrid precoding structure of mmWave massive MIMO systems to a multi-layer neural network. For the future study, we will investigate the design of hybrid precoding based on software-hardware hybrid neural networks.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Ge, X., Tu, S., Mao, G., Wang, C.X., Han, T.: 5G Ultra-Dense Cellular Networks. IEEE Wireless Communications 23, 72-79 (2016)
- 2[2] Ge, X., Ye, J., Yang, Y., Li, Q.: User Mobility Evaluation for 5G Small Cell Networks Based on Individual Mobility Model. IEEE Journal on Selected Areas in Communications 34, 528-541 (2016)
- 3[3] Ge, X., Tu, S., Han, T., Li, Q., Mao, G.: Energy efficiency of small cell backhaul networks based on Gauss-Markov mobile models. IET Networks 4, 158-167 (2015)
- 4[4] Ge, X., Yang, J., Gharavi, H., Sun, Y.: Energy Efficiency Challenges of 5G Small Cell Networks. IEEE Communications Magazine 55, 184-191 (2017)
- 5[5] Zi, R., et al.: Energy Efficiency Optimization of 5G Radio Frequency Chain Systems. IEEE Journal on Selected Areas in Communications 34, 758-771 (2016)
- 6[6] Ge, X., Cheng, H., Guizani, M., Han, T.: 5G wireless backhaul networks: challenges and research advances. IEEE Network 28, 6-11 (2014)
- 7[7] He, K., Zhang, X., Ren, S., Sun, J.: Deep Residual Learning for Image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778. (Year)
- 8[8] Gao, H., He, W., Zhou, C., Sun, C.: Neural Network Control of a Two-Link Flexible Robotic Manipulator Using Assumed Mode Method. IEEE Trans. Ind. Inform. 1-1 (2018)
