Semi-Supervised Learning Detector for MU-MIMO Systems with One-bit ADCs
Seonho Kim, Song-Nam Hong

TL;DR
This paper introduces a semi-supervised learning detector for MU-MIMO systems with one-bit ADCs, reducing pilot data requirements while maintaining high detection performance.
Contribution
It proposes a semi-supervised learning approach using EM algorithm to estimate system parameters with less labeled data compared to existing supervised methods.
Findings
SSL detector achieves similar performance to SL detector
Significantly reduces pilot-overhead
Effective in multiuser MU-MIMO with one-bit ADCs
Abstract
We study an uplink multiuser multiple-input multiple-output (MU-MIMO) system with one-bit analog-to-digital converters (ADCs). For such system, a supervised-learning (SL) detector has been recently proposed by modeling a non-linear end-to-end system function into a parameterized Bernoulli-like model. Despite its attractive performance, the SL detector requires a large amount of labeled data (i.e., pilot signals) to estimate the parameters of the underlying model accurately. This is because the amount of the parameters grows exponentially with the number of users. To overcome this drawback, we propose a semi-supervised learning (SSL) detector where both pilot signals (i.e., labeled data) and some part of data signals (i.e., unlabeled data) are used to estimate the parameters via expectation-maximization (EM) algorithm. Via simulation results, we demonstrate that the proposed SSL detector…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced MIMO Systems Optimization · Analog and Mixed-Signal Circuit Design · Distributed Sensor Networks and Detection Algorithms
Semi-Supervised Learning Detector for MU-MIMO Systems with One-bit ADCs
Seonho Kim and Song-Nam Hong
Ajou University, Suwon, Korea,
email: {kimsh1005 and snhong}@ajou.ac.kr
Abstract
We study an uplink multiuser multiple-input multiple-output (MU-MIMO) system with one-bit analog-to-digital converters (ADCs). For such system, a supervised-learning (SL) detector has been recently proposed by modeling a non-linear end-to-end system function into a parameterized Bernoulli-like model. Despite its attractive performance, the SL detector requires a large amount of labeled data (i.e., pilot signals) to estimate the parameters of the underlying model accurately. This is because the amount of the parameters grows exponentially with the number of users. To overcome this drawback, we propose a semi-supervised learning (SSL) detector where both pilot signals (i.e., labeled data) and some part of data signals (i.e., unlabeled data) are used to estimate the parameters via expectation-maximization (EM) algorithm. Via simulation results, we demonstrate that the proposed SSL detector can achieve the performance of the existing SL detector with significantly lower pilot-overhead.
Index Terms:
Massive MIMO, one-bit ADC, MIMO detection, Machine Learning, Semi-Supervised Learning, EM Algorithm
I Introduction
Massive multiple-input multiple-output (MIMO) is a promising technology for beyond 5G cellular systems where a large number of antennas at the BS is used to improve the capacity and energy-efficiency [1]. In contrast, it can cause the hardware cost and the radio-frequency (RF) circuit power consumption to increase significantly [2]. Especially, a high-resolution analog-to-digital converter (ADC) is the major problem as the power consumption of an ADC increases exponentially with the number of quantization bits and linearly with the baseband bandwidth[3]. To overcome this challenge, the use of low-resolution ADCs (e.g., 13 bits) for massive MIMO systems has received increasing attention over the past years. The one-bit ADC is particularly attractive as there is no need for an automatic gain controller, which reduces the hardware complexity significantly[4]. In this case, simple zero-threshold comparators quantize the in-phase and quadrature components of the continuous-valued received signals separately. Although low-resolution ADCs provides the advantages, it gives rise to numerous technical challenges in channel estimation and MIMO detections.
For uplink MU-MIMO systems with one-bit ADCs, numerous channel estimation methods were developed as least-square (LS) based method [5], maximum likelihood (ML) method[6], zero-forcing (ZF) type method [6] and Bussgang decomposition based method [7]. Also, regarding MIMO detections, the optimal ML detection was developed in [6], and the low complexity methods were presented in [8, 9]. Inspired by coding theory, the MIMO detection problems have been reconstructed as an equivalent coding problem [10]. Using the resulting model, a weighted minimum distance (wMD) decoding (i.e., an alternative expression of the ML detector) was presented. Very recently, supervised-learning (SL) detectors were proposed in [11, 12, 13] for the considered communication system with one-bit quantized signals. Especially, in our prior work [12], we proposed the generative model, called Bernoulli-like model, by considering the traits of one-bit quantized signals. Despite its attractive performance, the SL detector in [12] requires a large amount of pilot overhead to estimate the model parameters accurately. Thus, it is necessary to reduce a pilot overhead so that the SL detector will be used in practical systems.
In this paper, we study an uplink MU-MIMO system with one-bit ADCs where users with single-transmit antenna communicate with one BS with receive antennas. Also, it is assumed that the BS is not aware of a channel state information (CSI) as in practical communication systems, and needs to estimate it using pilot signals during training phase (see Fig. 1). A block-fading channel is assumed in which the channel is static during the coherence time and changes independently in block-to-block. We assign the first time slots to the channel training phase and the remaining time slots are dedicated to the data transmission phase as shown in Fig. 1. Inspired by semi-supervised learning[14], for such system, we propose a semi-supervised learning (SSL) detector which can significantly reduce the pilot-overhead of the existing SL detector in [12]. The main idea of the proposed SSL detector is that it uses both pilot signals (i.e., labeled data) and some part of data signals (i.e., unlabeled) data to estimate the parameters of the underlying Bernoulli-like model via an efficient expectation-maximization (EM) algorithm. Via simulation results, we demonstrate that the proposed SSL detector can achieve the same performance of the SL detector with a significantly reduced pilot-overhead (e.g., overhead reduction).
This paper is organized as follows. In Section II, we describe an uplink MU-MIMO system with one-bit ADCs and equivalent parallel binary discrete memoryless channels in a coding-theoretic viewpoint. In Section III, we briefly review a SL detector for the considered system. In Section IV, we propose a novel SSL detector with parameter update rules which are built on EM algorithm. Section V provides the simulation results to verify the superiority of the proposed SSL detector. Finally, conclusion is provided in Section VI.
Notation: Lower and upper boldface letters represent column vectors and matrices, respectively. Let for any integers and , and when , it can be further shortened as . For any , we let represent the -ary expansion of where for . We also let denote its inverse function. For a vector, is applied element-wise. Likewise, if a scalar function is applied to a vector, it will be performed element-wise. and represent the real and complex part of a complex vector , respectively.
II Preliminaries
In this section, we describe the system model and define an equivalent parallel binary discrete memoryless channels (DMCs).
II-A System model
We consider a single-cell uplink MU-MIMO system in which users with a single-antenna communicate with one BS with an array of antennas. We denote as the user ’s message for , each of which contains information bits. Also Let -ary constellation set by with power constraint as
[TABLE]
At time slot , the user transmits the symbol as
[TABLE]
where denotes a modulation function. When all the users transmit the symbols , the BS receives the discrete-time complex-valued baseband signal vector , given by
[TABLE]
where is the channel matrix between the BS and the users, for example, the -th row of is the channel vector between the -th receiver antenna at the BS and the users. Also, denotes the noise vector whose elements are distributed as circularly symmetric complex Gaussian random variables with zero-mean and unit-variance, i.e., .
In the MIMO system with one-bit ADCs, each receiver antenna of the BS is equipped with RF chain followed by two one-bit ADCs that are applied to each real and imaginary part respectively. We define as the one-bit ADC quantizer function with if , and , otherwise. Then, the BS receives the quantized output vector as and . For the ease of representation, we rewrite the complex input-output relationship in (3) into the equivalent real representation as
[TABLE]
where , , , and
[TABLE]
where . This real system representation will be used in the sequel.
II-B Equivalent N parallel B-DMCs
In [10], it was shown that a real system representation (4) can be transformed into an equivalent parallel B-DMCs via a coding-theoretic viewpoint. In the resulting parallel B-DMCs, the channel input/output and the channel transition probabilities are defined as follows.
Auto-encoding function: Given , we can create a spatial-domain code , each of which is given by
[TABLE]
where note that each codeword of can be considered as a noiseless channel output in (4). In Fig. 2, the channel input of the equivalent channel is determined by the auto-encoding function such as
[TABLE]
for .
Effective channel: As shown in Fig. 2, the effective channel consists of the parallel BSCs with the channel input and the channel output . This channel is specified by the following channel transition probabilities: For the -th BSC, the transition probability, depending on user’s message and the corresponding codeword , are defined as
[TABLE]
where the error-probability of the -th BSC is computed as
[TABLE]
where .
The purpose of this paper is to design a decoding function in Fig. 2 which decodes from an observation , by leveraging the equivalent effective channel (i.e., the channel transition probabilities in (7)). We remark that the parameters of the transition probabilities are not known a priori and should be estimated with pilot signals during the training phase.
III The Overview of SL Detector
In this section, we briefly review the supervised-learning (SL) detector proposed in [12] with the assumption that a channel matrix is not known. In the SL detector, thus, we need to estimate the parameters and using pilot signals as in parameterized supervised learnings. From (7), we can define the generative model of , named Bernoulli-like model, which are fully described by the parameter vector \hbox{\boldmath\theta}=[\hbox{\boldmath\theta}_{0},\ldots,\hbox{\boldmath\theta}_{m^{K}-1}] where \hbox{\boldmath\theta}_{j}=[{\bf c}_{j},\hbox{\boldmath\epsilon}_{j}], such as
[TABLE]
for . We remark that each class has its own probability distribution parameterized by \hbox{\boldmath\theta}_{j}=[{\bf c}_{j},\hbox{\boldmath\epsilon}_{j}].
The SL detector in [12] performs with the following two-phase during each coherence time .
Parameter Estimation: In this phase, the parameter vector is estimated using pilot signals. We first obtain the labeled data such as
[TABLE]
where represents the pilot signal corresponding to the label . Since pilot signals are transmitted for each codeword, the overall pilot-overhead is equal to . Also, for , the labels are determined as
[TABLE]
denotes the floor function. In [12], from the labeled data , the parameter vector is determined via the optimal maximum-likelihood (ML) estimation as
[TABLE]
for and .
Data Detection: From the Bernoulli-like model parameterize by (12) and (13), the ML detection performs as
[TABLE]
IV The Proposed SSL Detector
Despite its superior performance, the SL detector proposed in [12] suffers from the heavy pilot-overhead because a larger number of pilot signals are required so that an empirical transition probability in (13) is close to the true transition probability in (8). Moreover, this overhead becomes larger as the number of users increases, because the number of parameters to be estimated increases exponentially with the (see (12) and (13)). To address the above problem, we propose a semi-supervised learning (SSL) detector in which the parameter vector is estimated by leveraging both data signals (i.e., unlabeled data ) and pilot signals (i.e., labeled data ). Here, the unlabeled data is collected during time slots (see Fig. 1) such as
[TABLE]
Also, we let denote the observed data to be used for parameter-estimation in the proposed SSL detector.
Parameter Estimation: In this phase, the parameter vector \hbox{\boldmath\theta}=[\hbox{\boldmath\theta}_{0},\ldots,\hbox{\boldmath\theta}_{m^{K}-1}] is updated from the given data so that the conditional probabilities of the observations (i.e., the received binary signals) are maximized. This ML estimation is mathematically formulated as
[TABLE]
Note that from the Bernoulli-like model, we know the probability distribution p({\bf r}[t]|j,\hbox{\boldmath\theta}_{j}) defined in (9) for the given parameter \hbox{\boldmath\theta}_{j}, which will be used in the below. Also, the labels of the labeled data ate given as in (11).
For any fixed parameter , the objective function in (16) is represented as
[TABLE]
where recall that p({\bf r}[t]|j,\hbox{\boldmath\theta}_{j}) is defined in (9), and \mbox{\bb P}(j_{t}|\hbox{\boldmath\theta}_{j_{t}})=1/m^{K} since the users’ messages are assumed to be generated uniformly and randomly. Definitely, the above objective function is non-convex especially due to the second-term caused by the unlabeled data and thus, the optimization problem in (16) is too complex to be solved. We thus solve it using Expectation-Maximization (EM) algorithm[15].
The EM algorithm consists of the following two steps, named expectation-step (E-step) and maximization-step (M-step), respectively: Given the up-to-date parameter vector \hbox{\boldmath\theta}^{i}, it finds the updated parameter vector \hbox{\boldmath\theta}^{i+1}.
E-step: In this step, we compute the following probability distribution using the latest parameter vector \hbox{\boldmath\theta}^{i}:
[TABLE]
This is specified by considering the difference of the labeled and unlabeled data as follows:
- •
(Labeled Data) For and ,
[TABLE]
- •
(Unlabeled Data) For and ,
[TABLE]
M-step: In this step, we find an updated parameter vector \hbox{\boldmath\theta}^{i+1} using the in the above as follows:
[TABLE]
where the objective function is defined as
[TABLE]
where the second equality is from the Bayes rule and (9). Note that in the above is constant with respect to \hbox{\boldmath\theta}_{j}. Also, from the Bernoulli-like model in (9), the objective function in (22) can be specified as
[TABLE]
Since the first-term in the above is constant with respect to , the parameter vector can be optimized by only maximizing the second-term as follows:
[TABLE]
Obviously, we can see that maximizing (IV) is equivalent to maximizing the individual terms in (IV): For each fixed and , we have
[TABLE]
To solve the above problem, we introduce the useful lemma in the below.
Lemma 1
Suppose for , Then is maximized over all probability vectors by .
First of all, we observe that the optimal should satisfy the following constraint for any :
[TABLE]
Also, we can see that this constraint is satisfied by assigning
- •
if ;
- •
if .
Equivalently, we obtain that
[TABLE]
Next, applying Lemma 1 in the below to (IV), the error-probability is optimized as
[TABLE]
Finally, we can compute the log-likelihood (17) using the updated parameter vector \hbox{\boldmath\theta}^{i+1} as
[TABLE]
which is used to check the convergence of EM algorithm. The overall procedures are summarized in Fig. 3 and Algorithm 1 where denotes the pre-determined threshold for the stopping criterion.
Data Detection: For , the SSL detector performs using the latest in (18) as
[TABLE]
Also, for , the detection process of the SSL detector is equivalent to that of the SL detector in Section III. We remark that the performance-complexity tradeoff of the proposed SSL detector is controlled by the choice of .
V Simulation Results
We evaluate the average bit-error rate (BER) performances of the proposed SSL detector and the conventional SL detector. For the simulations, a Rayleigh fading channel is considered where each element of a channel matrix H is drawn from an independent and identically distributed (i.i.d.) circularly symmetric complex gaussian random variable with zero mean and unit variance. a user is assumed to send binary data () and QPSK modulation is applied. A block fading duration (i.e., coherence time interval) is set to be and .
Fig. 4 shows the BER performances of the SSL detector, SL detector, and maximum likelihood detection (MLD) with channel state information at a receiver (CSIR) in a condition of various training duration. It is notable that the performance of proposed SSL detector outperforms the conventional SL detector in the entire SNR regimes where the pilot-overhead is same. In particular, for , the performance of the proposed SSL detector almost achieves that of the SL detector with . This implies that the SSL detector reduces training span () considerably without degradation in performance, by making the best use of information from the generative model and data signals. Also, when compared with MLD in CSIR, this result shows that the proposed method allows the empirical conditional probability to converge into true conditional probability without increasing the number of pilots.
VI Conclusion
In this paper, we presented a novel semi-supervised learning detector inspired by semi-supervised learning. Specifically, the proposed SSL detector updates parameters by using data signals through the maximum likelihood estimation under the Bernoulli-like model. Such parameter updates can significantly reduce pilot-overhead that is an issue in the existing SL detector. The simulation results demonstrated that the performance of the SSL detector almost achieves that of the SL detector, even with a quite lower pilot-overhead than that of the SL detector. We would like to emphasize that a SSL detector would be a strong practical framework in a field of machine learning based detector, in that compared with pilot signals, data signals are fairly cheap to obtain. On going work, we are investigating to develop more practical SSL detectors which require low complexity or are appropriate for time-varying channel system.
Acknowledgement
This work was supported by Samsung Research Funding & Incubation Center of Samsung Electronics under Project Number SRFC-IT1702-00.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] L. Lu, G. Y. Li, A. L. Swindlehurst, A. Ashikhmin, and R. Zhang, “An overview of massive mimo: Benefits and challenges,” IEEE journal of selected topics in signal processing , vol. 8, no. 5, pp. 742–758, 2014.
- 2[2] H. Yang and T. L. Marzetta, “Total energy efficiency of cellular large scale antenna system multiple access mobile networks,” in Online Conference on Green Communications (Green Com), 2013 IEEE . IEEE, 2013, pp. 27–32.
- 3[3] A. Mezghani and J. A. Nossek, “Modeling and minimization of transceiver power consumption in wireless networks,” in Smart Antennas (WSA), 2011 International ITG Workshop on . IEEE, 2011, pp. 1–8.
- 4[4] S. Hoyos, B. M. Sadler, and G. R. Arce, “Monobit digital receivers for ultrawideband communications,” IEEE Transactions on Wireless Communications , vol. 4, no. 4, pp. 1337–1344, 2005.
- 5[5] C. Risi, D. Persson, and E. G. Larsson, “Massive mimo with 1-bit adc,” ar Xiv preprint ar Xiv:1404.7736 , 2014.
- 6[6] J. Choi, J. Mo, and R. W. Heath, “Near maximum-likelihood detector and channel estimator for uplink multiuser massive mimo systems with one-bit adcs,” IEEE Transactions on Communications , vol. 64, no. 5, pp. 2005–2018, 2016.
- 7[7] Y. Li, C. Tao, G. Seco-Granados, A. Mezghani, A. L. Swindlehurst, and L. Liu, “Channel estimation and performance analysis of one-bit massive mimo systems,” IEEE Trans. Signal Process , vol. 65, no. 15, pp. 4075–4089, 2017.
- 8[8] C. Mollén, J. Choi, E. G. Larsson, and R. W. Heath, “One-bit adcs in wideband massive mimo systems with ofdm transmission,” in Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on . IEEE, 2016, pp. 3386–3390.
