DFE/THP duality for FBMC with highly frequency selective channels
Hela Jedda, Leonardo G. Baltar, Oliver De Candido, Amine Mezghani,, Josef A. Nossek

TL;DR
This paper introduces a novel THP design for FBMC/OQAM systems, leveraging MSE duality from a MMSE decision feedback equalizer to improve performance in highly frequency selective channels.
Contribution
It proposes a new THP design based on MSE duality, enhancing FBMC/OQAM performance in challenging frequency selective environments.
Findings
Improved equalization in highly frequency selective channels
Enhanced spectral efficiency for 5G applications
Effective mitigation of ISI and ICI
Abstract
Filter bank based multicarrier with Offset-QAM systems (FBMC/OQAM) are strong candidates for the waveform of future 5-th generation (5G) wireless standards. These systems can achieve maximum spectral efficiency compared to other multicarrier schemes, particularly in highly frequency selective propagation conditions. In this case a multi-tap, fractionally spaced equalizer or precoder needs to be inserted in each subcarrier at the receiver or transmitter side to compensate inter-symbol interference (ISI) and inter-carrier interference (ICI). In this paper we propose a new Tomlinson-Harashima precoder (THP) design for FBMC/OQAM based on the mean squared error (MSE) duality from a minimum MSE (MMSE) designed decision feedback equalizer (DFE).
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
DFE/THP duality for FBMC with Highly Frequency Selective Channels
Abstract
Filter bank based multicarrier with Offset-QAM systems (FBMC/OQAM) are strong candidates for the waveform of future 5-th generation (5G) wireless standards. These systems can achieve maximum spectral efficiency compared to other multicarrier schemes, particularly in highly frequency selective propagation conditions. In this case a multi-tap, fractionally spaced equalizer or precoder needs to be inserted in each subcarrier at the receiver or transmitter side to compensate inter-symbol interference (ISI) and inter-carrier interference (ICI). In this paper we propose a new Tomlinson-Harashima precoder (THP) design for FBMC/OQAM based on the mean squared error (MSE) duality from a minimum MSE (MMSE) designed decision feedback equalizer (DFE).
**Index Terms— ** Filter Bank Multicarrier, Offset-QAM, Decision Feedback, Tomlinson-Harashima, MSE duality
1 Introduction
In recent years multi-carrier systems have been at the forefront of communication systems due to their attractive properties at high data rates. Orthogonal frequency division multiplexing with a cyclic prefix (CP-OFDM) is a widely implemented solution for multi-carrier systems in standards such as IEEE 802.11, LTE or VDSL. Its popularity is partly due to the simple equalization enabled by the CP and the efficient implementation using Fast Fourier Transform (FFT). However, this comes at the price of a loss in spectral efficiency due to the CP, which is extremely long in the presence of highly frequency selective channels. CP-OFDM additionally suffers from high out-of-band emissions and the necessity of perfect synchronization.
An alternative solution to CP-OFDM are FBMC/OQAM systems which are a strong contender for 5G mobile communication systems [1]. FBMC/OQAM systems have improved spectral efficiency due to the Synthesis and Analysis Filter Banks (SFB and AFB) at the transmitter and receiver [2], which guarantees higher selectivity in the frequency domain and a much lower out-of-band radiation compared with CP-OFDM [3]. This form of pulse shaping limits the ICI, whilst simultaneously attributing to more ISI within each individual sub-carrier. Furthermore, FBMC/OQAM systems are extremely efficient in the presence of highly frequency selective channels. These advantages over CP-OFDM come at the cost of slightly higher computational complexity, however, this is not problematic [4].
In [5] an MMSE-based, multi-tap, per sub-carrier, linear equalizer design for a Single Input Single Output (SISO) setting was introduced to compensate the ISI and ICI in the presence of highly frequency selective channels. In [6] a DFE extension of [5] was proposed. In situations where the channel impulse response is known at the transmitter side, it is usually preferred to employ a precoder in order to avoid noise coloring and noise power amplification at the receiver. Additionally, if there is a symmetry in the computational power, e.g. cellular networks, where most of the processing can be concentrated at the base station, i.e. precoding in the downlink (DL) and equalization in the uplink (UL). In [7] the authors proposed MIMO-FBMC precoders based on the signal-to-leakage plus noise ratio (SLNR) and on the signal-to-interference plus noise ratio (SINR). In [8] three precoders are inserted in each subcarrier to combat ICI. In [9] a THP is proposed for frequency flat channels in each subcarrier. In [10] linear precoders based on the MSE duality with the linear equalizer was extended for the Multi-User Multiple Input Single Output (MU-MISO) setting. In this contribution we propose a THP design for SISO FBMC/OQAM systems using the MSE duality and the DFE design from [6].
This paper is organized as follows: in Section 2 we introduce the FBMC system model. In Section 3 we calculate the MSE for the DFE and show its MMSE solution as in [6]. In Section 4 we explain the THP and define its MSE. We explore two different methods to transform the DFE into a dual THP in Section 5. In Sections 6 and 7 we interpret the simulation results and summarize this work.
Notation: Bold letters indicate vectors and matrices, non-bold letters express scalars. The operators , , and stand for complex conjugation, the transposition, Hermitian transposition and the expectation, respectively. The identity matrix is denoted by while the zeros (ones) matrix with rows and columns is defined as (). We define , . The operator concatenates vertically the real- and imaginary valued parts of the vector/matrix . The vector represents a zero vector with 1 in the -th position.
2 FBMC System Model
In a SISO FBMC system, the SFB combines the complex valued QAM input signals , , generated at a rate of , into a single complex valued signal at a higher rate of . The signal is transmitted across a highly frequency selective additive white Gaussian noise channel to the receiver. In our system, corresponds to the total number of sub-carriers and the number of sub-carriers we transmit across. The AFB separates the received signal back into its components at the lower rate per sub-carrier.
The first operation in the SFB is the O-QAM staggering of the input and the output sequence reads as
[TABLE]
The input symbol is split into its real and imaginary parts, up-sampled by a factor of 2, then depending on which sub-carrier we observe, either or symbol is delayed by exactly and finally these components are added together. Due to this characteristic of the O-QAM symbols, there is a phase change of between immediately adjacent sub-carriers, ensuring orthogonality between them. At the receiver, the AFB applies O-QAM de-staggering to reconstruct the complex QAM symbols from the equalized symbols.
Since an implementation as described above is not very efficient due to the extremely high data rate, an implementation as a Modified DFT (MDFT) filter bank is much more efficient. An MDFT filter bank takes advantage of exponentially modulated, pulse shaping filters given by
[TABLE]
where is a lowpass prototype filter with length , with representing the overlapping factor to indicate the number of symbols which overlap in time. should be kept as small as possible not only to limit the complexity but also to reduce the time-domain spreading of the symbols and the transmission latency. Furthermore, MDFT takes advantage of the polyphase decomposition of so that the filtering can be performed at a rate of only .
To minimize the complexity in the calculations of the equalizer and precoder vectors, we set and the roll-off factor of our root raised cosine filter equal to one. Thus, the frequency response of the filter only significantly overlaps with the two adjacent filters.
For a simple total transmission notation we define the following filtering and downsampling operation, . This represents the total impulse response from the sub-carrier at the transmitter into the sub-carrier at the receiver, with . The resulting filter has length .
In the following sections we work with a purely real notation and therefore define a purely real input sequence as where the relation holds with
[TABLE]
This extracts the imaginary ’s from the input signal. We then multiply the transposed convolution matrix of by and are left with .
3 Decision Feedback Equalizer
We are interested in designing a multi-tap decision feedback equalizer per sub-carrier with feed-forward (FF) filter of length and feedback (FB) filter of length and a single-tap precoder per sub-carrier. We assume there is no channel state information at the transmitter and, therefore, set the scalar precoder to one, i.e. . The received and equalized signal in sub-carrier , when is odd, i.e. for , is defined as
[TABLE]
where we define
[TABLE]
where is the downsampled, transposed convolution matrix of which filters the noise and is the equalization latency in our system. For the following derivations we assume the input signals to be independent and identically distributed (i.i.d.) and Gaussian distributed. The covariance matrix of is defined as . Furthermore, we assume the additive noise is Gaussian distributed with .
The MMSE equalizer is given by
[TABLE]
where
[TABLE]
where . The MSE can be expressed by
[TABLE]
It can be shown, that calculating the precoder or equalizer filters with either the real part ( is odd) or imaginary part ( is even) result in the same solution [5, 11].
4 Thomlinson Harashima Precoder
We define a per sub-carrier, multi-tap THP with FF filter and FB filter and a per sub-carrier single-tap equalizer at the receiver. Since we have a feedback loop in the THP, we are at risk of stability problems. Therefore, we additionally introduce the modulo operator at the transmitter and the receiver in the DL scenario, that upper bounds the output signals. The modulo operator that is adapted to the O-QAM structure is expressed as
[TABLE]
where is the modulo constant and depends on the modulation alphabet [12]. The modulo operators can be replaced by the summations of the signals and , which are multiples of , as shown in Fig. 1. The output of the modulo operator at the transmitter in sub-carrier is denoted by and we define with covariance matrix and [13].
The MSE of the DL scenario can be expressed by
[TABLE]
5 DFE/THP MSE duality Transformation
In this Section we investigate two different methods of transforming the DFE into an equivalent THP using the duality principle as introduced in [14]. The basic idea behind an MSE duality transformation is to switch the roles of the UL and DL filters, i.e. we interchange each receiver filter in the UL scenario with the respective transmitter filter in the DL scenario. As the dual DL scenario has purely transmitter processing, we must ensure that the transmit power is subsequently limited, thus we weigh every transmitter filter with a strictly real constant and multiply the receiver with its inverse.
These two duality transformation methods are summarized as follows:
- •
In Subsection 5.1 we aim at conserving the Sum-MSE. This is the simplest form of duality since the Sum-MSE of all sub-carriers is kept equal when transforming the UL to a DL scenario. To this end, a single scaling factor is required which leads to relatively low computational complexity.
- •
In Subsection 5.2 we aim at conserving the Sub-Carrier MSE. In this method the MSE per sub-carrier is preserved when transforming the UL to a DL scenario resulting in an individual scaling factor for each sub-carrier. We get a linear system of equations for scaling factors, which results in a higher computational complexity than a Sum-MSE transformation.
In both of these MSE duality transformations the total transmit power is preserved, i.e. .
5.1 Sum-MSE
First, we define a relation between the UL and DL filters with a real-valued scaling factor for all sub-carriers such that
[TABLE]
with and recalling that the UL precoder scalar is set such that . To perform the Sum-MSE duality, the Sum-MSE is set equal between the UL and the DL scenario, i.e. we sum over all sub-carriers and set them equal
[TABLE]
We get the following expression of the scaling factor
[TABLE]
This form of duality transformation guarantees equality in the Sum-MSE between the UL and the DL scenario. Therefore, this method can be interpreted as allocating an equal amount of transmit power whilst spreading this transmit power across the sub-carriers as required. The disadvantage of this method arises if the MSE of certain sub-carriers is disproportionately large. This leads to these sub-carriers obtaining a greater amount of transmit power.
5.2 Sub-Carrier MSE (SC-MSE)
Second, we define a relation between the UL and DL filters with a real-valued scaling factor per sub-carrier such that
[TABLE]
with and recalling that the UL precoder is set such that . We then set sub-carrier MSE equal between the UL and the DL scenario, i.e. we set the individual MSE expressions per sub-carrier equal such that
[TABLE]
We end up with a system of linear equations to solve for scaling factors
[TABLE]
[TABLE]
This duality transformation guarantees that each SC-MSE remains equal for both UL and DL scenario. Therefore, we cannot spread the transmit power amongst the sub-carriers but instead we normalize the filter in each sub-carrier individually.
6 Simulation Results
Throughout our simulations we transmitted data across of the available sub-carriers. The used multipath fading channel is based on bad urban area model (BU) with 6 taps. We used a sampling rate of MHz and a channel impulse response of duration samples. Thus, we had a subcarrier distance of kHz. We used randomly generated -QAM symbols and took a block length of symbols per sub-carrier. For the used modulation scheme, we have following modulo constant value . With the chosen system configurations, especially due to and the highly frequency selective channel, a CP-OFDM system would have required a CP with a minimum length of 109. This would have limited the data-throughput of the CP-OFDM to almost 50%, therefore we have not included a direct comparison in the simulation results. Throughout the simulations we took the quantity of to be a pseudo-signal-to-noise ratio. We took the Bit Error Rate (BER) and MSE as an average over all sub-carriers. We took an average over randomly generated channel realizations.
We investigated six equalizers and precoders designs: a linear equalizer of length taps, its two dual precoders (SC-MSE and Sum-MSE), DFE with FF filter with and FB filter with taps and its two dual THPs. Note that the complexity of the FB filter is proportional to half of its length , since its input and output are either purely real or purely imaginary.
As can be concluded from Fig. 2 and Fig. 3, the non-linear processing (DFE/THP) outperform the linear processing significantly in medium to high regime for the same complexity. Second, the Sum-MSE duality seems to be more beneficial than the SC-MSE duality. Third, the Sum-MSE dual THP compared to DFE shows an improved BER performance and similar behavior in terms of MSE.
7 Conclusions
In this work, we proposed a new method to design a dual THP scheme from the DFE of a SISO FBMC system. To this end, we made use of the MSE duality transformation between an UL and a DL scenario, where either the Sum-MSE or the SC-MSE is conserved. Throughout our simulations we observed first that the non-linear processing (DFE/THP) outperform the linear processing in medium to high region for the same complexity. Second, we have seen that the Sum-MSE duality performed the best in terms of BER over the whole regime, which could be explained by its equivalence to an inverse water-filling technique, i.e. the subcarriers with poorer channel response are allocated more power.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. Banelli et al., “Modulation formats and waveforms for 5G Networks: Who will be the heir of OFDM?,” Signal Proc. Mag., IEEE , vol. 31, no. 6, Nov 2014.
- 2[2] P. Siohan, C. Siclet, and N. Lacaille, “Analysis and design of OFDM/OQAM systems based on filterbank theory,” IEEE Trans. on Signal Proc. , vol. 50, no. 5, pp. 1170–1183, 2002.
- 3[3] L. G. Baltar, D.S. Waldhauser, and J. A. Nossek, “Out-of-band radiation in multicarrier systems: A comparison,” in 6th Int. Workshop on Multi-Carrier Spread-Spectrum , May 2007.
- 4[4] L. G. Baltar, F. Schaich, M. Renfors, and J. A. Nossek, “Computational complexity analysis of advanced physical layers based on multicarrier modulation,” in Future Networks & Mobile Summit , Jun. 2011.
- 5[5] D. S. Waldhauser, L. G. Baltar, and J. A. Nossek, “MMSE subcarrier equalization for filter bank based multicarrier systems,” in IEEE 9th Workshop on Signal Proc. Adv. in Wireless Comm. , Jul. 2008, pp. 525–529.
- 6[6] L.G. Baltar, D. S. Waldhauser, and J. A. Nossek, “MMSE subchannel decision feedback equalization for filter bank based multicarrier systems,” in IEEE Int. Symp. on Circuits and Syst. , Mai. 2009, pp. 2802–2805.
- 7[7] M. Caus and A.I. Perez-Neira, “Transmitter-receiver designs for highly frequency selective channels in MIMO FBMC systems,” IEEE Trans. on Signal Proc. , vol. 60, no. 12, pp. 6519–6532, Dec. 2012.
- 8[8] F. Horlin et al., “Interference-free SDMA for FBMC-OQAM,” EURASIP J. on Adv. in Signal Proc. , vol. 46, Mar. 2013.
