Abstract
To promote reliable and secure communications in the cognitive radio network, the automatic modulation classification algorithms have been mainly proposed to estimate a single modulation. In this paper, we address the classification of superimposed modulations dedicated to 5G multiple -input multiple-output (MIMO) two-way cognitive relay network in realistic channels modeled with Nakagami-m distribution. Our purpose consists of classifying pairs of users modulations from superimposed signals. To achieve this goal, we apply the higher-order statistics in conjunction with the Multi-BoostAB classifier. We use several efficiency metrics including the true positive (TP) rate, false positive (FP) rate, precision, recall, F-Measure and receiver operating characteristic (ROC) area in order to evaluate the performance of the proposed algorithm in terms of correct superimposed modulations classification. Computer simulations prove that our proposal allows obtaining a good probability of classification for ten superimposed modulations at a low signal-to-noise ratio, including the worst case (i.e., m = 0.5), where the fading distribution follows a one-sided Gaussian distribution. We also carry out a comparative study between our proposal using MultiBoostAB classifier with the decision tree (J48) classifier. Simulation results show that the per-formance of MultiBoostAB on the superimposed modulations classifications outperforms the one of J48 classifier. In addition, we study the impact of the symbols number, path loss exponent and relay position on the performance of the proposed automatic classification superimposed modulations in terms of probability of correct classification.