Improvement of training set structure in fusion data cleaning using
Time-Domain Global Similarity method
Traditional data cleaning identifies dirty data by classifying original data sequences, which is a classimbalanced problem since the proportion of incorrect data is much less than the proportion of correct ones for most diagnostic systems in Magnetic Confinement Fusion (MCF) devices. When using machine learning algorithms to classify diagnostic data based on classimbalanced training set, most classifiers are biased towards the major class and show very poor classification rates on the minor class. By transforming the direct classification problem about original data sequences into a classification problem about the physical similarity between data sequences, the classbalanced effect of TimeDomain Global Similarity (TDGS) method on training set structure is investigated in this paper. Meanwhile, the impact of improved training set structure on data cleaning performance of TDGS method is demonstrated with an application example in EAST POlarimetryINTerferometry (POINT) system.
View on arXiv