A Convolutional Autoencoder Based Fault Detection Method for Metro Railway Turnout

Chen Chen,Xingqiu Li,Kai Huang,Zhongwei Xu and Meng Mei

1School of Electronic and Information Engineering,Tongji University,Shanghai,201804,China

2School of Engineering,City University of Hong Kong,Hong Kong,200433,China

3School of Civil Aviation,Northwestern Polytechnical University,Xi’an,710072,China

4School of Computer Engineering,Jimei University,Xiamen,361021,China

ABSTRACT Railway turnout is one of the critical equipment of Switch & Crossing (S&C) Systems in railway, related to the train’s safety and operation efficiency. With the advancement of intelligent sensors, data-driven fault detection technology for railway turnout has become an important research topic.However,little research in the literature has investigated the capability of data-driven fault detection technology for metro railway turnout. This paper presents a convolutional autoencoder-based fault detection method for the metro railway turnout considering human field inspection scenarios.First,the one-dimensional original time-series signal is converted into a twodimensional image by data pre-processing and 2D representation.Next,a binary classification model based on the convolutional autoencoder is developed to implement fault detection.The profile and structure information can be captured by processing data as images.The performance of our method is evaluated and tested on real-world operational current data in the metro stations.Experimental results show that the proposed method achieves better performance,especially in terms of error rate and specificity,and is robust in practical engineering applications.

KEYWORDS Convolutional autoencoder;fault detection;metro railway turnout

1 Introduction

As an essential mode of transportation, urban rail transit has been rapidly developed in many countries.For instance,China’s urban rail transit(URT)has developed into the most prolonged and widespread urban rail transit network worldwide.By the end of 2021,the total length of China’s URT network has reached more than 9,192 kilometers [1]. The safety and efficiency of the URT network have been receiving increasing attention, which is deeply affected by the URT’s equipment. With the development of URT and the increasing awareness,prognostics and health management(PHM)research in URT has become the focus of attention[2,3].

Railway turnout is the critical infrastructure component in Switch&Crossing (S&C) Systems in high-speed rail, general-speed rail, and URT, which control the switch of tracks in operation [4].Accordingly,railway turnout affects trains’safety and operational efficiency[5,6].This study focuses on PHM research in metro railway turnout.Fault detection and fault diagnosis are the main contents of PHM research.Fault detection aims to identify whether a device is faulty,and fault diagnosis refers to recognizing the type of fault [7]. Fault detection can distinguish fault samples from the test data mixed with large numbers of normal samples to reduce the manual judgment workload.Furthermore,fault detection can be divided into abrupt and incipient fault detection based on the cause of the fault[8,9].This study focuses on abrupt fault detection,which can be viewed as a classification problem.

Recent intelligent sensor advancements have contributed to data-driven PHM research on railway turnout.The related research contents include gap measurement[10-12],electric power analysis[13-15],electric current analysis[16-18],and sound analysis[19-21].These studies are highly dependent on features,and they are divided into three categories according to the way features are constructed:the manual features applied in classifiers approach[22,23],the distance-based measurement approach[14,24],and the automatic features with deep learning approach[25-27].There are two types of features for the manual features and classifiers approach: signal-processing-based and statistical features.Márquez et al. [22] extracted 11 time-domain features from the point machine’s current and force signal.An et al.[23]proposed a multi-scale analysis and feature extraction method for high-speed rail’s turnout switch machine. The fault features were represented by the wavelet packet’s energy entropy.Conversely, the main idea of the distance-based measurement approach is to realize identification by comparing the distance metric. Meanwhile, it requires standard curves of various turnout states.Huang et al.[28]used Fréchet distance to distinguish normal and abnormal turnout current curves for general-speed rail.Although the above two methods proved effective,these methods highly depend on expert experience.

The automatic features with deep learning approach have become an emerging research topic in PHM research[29].Deep learning can solve the limitations of the expert experience by providing an efficient way to extract features automatically[30,31].Zhang et al.[25]proposed a convolutional neural network method for the fault diagnosis of high-speed railway turnout. This study combines 2-D image representation and convolutional operation to extract features automatically.However,this work only decomposed time series data piecewise and stacked it into two-dimensional images,losing the original curve data’s profile and spatial structure information.Guo et al.[26]designed a stacked autoencoder method for fault detection of high-speed railway turnout. Chen et al. [27] developed a sparse autoencoder approach to detect the health condition of general speed train turnout.The data process method of literature[26,27]was to process the data directly as a one-dimensional vector,which destroyed the data’s profile and structure information,leading to the loss of curve data information.

As described,most existing approaches focus on the turnout of high-speed rail and normal-speed railway. Although some studies have applied the data-driven fault detection method to monitoring URT turnout [32,33], little research has considered preserving the curve data’s profile and structure information. This paper develops a fault detection method for URT turnout to address the above limitations. The real on-site detection method in URT is to read the pictures of the current curve and make a judgment based on the profile and structure of the curve.By using the image-based data processing method,curve data’s profile and structure information can be preserved and in line with the domain knowledge in real-life inspection scenarios.The convolution operation and autoencoder are combined to extract features and modeling as the processed data are image data.In summary,this study makes the following contributions:

1. This paper proposes a method for detecting metro turnout faults that applies to solving a practical engineering issue.

2. The proposed data processing method fully considers the real detection scene of metro turnout by preserving the curve data’s profile and structure information.

3. Data from real metro stations validated the proposed method.

This paper is organized as follows: railway turnout and field data description are given in Section 2. The proposed research method is illustrated in Section 3. In Section 4, we evaluate and test the proposed method using real-world operational data.Lastly,the conclusion and future work are drawn in Section 5.

2 Railway Turnout and Field Data Formulation

S&C Systems mainly include rails,actuators,and turnout(switch machine),as shown in Fig.1.In this study,the research object is the switch machine,and the machine type is ZDJ9.In general,there are two types of definitions for railway turnouts.According to the literature[22],turnout can refer to a switch machine or the combination of switches and crossing.In this article,the authors adopt the term ‘turnout’to describe the switch machine. A microcomputer monitoring system is mainly used in China to monitor turnouts online via their current or power signals. It can be detected whether a turnout is faulty through current signals analysis since current signals reflect the condition of the turnout’s movement [32,34]. All-round rail transit control system integrator (CASCO) collected the real-life data used in this study.Three subway stations in Shanghai Metro Line 13 have been tested:Jinyun Road,Nanjing West Road,and Fengzhuang.

Figure 1:A simplified schematic diagram of S&C systems in railway

The current curve of ZDJ9 includes A, B, and C three-phase currents with the 380 V threephase AC power supply.According to the literature[25],compared with B-phase and C-phase current curves,A-phase current curve can provide more comprehensive information on the turnout movement.Therefore,this study uses the A-phase current curve to monitor the ZDJ9.The state transition of the switch machine is divided into two situations:positioning to reverse position and reverse position to positioning. Due to the similarity of the A-phase current’s profile and trend in two conditions, this paper takes the case of normal to reverse position as an example,as shown in Fig.2.

Figure 2:The A-phase current curve

The A-phase current curve consists of four stages:unlocking,switching,locking,and switching on.The specific description of each stage is as follows:

(1) Stage 1(unlocking)(T0-T1):

After the switch machine starts,it must overcome the strong resistance to complete the unlocking.Therefore,the motor needs to provide strong power support.The current increase rapidly,showing a prominent pulse peak on the curve.Afterward,power and current return to standard levels.

(2) Stage 2(conversion)(T1-T2):

The conversion process requires less resistance and relatively more minor power than the unlocking stage.The switch machine provides power to pull the switch to realize the conversion.This process is time-consuming, and the power is maintained at a relatively stable value. The current curve also keeps a smooth straight line with slight fluctuation.

(3) Stage 3(locking)(T2-T3):

After the conversion process is completed, the position of the switch needs to be fixed, and the tip rail is not allowed to move by an external force.This stage is locking.The locking process time is short,and the curve has no prominent feature.

(4) Stage 4(slow release)(T3-T4):

The switch state transition is completed when the lock ends and the current is disconnected with the switch action.The circuit is turned on,resulting in a rapid drop in the switch machine’s operating current.

ZDJ9 turnout takes 7-9 s to accomplish once state transition, with the sample rate of 25 Hz.Specifically, the field dataset consisted of 500 normal and 500 fault samples. Each current curve includes 256 sample points.

3 Methodology

This paper develops a convolutional autoencoder-based (CAE) method for modeling and identifying turnout using the A-phase current curve.The method’s inputs are A-phase current signals of turnout.The outputs are whether the switch is faulty.As shown in Fig.3,there are two modules in the presented approach.

(1) Curve data pre-processing and image generation.The primary purpose of this module is to preprocess curve data to match the input requirements of the convolutional autoencoder-based model.The process involves the cleaning,normalization,and image generation of the current curve data.The MATLAB software is performed to generate images in a specified size.With the processed data,we can complete the next module’s convolution.

(2) Classification modeling.A CAE model is designed to identify the current curve.The input of this module is the current curve images,and the module’s output is the trained model for fault detection.

Figure 3:The flowchart of the presented approach

3.1 Curve Data Pre-Processing and Image Generation

The real on-site turnout detection in URT is to read the images of electrical characteristic curves.The 2D image represents the raw current signals based on this domain knowledge.MATLAB’s‘plot’and‘saveas’functions are used to generate images from raw current curves.The size of the generated images in this study was set to 32×32.The whole process is shown in Fig.4.

Figure 4:The flowchart for converting time series to images

To summarize, unlike the previous study [22,23], this step does not require complex signal processing calculations, nor does it destroy the spatial structure of the current curve. Furthermore,it combines on-site manual detection with the real scene.

3.2 Proposed CAE-Based Model

The convolutional autoencoder is a type of autoencoder that is effective for unsupervised learning. It introduces convolutional operations into the encoding and decoding steps. Through the combination of convolutional operations and autoencoders, it provides powerful feature extraction and unsupervised feature clustering. In encoding, convolution and pooling are used to map highdimensional image data to low-dimensional feature space. In the decoding part, the feature space is reconstructed and transformed into the original data by deconvolution and unpooling.Intermediate hidden layers can effectively represent the original data and provide features for classifiers[35].

In practical engineering application scenarios, the sample size is often relatively small. In this situation,we designed the network structure as shown in Fig.5,where the encoding part includes two convolution operations and the corresponding two pooling operations,and the decoding part includes two deconvolution operations and the corresponding two unpooling operations.

Figure 5:Schematic diagram of the proposed network structure

The configuration of each layer of the proposed structure is shown in Fig.6. Specifically, the meaning of‘Conv2D’is the 2D convolution operation.‘Deconv2D’means the 2D deconvolution operation.‘Maxpooling2D’represents 2D max-pooling operation.‘Unpooling2D’denotes 2D unpooling operation. (3×3×16) represents the size of the convolution kernel or deconvolution kernel is 3×3,and the number of the corresponding filter is 16. (2×2) means the size of the pooling kernel or unpooling kernel is 2×2. ‘Full-connected’denotes the fully connected layer, and the corresponding(64) represents 64 neurons in the layer. The autoencoder’s loss function is the mean squared error(MSE) function. The classifier layer consists of two neurons whose loss function is the SoftMax function to perform classification.

Let us consider the operation dataset iswhereis a current signal,andNdenotes the number of the current signal.A brief introduction of the proposed method will be presented as follows.

Following data processing and image transformation,the input matrixAis represented as follows:

wheremandnrepresent the length and width of the matrix.

(1) The convolution operation for matrixAis represented as:

whereCis the activation map of the input matrixA,fjis thejthconvolution filter andσ(·)denotes the activation function.The size of the image is 2k+1.The direction is indicated as the x-axis and y-axis,respectively.

(2) The encoding part of the convolutional autoencoder is as follows:

Through the convolution operation, the original data is mapped into the feature spaceand the encoding operation is as follows:

whereAirepresents the input matrix, * denotes the 2-D convolution,Fkis the kthfilter for 2-D convolution,b1denotes encoder bias,σ(·)represents the activation function.

And the pooling operation is denoted as follows:

wheresiis the feature space after pooling operation, anduirepresents the feature space calculated by convolution,σ(·)is the activation function, W denotes the weight matrix for the kthpooling operation,b2denotes bias.

Then the decoder operation is as follows:

whereis the decoder reconstruction of input dataAi,σ(·)represents the activation function,siis the feature space after pooling operation calculation,Fkis the kthfilter for 2-D convolution of decoder,b3denotes bias.

Then the unsupervised loss function is as follows:

Theqthlayer features are proposed to represent the original images through unsupervised clustering of autoencoders.The first and the(k ＞2)hidden layers features are shown as follows

whereWqis the weight matrix,bqis the bias vector.

Then the selected hidden layer features are fed into the fully connected layer for classification.The SoftMax function is used as the activation function of the classifier’s output layer,and the SoftMax function is represented as follows:

wherehdenotes the input vector.

The specific formula of the classifier’s output layer is:

whereW(k+1)the weight matrix,b(k+1)is the bias vector.

The corresponding loss function of the classifier is

4 Experiments on Field Data

The proposed method is validated by the real field current turnout data in the metro system,as described in Section 2.First,we pre-process the field data by cleaning and normalization.Next,the data is transformed into the 32×32 images by MATLAB function, with 500 normal and 500 fault samples.In this study,the positive sample represents the fault sample,and the negative sample denotes the normal sample.The ratio of the training set to the test set is 8:2.Lastly,comparative experiments are conducted to analyze the proposed method.

4.1 Experimental Setup

The deep learning framework keras accomplish the developed method with python 3.6.All models are implemented on the workstation with NVIDIA RTX 2080 GPU and Intel i7-8700 CPU.There are four evaluation metrics selected for comparison.The metrics are error rate,F1-score,sensitivity,and specificity.The definitions and formulas of these evaluation metrics are shown as follows:

? Error rate:the probability of recognition error.

? F1-score:a measure of prediction accuracy.

? Sensitivity:the probability of a positive sample being predicted to be positive.

? Specificity:the probability that a negative sample is predicted to be negative.

where the values TP,FP,TN,and FN correspond to True Positive,False Positive,True Negative,and False Negative,respectively.

Specifically, true positives indicate the number of positive samples predicted correctly. False negatives indicate the number of positive samples predicted as negatives.False positives indicate the number of negative samples predicted as positives,and true negatives indicate the number of negative samples predicted correctly.

4.2 Performance Comparison

To evaluate the performance of the presented method, we compared it with the fault detection models in the existing literature.The comparison models include the convolutional neural networks(CNN) model [25], stacked autoencoder (Stacked AE) model [26], and stacked sparse autoencoder(Stacked SAE) model [27]. Stacked AE and Stacked SAE models use autoencoders and sparse autoencoders for feature extraction, respectively. The classifier layer consists of two neurons whose loss function is the SoftMax function to perform classification.The CNN model’s input is the same as this study’s image data.For the Stacked AE and Stacked SAE models,the input is the vector of the original time series in the A-phase current curve. The model’s network structure and key parameter settings follow the original literature’s settings.The comparison experiment is conducted from three perspectives:model performance under different epochs,batch sizes,and the best parameters.Table 1 shows the detail of the hyper-parameters setting in the models, wherer,b, anderepresent learning rate,batch size,and epoch,respectively.

Table 1: Hyper-parameters setting of the models for comparison

Table 1 (continued)Model Hyper-parameters Training range Stacked SAE {r, b, e} {[0.0001,1],[5,25],[5,25]}Proposed CAE {r, b, e} {[0.0001,1],[5,25],[5,25]}

Experiment 1:Comparison of different models with changes in the number of epochs.

With other parameters fixed, models’performances in terms of evaluation metrics in different epoch numbers are shown in Tables 2 and 3. The proposed CAE model performs better than other methods in each evaluation index under different iteration times.The experimental results verify the feasibility and effectiveness of the proposed method.

Table 2: Comparison of models for error rate and F1-score with different epoch numbers

Table 3: Comparison of models for sensitivity and specificity with different epoch numbers

Experiment 2:Comparison of different models with the change in batch size.

With other parameters fixed,models’performances in evaluation metrics in different batch sizes are shown in Tables 4 and 5.The proposed CAE model performs better than other methods in each evaluation index under different batch sizes.The experimental results further verify the feasibility and effectiveness of the proposed method.

Table 4: Comparison of models for error rate and F1-score with different batch size

Table 5: Comparison of models for sensitivity and specificity with batch sizes

Experiment 3:Models’performance under the best parameters.

Under the best parameters, models’performances in evaluation metrics are shown in Table 6.We find that proposed CAE and CNN perform better than other methods. The reason is that the image-based processing method contains more information than the one-dimensional array processing method. The proposed CAE method also outperforms the CNN model because the proposed CAE use the autoencoder to reduce the dimension for data representation.

To summarize, the proposed model offers two distinct advantages over the other method.Firstly, the data processing process considers the curve data’s profile and structure information.Meanwhile, the convolution autoencoder model combines the advantages of convolution operation and autoencoder.Consequently,the proposed method performs well compared to other related studies in experiments 1,2,and 3,demonstrating our approach’s robustness.

Table 6: Comparison of each model under the best parameters

4.3 Discussion on the Detection Failures Case

The samples that failed to be identified in experiment 3 were clustered by k-means clustering and analyzed.Three types of fault samples could not be entirely correctly identified.The specific examples are shown in Fig.7.

Figure 7:The examples of detection failures case

As a result,the proposed method is difficult to completely identify the fault curve if the profile or structure is relatively small changes compared to the standard curve.

5 Conclusion

This study proposes a convolutional autoencoder-based fault detection method for metro railway turnout. The presented method included 1) Curve data pre-processing and image generation and 2)Classification modeling based on the convolutional autoencoder.Furthermore,the main contribution lies in developing a new data-driven fault detection method for metro railway turnout without expert experience-based feature engineering. The proposed method combines the advantages of convolutional operations and autoencoders. Specifically, the developed method is evaluated and validated with real-world operation data. While our approach is highly dependent on the quality of the data,it is difficult to identify some kinds of samples.Furthermore,the proposed method still needs to improve accuracy and interpretability,and incipient fault detection is not considered.

Future work will focus on the model’s accuracy, interpretability, and incipient fault detection.We will improve the model’s accuracy and interpretability by circuit physics modeling and the neural network’s loss functions embedded with the partial differential equations. For the incipient fault detection, a dynamic model of the turnout circuit will be constructed based on circuit parameters,describing the degradation process. Afterward, threshold technology will be used to recognize the incipient fault.

Acknowledgement:The authors would like to thank the all-round rail transit control system integrator(CASCO)for providing research data and domain knowledge support.

Funding Statement:This research work is supported in part by the National Natural Science Foundation of China under Grant U1734211.

Conflicts of Interest:The authors declare that they have no conflicts of interest to report regarding the present study.