A Deep Two-State Gated Recurrent Unit for Particulate Matter(PM2.5)Concentration Forecasting

Muhammad Zulqarnain，Rozaida Ghazali，＊，Habib Shah，Lokman Hakim Ismail，Abdullah Alsheddy and Maqsood Mahmud

1Faculty of Computer Science and Information Technology，Universiti Tun Hussein Onn Malaysia，Batu Pahat，Johor，Malaysia

2College of Computer Science，King Khalid University，Abha，Saudi Arabia

3College of Computer and Information Sciences，Imam Mohammad Ibn Saud Islamic University，Riyadh，Saudi Arabia

4Department of Management Information Systems，College of Business Administration，Imam Abdulrahman Bin Faisal University，31441，Dammam，Saudi Arabia

Abstract: Air pollution is a significant problem in modern societies since it has a serious impact on human health and the environment.Particulate Matter (PM2.5) is a type of air pollution that contains of interrupted elements with a diameter less than or equal to 2.5 m.For risk assessment and epidemiological investigations，a better knowledge of the spatiotemporal variation of PM2.5 concentration in a constant space-time area is essential.Conventional spatiotemporal interpolation approaches commonly relying on robust presumption by limiting interpolation algorithms to those with explicit and basic mathematical expression，ignoring a plethora of hidden but crucial manipulating aspects.Many advanced deep learning approaches have been proposed to forecast Particulate Matter (PM2.5).Recurrent neural network(RNN) is one of the popular deep learning architectures which is widely employed in PM2.5 concentration forecasting.In this research， we proposed a Two-State Gated Recurrent Unit(TS-GRU)for monitoring and estimating the PM2.5 concentration forecasting system.The proposed algorithm is capable of considering both spatial and temporal hidden affecting elements spontaneously.We tested our model using data from daily PM2.5 dimensions taken in the contactual southeast area of the United States in 2009.In the studies，three evaluation matrices were utilized to compare the overall performance of each algorithm:Mean Absolute Error (MAE)， Root Mean Square Error(RMSE)， and Mean Absolute Percentage Error (MAPE).The experimental results revealed that our proposed TS-GRU model outperformed compared to the other deep learning approaches in terms of forecasting performance.

Keywords: Deep learning;PM2.5 forecasting;air pollution;two-state GRU

1 Introduction

Particulate matter (PM) levels have recently become a global issue.Atmospheric aerosols are groupings of solid or liquid particles suspended in the air that arise from a variety of sources and come in different shapes and sizes.Furthermore，the majority of particulate matter is formed in the lowest layer of the atmosphere.Fine particles having aerodynamic dimensions less than 10 and 2.5 m are referred to as PM10and PM2.5respectively.Many epidemiological studies have demonstrated that PM is extremely harmful to people，especially at high concentrations[1].PM2.5is still a major public health concern[2]，and it has been related to a number of health consequences，such as cancer，respiratory，mortality，and cardiovascular illnesses[3].Environmental exposure analysis has increased significantly due to advances in geospatial technologies，particularly Geographic Information Systems(GIS).An adequate knowledge of PM2.5in a continuous space-time domain is necessary for a useful evaluation of the quantifiable link between adverse health effects and PM2.5concentrations.Because air pollution data is frequently obtained at discrete or restricted sample areas，it is frequently essential to estimation air quality intensity at current information locations inside the region of a finite set of existing data points，which referred to interpolated in quantitative simulation.Based on the assumption，the spatial interpolation approaches have been already widely examined over the years that are higher associated with ordinary spatial interpolation approaches，including Inverse Distance Weighting(IDW)[4]，trend surface[5]and splines[6].

Most well-known interpolation approaches， such as IDW and Kriging， constrain interpolation methods which are commonly described with clear and simple mathematical expression.In contrast to conventional spatial interpolation，spatiotemporal interpolation requires consideration of an additional time dimension.There are some effective and efficient interpolation techniques for complicated spatiotemporal datasets.Some spatiotemporal approaches [7] integrate time and space individually and decrease the temporal interpolated issue to a series of multivariate statistical snapshots.Few other spatiotemporal approaches [8，9] consider time as a separate dimension in space and integrate both temporal and spatial aspects at the same time.Unfortunately，none of the thesis researches provided adequate methodologies for including time aspects， ensuring that the sequential measurement is handled “equitably”in comparison to the spatial dimension.Samal et al.[10] were referred to this issue as the “time scale issue”and later， over the past decades Fioravanti et al.[11] were revised the scaling ratio is known as“spatiotemporal anisotropy parameter”.To estimate this parameter，just a few basic approaches were proposed.The fundamental reason，there is a dearth of strong theoretical assistance for determining the relationship between time and space dimensions.A black box strategy，including the artificial intelligent algorithm，is a reasonable concept and an auspicious way to predict the spatiotemporal assessment parameter in such scenarios.Furthermore，Badli et al.[12]presented an effective parallel machine learning model to address this challenge in order to regulate the appropriate spatiotemporal anisotropy parameters.

Through a hierarchical learning process， deep neural network approaches have extracted highlevel， features from data for learning processing [13].Artificial intelligence inspired the hierarchical learning mechanism，which resembles the deep layered learning mechanism of the core sensory fields of the human brain’s neocortex， which pulls functionalities and abstractions from the core input[14，15].Since its inception，deep learning has been effectively used in time series prediction[16]，object detection [17] natural language processing [18]， medical images analysis [19] multi-class skin cancer classification[20]，and sentiment analysis[21].Deep recurrent neural network(DRNN)[22]is one of the most suitable deep learning models for time series prediction and sequence modelling because it often perceives the current input but also a trace of formerly obtained data through use of repeatable process，that permits a directly dispensation of sequential relationship and other hidden probability.

Lately，in 2017，F(xiàn)an et al.[23]introduced a DRNN-based comprehensive forecast architecture for air pollution level.It’s a helpful forecasting approach that can’t be employed for common interpolation goals.Recently in 2018， Qi et al.[24] proposed broad and efficient technique to address the finegrained air quality interpolation，forecasting，and feature analysis in one model.The RNN was used as the major ingredient in their method as well.Previous RNN-based deep learning approaches relied solely on historical data.Furthermore，they considered that the present air pollution intensity is solely driven to the concerned point’s by previous information and the present air quality strengths of its environmental situations.This argument is flawed because it ignores the time relation between spatial neighbors.

This research intends to create a unique spatiotemporal interpolation technique for predicting PM2.5based on Two-State Gated Recurrent Unit，which considers both past and future spatiotemporal relationships between geographical neighbours.Our methodology enables the creation of more precise air pollution estimates on a vast geographic area due to long period of time.Generally， RNN’s memory of previously acquired patterns fades with time，resulting in a calculation difficulty known as vanishing gradient[25].We explored the advanced variant of recurrent neural networks such as Gated Recurrent Unit(GRU)[26]GRU handles this problem by retaining an internal flow of information and establishing routes where the gradient can flow for a long period of time.Specifically， we used the Two-State GRU (TS-GRU) to train our prediction model for air pollution concentrations.In particularly，the two-state principle divides the neurons of a developed TS-GRU into two directions，allowing for simultaneous consideration of both past and future information.We assessed the model performance of our proposed model using ground PM2.5measurements from the US Environmental Protection Agency(EPA)’s Air Quality System(AQS).In order to examine the impact of concentration influence on the temporal dimension， we also compared our developed approaches to the existing GRU RNN model.

2 Related Works

2.1 Spatial Temporal Interpolation

Despite the fact that PM2.5concentrations are usually observed in common countries including USA， the number of sensors and their geographic range continue restricted.Mostly In any circumstance， none of these studies provide a strategy for predicting pollution over the next several months or identifying associated factors.With ever-increasing levels of air pollution， it’s critical to develop efficient air quality monitoring simulations based on data provided by pollution sensors.These algorithms may help predict the concentration of particles and provide an assessment of air pollution in each location.As a result，air quality assessment and forecasting has become a significant study area.In conjunction to pieces within the ensemble that address the hypothesis of air pollution.Advanced spatiotemporal interpolation technique is critical for gaining a good understanding of the observed air pollutants because it can have a significant influence on the precise assessment of humanoid revelation to PM2.5and obtain more consistent analysis of the correlation among PM2.5and disease consequences through time [26].Assume that in an areaA， there arenvarious monitoring stations{S1，...，Sn}.The analysis for particular situationSiat a certain time stamptcan be defined as a tuplexi，t=(loni，lati，t，vi) whereviis the reported air pollutant concentration is measured，loni and latidefining the longitude and latitude of the stationSi，accordingly.As a result，the input dataset can be referred to as n time series，{ts1，...，tsn}.The sequential time seriests1=xi，1，...，xi，Tthat observed by data at a single stationSi.Based on the time series the basic purpose of this research is target to estimateAat any time for the position ofv.The local air quality is frequently affected by nearby places in the spatial dimension as air pollutants can disseminate or spread across the atmosphere with the wind[27].

Historical air pollution levels can influence present and future levels in the temporal dimension.For example，the pollution levels of the previous hour will have an impact on the next hours of pollution levels during the observation process.Furthermore，some various cases have included in recent years is that， atmosphere has tended to be similar during the same time of periods.In conclusion， to all influencing factors mentioned above， many other factors including weather， human activities and traffic flow can cause changes in air quality in both geographic and frequency domain，affecting air pollutant concentrations.It is difficult to construct a comprehensive mathematical model to estimate the levels of air quality due to the lack of a available dataset and only three affecting parameters，namely longitude，latitude，and time have been used in the recent studies.Although GRU is one of the most effective approaches，it has been applied for the prediction of various types of particulate matter(PM)levels.

2.2 Gated Recurrent Unit(GRU)

The GRU is a more advanced and simplified version of the recurrent neural network such as LSTM， which was first proposed on statistical machine translation by [28].GRU is based on the LSTM， which uses an update gateztand a reset gatertto handle information flow inside the unit without the use of separate memory.As a result，GRU can capture the mapping relationship between time-series data[29，30]，while also offering appealing benefits such as reduced complexity and a faster computational procedure.Fig.1 demonstrate the GRU computational structure， which shows the connection among the update and reset gates.Furthermore， GRU uses internal memory to retain the filter information and combines the input and forget gates into a single update gate with previous stateht-1and the candidate computation illustrated by ?ht.The update gate，reset gate，and candidate state are the three major components of GRU，and their equations summaries as follows:

Figure 1:GRU Architecture

whereVxz，Vxrandpresent to the weights vector between the input layer and update gate， reset gate and candidate vector while weight matrixUhz，Uhrandreferring the recurrent connection respectively.φis the nonlinear activation function of update and reset gates，*conducts multiplication operation between the component andBz，Brandare the associated biases.

3 The Proposed Model:Two-State GRU Mechanism

GRU is the latest kind of traditional RNN which particularly has to be used for sequential modeling.However，a recurrent layer required the input vectorht∈Rnat each timestept，and hidden statehtby implementing the recurrent procedure:

whereW∈Rm*n，b∈Rm*m，b∈Rmweights matrix， and element-wise nonlinearity is represented by f.Training the long-term dependencies with RNN is very complicated due to the problem of vanishing gradient and exploding[31].By applying the gating architecture，GRU can maintain memory substantially better than traditional RNN[32].However，based on the existing literature，we explored that when GRU analyze a word it only includes the forward semantic information，so it is impossible for GRU to learns the backward contexts.As the results， we also observed that in any language approach， which process of sentence is not affected only through forward information but also in the backward context.Therefore，in this study，we proposed Two-State GRU(TS-GRU)to solve the aforementioned issue.The proposed TS-GRU model consists of two processes，one for positive pass known as“forward pass”，and other for negative pass known as“backward pass”presented in Fig.2.The two-state GRU can efficiently learn the context through both directions.

Figure 2:The proposed Two-State GRU architecture for sentiment analysis

TS-GRU is inspired by the bidirectional recurrent neural networks(BRNNs)in[33].It consists of two separate recurrent nets in the terms of forward passes(left to right(for future information))and backward passes(right to left(for past information))in the training process and finally both of them are merged to produce output layer.The formulas for update gatezt，reset gatert，candidate state，and final output activation statehtof the forward and backward GRU are shown as a follows:

Forward pass:

Additionally，we implemented backward pass in the proposed approach to explore more valuable information.

Backward Pass:

The activation of a word at timet:= for an arbitrary sequence (x1，x2，...，xn)containingnwords， at timeteach word illustrated as a dimensional vector.The forward GRU computeswhich takes left-to-right contexts of the sentence whereas the reverse GRU consider rightto-left contextsfor attention.Then forward and backward context descriptions are then combined into a single context.In common，Backpropagation Through Time(BPTT)is a gradient constracted based methodology and a veriation of the conventional backpropagation method that can be used to train the DRNN(Chauvin and Rumelhart 1995)[34].BPTT starts with development of a unfolding RNN in time so that each timestep has one input timestep，one copy of the network，and one output.

The system flow diagram of the proposed TS-GRU is presented in Fig.3.During training to avoid being excessively fractional to a particular dimension，the original dataset is first normalized，that is，the data points of all dimensions are constrained to a range of 0 to 1.Furthermore，the regularized data is divided into two sections:training data and testing data.Only the training data is used throughout the training to maintain the impartiality of performance evaluation.When training data is fed into the TS-GRU，a loss value is created，and the enhancement adjusts the parameters of TS-GRU using the backpropagation method.The forecasting performance of TS-GRU will become more precise with the increase of training iterations.The testing data is entered into the TS-GRU when the learning is finished， and evaluate the performance of the TS-GRU the testing results and real results were compared.Overfitting can happen when there is not enough training data or when there is too much training.

Figure 3:The system flow diagram of the proposed TS-GRU

However， overfitting can be avoided using several methods including， regularization [35]， data augmentation[36]，dropout[37]，and dropconnect[38].Regularization can be divided into two types:L1 regularization and L2 regularization，both of which are commonly employed in deep learning.To avoid overfitting， both of these strategies minimize the weight value of the neural network as much as possible.The goal of data augmentation is to enhance the dimension of the dataset as much as conceivable，for example，by adding random bias or noise，in order to diversity the training data and improve training results.Dropout and dropconnect are similar in that the former pauses the neuro’s operation at random，while the latter eliminates the connection at discrete points.The early stopping technique is implemented in this paper[39].

4 Experimental Design

In this section， we briefly explained the experimental settings， measure of performance and empirical results of the developed two-state GRU approach.

4.1 Data Set Description

We investigated the daily PM2.5data set in Florida in 2009 to illustrate the performance and efficiency of our developed approach.This data was accessed by the United States Environmental Protection Agency’s Air Quality System (AQS) controlling process and can be accessible via EPA’s website.In this dataset，a tuple entry(t，lon，lat，v)，is determined by each dataset wherelonandlatare referring to the length and parallel coordinates of the controlling station，t=(year，month，day)representing the date when a PM2.5dimension is reserved，and v is the calculated PM2.5value.Tab.1 shows the separate entity from one controlling station.The extracted features from dataset defined the collection of n time series{ts1，...，tsn}fromncontrolling positions.Each time seriestsi=xi，1，...，xi，Tis an sequential observation of data at a one stationSi， andxi，t=(t，lon，lat，v) represents one assessment from each stationSiat a certain time stept.We can notice from the sample data that the range of raw information fluctuates greatly.Suppose，the[1，12]is the range features of the month，whereas the limit of PM2.5values is(0，210].As a result，we measure the informative features so that all values fall between 0 and 1.Moreover， Ioffe et al.[40] also shown that when features are scaled，gradient descent converges substantially faster.

Table 1:One monitoring site on sample dataset

The original dataset consists incorrect entries， indicating that no measurements were taken at a distinct location and on a specific day.There were 6，698 everyday proportions at 30 controlling locations on all 365 days of 2009 after eliminating all the incorrect entries.

4.2 Implementation Detail and Parameter Settings

In the temporal interpolation，we assume that reginal pollution levels are influenced not just in nearby fields，but similarly associated by factual and prospective information from surrounding places[41].Our proposed framework uses the TS-GRU(illustrated in Fig.2)to collect the both geographical and temporal relationships.In the proposed framework two directions GRU layers and conventional dense layers are stacked in the network.Furthermore，the random uniform approach is used to set the parameters of each layer randomly and equally，and the sigmoid nonlinear process is utilized to imitate non-linearity in each layer.We used MAPE as our loss function because of its scale independence and interpretability.Finally，we used Adam algorithm[42]to train and optimized the entire neural network，which is a numerically effective technique for rapid stochastic optimization.Kingma and Ba showed that， Adam algorithm is suitable for issues with enormous amounts of data and is also suitable for non-stationary goals[42].All the simulations of this research were implemented on Intel core-i7-3770 CPU@3.40 GHz，DDR3 and 8 GB of RAM with Window 10 operating system.We used Python 3.7 compiler and a high-level NNs API-Keras as the development environment， with required libraries TensorFlow 1.14 and Keras 2.3.

It is usual to run into the overfitting issue，when training neural network algorithm(see Tab.2.for the details)，which indicates the performance of both training and testing set.However，the training set is substantially superior than testing set.To solve the overfitting issue and enhance the robustness of our approach，we used the k-fold cross validation[43]and dropout technique[37].We divide the dataset into k equivalent-size subgroups for k-fold cross validation，then choose one subset as the testing set and train on the subsisting k–1 subset iteratively.In this study，we used the generally utilized 10-fold cross validation method.As a result， we randomly partition our dataset into 78% training set， 10%validation set and 12%testing test，and then train our network on the training set using the 10-fold cross validation technique.

Table 2:Parameters description of the deep learning models

When training a neural network，the dropout technique works by sampling a“thinned”model.To optimize the model，we arbitrarily selected a portion of nodes in hidden layer and temporarily deleted them from the network，as well as all input and output connectivity at each iteration.As a side effect，the dropout technique also improves the training efficiency by requiring fewer computations.We also explored that the actual air quality is strongly linked to air quality levels in the past and future days.

4.3 Evaluation Methods

In this paper，we employed three assessment measures to access the performance of the developed model.When comparing predictions to actual values， these metrics were calculated:mean absolute error(MAE)，root-mean-square error(RMSE)，and mean absolute percentage error(MAPE).Smaller values indicate better performances.The Large error are given relatively high weights by the RMSE.These equations are follows:

whereOirepresents the observed air quality，while predicted air quality denoted byPi，and the number of assessment samples showed byN.The absolute error is calculated using the previous two indices，whereas the relative error is calculated using the third.In other words，the extreme consequence and error scope of the projected values are expressed by RMSE and MAE， while the specificity of the average projected value is represented by MAPE[44].

5 Results and Discussion

In this section，three experiments were conducted to investigate the spatiotemporal relationships and to illustrate the efficacy of our proposed methodology.

Experiment 1:network architectureto insert our spatiotemporal dataset，we initially investigated appropriate deep learning architecture.The purpose of our first experiment is determined to stability the efficacy of our spatial and temporal interpolation technique by selecting the dropout rate，epoch numbers，and batch size.We consider that both the variables of closest neighbors and the quantity of the influencing days are 1，i.e.，k= 1，t= 1.In this experiment，the training set is separated through a number of constant dimension batches during the neural network training， in which each batch being transformed in order to during one learning session.As a result， we notice that the gradient and frequency of weights updates by batch size.Smaller batch sizes are usually encountered in less training epochs，whereas higher batch sizes provide additional similarity and thus superior calculation competence，as the separate learning instances within a single batch might be procedure in similar[45].In this study，we experimented with numerous batch sizes because our training data set is rather tiny，with only about 7，000 entrances.we experimented with several batch sizes{4，8，16，32，64，128，256}.Tab.3 illustrates the results.Finally， we selected 32 as our batch size to attain a proportion among the computational efficacy and competence.An epoch is a single pass over the complete training set batch by batch.The drawbacks of neural networks include the possibility of overfitting and a high computational cost.

Table 3:For 60 epochs，various batch sizes result in varied measurements and running times

We trained our model over 60 epochs when the batch size was 32，and the temporal training and validation losses were reported in Fig.4.During the training process， we noticed that both kinds of losses generally remain constant when the epoch number is greater than 45.Therefore， for our subsequent experiments，we set the epoch number up to 45.As we discussed in the previous section，the dropout technique is employed to enhance the performance of our developed approach by neglecting a smaller faction of interconnections at randomly.We have attempted eight various dropout rates to determine the dropout rate:{0.00，0.05，0.10，0.15，0.20，0.25，0.30，0.35}.Tab.4 contains the statistical data，and Fig.5.Depicts a performance of MAPE in the term of visualizations representation.In this case，we noticed that the values of MAPE increases as the dropout rate increases，as shown in Fig.5.Which indicates a weak model for a higher dropout rate.

Figure 4:The training and validation losses

Table 4:Measurements with/without 10-fold cross validation (CV) for various dropout rates.The k-cross validation technique increases the performance except for the emphasized cases

Figure 5:MAPE for various dropout rate

For improving the performance of our developed approach， we adopted another approach， 10-fold cross-validation，during the training procedure.The previous experiment was replicated without the 10-fold cross validation approach， as well as the findings are summarized in Tab.4.The 10-fold cross validation certainly enhance the robustness of our developed approach in the vast majority of scenarios.

Experiment 2:number of influencing neighbors and daysWe examined variouskandtat the interested point to investigate how environmental and sequential neighbours affect air quality.We setk∈{1， 2， 3， 4， 5， 6} andt∈{1， 2， 3， 4， 5， 6} in a more specific way.Tabs.5 and 6 reported the statistical measurements were collected by experiment.In this experiment，we noticed that during the training process the network takes into the account additional geographical neighbours of the interested site and the MAPE tends to reduces.On the other hand，when the network considers further previous and future days，these reducing features probably applies.

Table 5:Assessments for our method based on the amount of days influencing the outcome

Table 5:Continued

Table 6:Assessments for our method based on various number of neighbors

Table 6:Continued

Experiment 3:comparison with GRU-base RNNIn our final experiment， we compared the developed TS-GRU model with the existing deep GRU discover if the present condition of the air quality is associated with the future outcomes.In this experimental procedure，we build a GRU-based deep RNN， that is comparable to the network in Fig.2 besides that the Two-State GRU layers are adjusted as the standard GRU architecture.In the GRU， we suppose that the existing level of air pollution is unaffected by descriptive statistics.In other words，the existing GRU is a spatiotemporal prediction network.As a experimental results，the left subfigure of Fig.6 depicts a three-dimensional mesh representation of the MAPE values.On the right side，a three-dimensional mesh representation for the TS-GRU is illustrated for comparison.When we compared to the present GRU， the MAPE values reduces askortincreases，which is a comparable observation of GRU.However，the intensity is much smaller for the GRU.Another interesting observation has been made.The GRU attains superior results than the TS-GRU whentis small (t ≤3) no matter whatkis.In contract， iftis substantial adequate，i.e.，k ＞3，the TS-GRU got remarkable performance than traditional GRU for allkvalues.More particularly，historical levels of air pollution have a greater impact on future levels of air pollution.

Figure 6:MAPE for traditional GRU and the proposed TS-GRU models

Despite the fact that the TS-GRU model analyses based on informative contents from the future，the near future data brings extra unpredictability or uncertainty into the system， causing the TSGRU to perform poorly whentis small.The existing GRU approach picks up noise from the past information，whereas the TS-GRU model can calibrate these noises through future information.As a result，the TS-GRU illustrates excellent performance as compared to existing GRU whentis large enough.

Fig.7 presents the comparison analysis of four experimental approaches.The real data is shown by the solid blue line.Usually， the LSTM and GRU models showed the poor match to the actual data，whereas another hybrid model was consistent.The hybrid approach mostly performed superior than the single approaches.In order to forecasting PM2.5levels，both the GRU and LSTM approaches were ineffective in forecasting the future higher and lower levels.The hybrid approach predicts the extreme events and commonly outperforms the single approaches.The proposed TS-GRU approach remarkable predicted PM2.5concentration levels， as compared to hybrid CNN–GRU model over 3 days in the term of future hours.The proposed TS-GRU model outperformed as compared to existing approaches and might be used to predict high PM concentrations in the future.

Figure 7:Predicted 3-day PM2.5 concentration;all approaches

6 Conclusion

In this study，we proposed a novel spatiotemporal technique for interpolating PM2.5concentrations based on Two-State gated recurrent unit.This technique is based on recently proposed deep learning techniques and considers both spatial and temporal aspects simultaneously.In order to remember facts from the past as well as the future，we used the Two-State GRU to split the neurons of an existing GRU into two directions.The particulate matter(PM2.5)predictions are done using deep learning approaches based on the statistical computations of parameters including;MAE，RMSE and MAPE.The results illustrate that our proposed model is perform superior than the existing approaches and also present the actual values and predicted values are very near to each other.To the best of our observation，it is the first time that the Two-State GRU has been used in the spatiotemporal interpolation of air pollutants concentrations.Our future research will focus on this technique for further investigation on ground PM2.5measurements as well as auxiliary data such as satellite-derived aerosol optical depth(AOD)， land use， roads， elevation， and weather circumstances.We will also further investigate the robustness of this strategy for prediction of other pollutant concentrations including ozone(O3)and nitrogen dioxide(NO2)and increase our research field to cover a larger geographical domain.In the future research， we will also explore how to speed up the developed model through using cluster computing frameworks.

Acknowledgement:The authors thank to King Khalid University of Saudi Arabia for supporting this research under the grant number R.G.P.1/365/42.

Funding Statement:This research work supported by Khalid University of Saudi Arabia under the grant number R.G.P.1/365/42.

Conflicts of Interest:The authors declare that they have no conflicts of interest to report regarding the present study.