• <tr id="yyy80"></tr>
  • <sup id="yyy80"></sup>
  • <tfoot id="yyy80"><noscript id="yyy80"></noscript></tfoot>
  • 99热精品在线国产_美女午夜性视频免费_国产精品国产高清国产av_av欧美777_自拍偷自拍亚洲精品老妇_亚洲熟女精品中文字幕_www日本黄色视频网_国产精品野战在线观看 ?

    A Deep Two-State Gated Recurrent Unit for Particulate Matter(PM2.5)Concentration Forecasting

    2022-08-24 03:28:44MuhammadZulqarnainRozaidaGhazaliHabibShahLokmanHakimIsmailAbdullahAlsheddyandMaqsoodMahmud
    Computers Materials&Continua 2022年5期

    Muhammad Zulqarnain,Rozaida Ghazali,*,Habib Shah,Lokman Hakim Ismail,Abdullah Alsheddy and Maqsood Mahmud

    1Faculty of Computer Science and Information Technology,Universiti Tun Hussein Onn Malaysia,Batu Pahat,Johor,Malaysia

    2College of Computer Science,King Khalid University,Abha,Saudi Arabia

    3College of Computer and Information Sciences,Imam Mohammad Ibn Saud Islamic University,Riyadh,Saudi Arabia

    4Department of Management Information Systems,College of Business Administration,Imam Abdulrahman Bin Faisal University,31441,Dammam,Saudi Arabia

    Abstract: Air pollution is a significant problem in modern societies since it has a serious impact on human health and the environment.Particulate Matter (PM2.5) is a type of air pollution that contains of interrupted elements with a diameter less than or equal to 2.5 m.For risk assessment and epidemiological investigations,a better knowledge of the spatiotemporal variation of PM2.5 concentration in a constant space-time area is essential.Conventional spatiotemporal interpolation approaches commonly relying on robust presumption by limiting interpolation algorithms to those with explicit and basic mathematical expression,ignoring a plethora of hidden but crucial manipulating aspects.Many advanced deep learning approaches have been proposed to forecast Particulate Matter (PM2.5).Recurrent neural network(RNN) is one of the popular deep learning architectures which is widely employed in PM2.5 concentration forecasting.In this research, we proposed a Two-State Gated Recurrent Unit(TS-GRU)for monitoring and estimating the PM2.5 concentration forecasting system.The proposed algorithm is capable of considering both spatial and temporal hidden affecting elements spontaneously.We tested our model using data from daily PM2.5 dimensions taken in the contactual southeast area of the United States in 2009.In the studies,three evaluation matrices were utilized to compare the overall performance of each algorithm:Mean Absolute Error (MAE), Root Mean Square Error(RMSE), and Mean Absolute Percentage Error (MAPE).The experimental results revealed that our proposed TS-GRU model outperformed compared to the other deep learning approaches in terms of forecasting performance.

    Keywords: Deep learning;PM2.5 forecasting;air pollution;two-state GRU

    1 Introduction

    Particulate matter (PM) levels have recently become a global issue.Atmospheric aerosols are groupings of solid or liquid particles suspended in the air that arise from a variety of sources and come in different shapes and sizes.Furthermore,the majority of particulate matter is formed in the lowest layer of the atmosphere.Fine particles having aerodynamic dimensions less than 10 and 2.5 m are referred to as PM10and PM2.5respectively.Many epidemiological studies have demonstrated that PM is extremely harmful to people,especially at high concentrations[1].PM2.5is still a major public health concern[2],and it has been related to a number of health consequences,such as cancer,respiratory,mortality,and cardiovascular illnesses[3].Environmental exposure analysis has increased significantly due to advances in geospatial technologies,particularly Geographic Information Systems(GIS).An adequate knowledge of PM2.5in a continuous space-time domain is necessary for a useful evaluation of the quantifiable link between adverse health effects and PM2.5concentrations.Because air pollution data is frequently obtained at discrete or restricted sample areas,it is frequently essential to estimation air quality intensity at current information locations inside the region of a finite set of existing data points,which referred to interpolated in quantitative simulation.Based on the assumption,the spatial interpolation approaches have been already widely examined over the years that are higher associated with ordinary spatial interpolation approaches,including Inverse Distance Weighting(IDW)[4],trend surface[5]and splines[6].

    Most well-known interpolation approaches, such as IDW and Kriging, constrain interpolation methods which are commonly described with clear and simple mathematical expression.In contrast to conventional spatial interpolation,spatiotemporal interpolation requires consideration of an additional time dimension.There are some effective and efficient interpolation techniques for complicated spatiotemporal datasets.Some spatiotemporal approaches [7] integrate time and space individually and decrease the temporal interpolated issue to a series of multivariate statistical snapshots.Few other spatiotemporal approaches [8,9] consider time as a separate dimension in space and integrate both temporal and spatial aspects at the same time.Unfortunately,none of the thesis researches provided adequate methodologies for including time aspects, ensuring that the sequential measurement is handled “equitably”in comparison to the spatial dimension.Samal et al.[10] were referred to this issue as the “time scale issue”and later, over the past decades Fioravanti et al.[11] were revised the scaling ratio is known as“spatiotemporal anisotropy parameter”.To estimate this parameter,just a few basic approaches were proposed.The fundamental reason,there is a dearth of strong theoretical assistance for determining the relationship between time and space dimensions.A black box strategy,including the artificial intelligent algorithm,is a reasonable concept and an auspicious way to predict the spatiotemporal assessment parameter in such scenarios.Furthermore,Badli et al.[12]presented an effective parallel machine learning model to address this challenge in order to regulate the appropriate spatiotemporal anisotropy parameters.

    Through a hierarchical learning process, deep neural network approaches have extracted highlevel, features from data for learning processing [13].Artificial intelligence inspired the hierarchical learning mechanism,which resembles the deep layered learning mechanism of the core sensory fields of the human brain’s neocortex, which pulls functionalities and abstractions from the core input[14,15].Since its inception,deep learning has been effectively used in time series prediction[16],object detection [17] natural language processing [18], medical images analysis [19] multi-class skin cancer classification[20],and sentiment analysis[21].Deep recurrent neural network(DRNN)[22]is one of the most suitable deep learning models for time series prediction and sequence modelling because it often perceives the current input but also a trace of formerly obtained data through use of repeatable process,that permits a directly dispensation of sequential relationship and other hidden probability.

    Lately,in 2017,F(xiàn)an et al.[23]introduced a DRNN-based comprehensive forecast architecture for air pollution level.It’s a helpful forecasting approach that can’t be employed for common interpolation goals.Recently in 2018, Qi et al.[24] proposed broad and efficient technique to address the finegrained air quality interpolation,forecasting,and feature analysis in one model.The RNN was used as the major ingredient in their method as well.Previous RNN-based deep learning approaches relied solely on historical data.Furthermore,they considered that the present air pollution intensity is solely driven to the concerned point’s by previous information and the present air quality strengths of its environmental situations.This argument is flawed because it ignores the time relation between spatial neighbors.

    This research intends to create a unique spatiotemporal interpolation technique for predicting PM2.5based on Two-State Gated Recurrent Unit,which considers both past and future spatiotemporal relationships between geographical neighbours.Our methodology enables the creation of more precise air pollution estimates on a vast geographic area due to long period of time.Generally, RNN’s memory of previously acquired patterns fades with time,resulting in a calculation difficulty known as vanishing gradient[25].We explored the advanced variant of recurrent neural networks such as Gated Recurrent Unit(GRU)[26]GRU handles this problem by retaining an internal flow of information and establishing routes where the gradient can flow for a long period of time.Specifically, we used the Two-State GRU (TS-GRU) to train our prediction model for air pollution concentrations.In particularly,the two-state principle divides the neurons of a developed TS-GRU into two directions,allowing for simultaneous consideration of both past and future information.We assessed the model performance of our proposed model using ground PM2.5measurements from the US Environmental Protection Agency(EPA)’s Air Quality System(AQS).In order to examine the impact of concentration influence on the temporal dimension, we also compared our developed approaches to the existing GRU RNN model.

    2 Related Works

    2.1 Spatial Temporal Interpolation

    Despite the fact that PM2.5concentrations are usually observed in common countries including USA, the number of sensors and their geographic range continue restricted.Mostly In any circumstance, none of these studies provide a strategy for predicting pollution over the next several months or identifying associated factors.With ever-increasing levels of air pollution, it’s critical to develop efficient air quality monitoring simulations based on data provided by pollution sensors.These algorithms may help predict the concentration of particles and provide an assessment of air pollution in each location.As a result,air quality assessment and forecasting has become a significant study area.In conjunction to pieces within the ensemble that address the hypothesis of air pollution.Advanced spatiotemporal interpolation technique is critical for gaining a good understanding of the observed air pollutants because it can have a significant influence on the precise assessment of humanoid revelation to PM2.5and obtain more consistent analysis of the correlation among PM2.5and disease consequences through time [26].Assume that in an areaA, there arenvarious monitoring stations{S1,...,Sn}.The analysis for particular situationSiat a certain time stamptcan be defined as a tuplexi,t=(loni,lati,t,vi) whereviis the reported air pollutant concentration is measured,loni and latidefining the longitude and latitude of the stationSi,accordingly.As a result,the input dataset can be referred to as n time series,{ts1,...,tsn}.The sequential time seriests1=xi,1,...,xi,Tthat observed by data at a single stationSi.Based on the time series the basic purpose of this research is target to estimateAat any time for the position ofv.The local air quality is frequently affected by nearby places in the spatial dimension as air pollutants can disseminate or spread across the atmosphere with the wind[27].

    Historical air pollution levels can influence present and future levels in the temporal dimension.For example,the pollution levels of the previous hour will have an impact on the next hours of pollution levels during the observation process.Furthermore,some various cases have included in recent years is that, atmosphere has tended to be similar during the same time of periods.In conclusion, to all influencing factors mentioned above, many other factors including weather, human activities and traffic flow can cause changes in air quality in both geographic and frequency domain,affecting air pollutant concentrations.It is difficult to construct a comprehensive mathematical model to estimate the levels of air quality due to the lack of a available dataset and only three affecting parameters,namely longitude,latitude,and time have been used in the recent studies.Although GRU is one of the most effective approaches,it has been applied for the prediction of various types of particulate matter(PM)levels.

    2.2 Gated Recurrent Unit(GRU)

    The GRU is a more advanced and simplified version of the recurrent neural network such as LSTM, which was first proposed on statistical machine translation by [28].GRU is based on the LSTM, which uses an update gateztand a reset gatertto handle information flow inside the unit without the use of separate memory.As a result,GRU can capture the mapping relationship between time-series data[29,30],while also offering appealing benefits such as reduced complexity and a faster computational procedure.Fig.1 demonstrate the GRU computational structure, which shows the connection among the update and reset gates.Furthermore, GRU uses internal memory to retain the filter information and combines the input and forget gates into a single update gate with previous stateht-1and the candidate computation illustrated by ?ht.The update gate,reset gate,and candidate state are the three major components of GRU,and their equations summaries as follows:

    Figure 1:GRU Architecture

    whereVxz,Vxrandpresent to the weights vector between the input layer and update gate, reset gate and candidate vector while weight matrixUhz,Uhrandreferring the recurrent connection respectively.φis the nonlinear activation function of update and reset gates,*conducts multiplication operation between the component andBz,Brandare the associated biases.

    3 The Proposed Model:Two-State GRU Mechanism

    GRU is the latest kind of traditional RNN which particularly has to be used for sequential modeling.However,a recurrent layer required the input vectorht∈Rnat each timestept,and hidden statehtby implementing the recurrent procedure:

    whereW∈Rm*n,b∈Rm*m,b∈Rmweights matrix, and element-wise nonlinearity is represented by f.Training the long-term dependencies with RNN is very complicated due to the problem of vanishing gradient and exploding[31].By applying the gating architecture,GRU can maintain memory substantially better than traditional RNN[32].However,based on the existing literature,we explored that when GRU analyze a word it only includes the forward semantic information,so it is impossible for GRU to learns the backward contexts.As the results, we also observed that in any language approach, which process of sentence is not affected only through forward information but also in the backward context.Therefore,in this study,we proposed Two-State GRU(TS-GRU)to solve the aforementioned issue.The proposed TS-GRU model consists of two processes,one for positive pass known as“forward pass”,and other for negative pass known as“backward pass”presented in Fig.2.The two-state GRU can efficiently learn the context through both directions.

    Figure 2:The proposed Two-State GRU architecture for sentiment analysis

    TS-GRU is inspired by the bidirectional recurrent neural networks(BRNNs)in[33].It consists of two separate recurrent nets in the terms of forward passes(left to right(for future information))and backward passes(right to left(for past information))in the training process and finally both of them are merged to produce output layer.The formulas for update gatezt,reset gatert,candidate state,and final output activation statehtof the forward and backward GRU are shown as a follows:

    Forward pass:

    Additionally,we implemented backward pass in the proposed approach to explore more valuable information.

    Backward Pass:

    The activation of a word at timet:= for an arbitrary sequence (x1,x2,...,xn)containingnwords, at timeteach word illustrated as a dimensional vector.The forward GRU computeswhich takes left-to-right contexts of the sentence whereas the reverse GRU consider rightto-left contextsfor attention.Then forward and backward context descriptions are then combined into a single context.In common,Backpropagation Through Time(BPTT)is a gradient constracted based methodology and a veriation of the conventional backpropagation method that can be used to train the DRNN(Chauvin and Rumelhart 1995)[34].BPTT starts with development of a unfolding RNN in time so that each timestep has one input timestep,one copy of the network,and one output.

    The system flow diagram of the proposed TS-GRU is presented in Fig.3.During training to avoid being excessively fractional to a particular dimension,the original dataset is first normalized,that is,the data points of all dimensions are constrained to a range of 0 to 1.Furthermore,the regularized data is divided into two sections:training data and testing data.Only the training data is used throughout the training to maintain the impartiality of performance evaluation.When training data is fed into the TS-GRU,a loss value is created,and the enhancement adjusts the parameters of TS-GRU using the backpropagation method.The forecasting performance of TS-GRU will become more precise with the increase of training iterations.The testing data is entered into the TS-GRU when the learning is finished, and evaluate the performance of the TS-GRU the testing results and real results were compared.Overfitting can happen when there is not enough training data or when there is too much training.

    Figure 3:The system flow diagram of the proposed TS-GRU

    However, overfitting can be avoided using several methods including, regularization [35], data augmentation[36],dropout[37],and dropconnect[38].Regularization can be divided into two types:L1 regularization and L2 regularization,both of which are commonly employed in deep learning.To avoid overfitting, both of these strategies minimize the weight value of the neural network as much as possible.The goal of data augmentation is to enhance the dimension of the dataset as much as conceivable,for example,by adding random bias or noise,in order to diversity the training data and improve training results.Dropout and dropconnect are similar in that the former pauses the neuro’s operation at random,while the latter eliminates the connection at discrete points.The early stopping technique is implemented in this paper[39].

    4 Experimental Design

    In this section, we briefly explained the experimental settings, measure of performance and empirical results of the developed two-state GRU approach.

    4.1 Data Set Description

    We investigated the daily PM2.5data set in Florida in 2009 to illustrate the performance and efficiency of our developed approach.This data was accessed by the United States Environmental Protection Agency’s Air Quality System (AQS) controlling process and can be accessible via EPA’s website.In this dataset,a tuple entry(t,lon,lat,v),is determined by each dataset wherelonandlatare referring to the length and parallel coordinates of the controlling station,t=(year,month,day)representing the date when a PM2.5dimension is reserved,and v is the calculated PM2.5value.Tab.1 shows the separate entity from one controlling station.The extracted features from dataset defined the collection of n time series{ts1,...,tsn}fromncontrolling positions.Each time seriestsi=xi,1,...,xi,Tis an sequential observation of data at a one stationSi, andxi,t=(t,lon,lat,v) represents one assessment from each stationSiat a certain time stept.We can notice from the sample data that the range of raw information fluctuates greatly.Suppose,the[1,12]is the range features of the month,whereas the limit of PM2.5values is(0,210].As a result,we measure the informative features so that all values fall between 0 and 1.Moreover, Ioffe et al.[40] also shown that when features are scaled,gradient descent converges substantially faster.

    Table 1:One monitoring site on sample dataset

    The original dataset consists incorrect entries, indicating that no measurements were taken at a distinct location and on a specific day.There were 6,698 everyday proportions at 30 controlling locations on all 365 days of 2009 after eliminating all the incorrect entries.

    4.2 Implementation Detail and Parameter Settings

    In the temporal interpolation,we assume that reginal pollution levels are influenced not just in nearby fields,but similarly associated by factual and prospective information from surrounding places[41].Our proposed framework uses the TS-GRU(illustrated in Fig.2)to collect the both geographical and temporal relationships.In the proposed framework two directions GRU layers and conventional dense layers are stacked in the network.Furthermore,the random uniform approach is used to set the parameters of each layer randomly and equally,and the sigmoid nonlinear process is utilized to imitate non-linearity in each layer.We used MAPE as our loss function because of its scale independence and interpretability.Finally,we used Adam algorithm[42]to train and optimized the entire neural network,which is a numerically effective technique for rapid stochastic optimization.Kingma and Ba showed that, Adam algorithm is suitable for issues with enormous amounts of data and is also suitable for non-stationary goals[42].All the simulations of this research were implemented on Intel core-i7-3770 CPU@3.40 GHz,DDR3 and 8 GB of RAM with Window 10 operating system.We used Python 3.7 compiler and a high-level NNs API-Keras as the development environment, with required libraries TensorFlow 1.14 and Keras 2.3.

    It is usual to run into the overfitting issue,when training neural network algorithm(see Tab.2.for the details),which indicates the performance of both training and testing set.However,the training set is substantially superior than testing set.To solve the overfitting issue and enhance the robustness of our approach,we used the k-fold cross validation[43]and dropout technique[37].We divide the dataset into k equivalent-size subgroups for k-fold cross validation,then choose one subset as the testing set and train on the subsisting k–1 subset iteratively.In this study,we used the generally utilized 10-fold cross validation method.As a result, we randomly partition our dataset into 78% training set, 10%validation set and 12%testing test,and then train our network on the training set using the 10-fold cross validation technique.

    Table 2:Parameters description of the deep learning models

    When training a neural network,the dropout technique works by sampling a“thinned”model.To optimize the model,we arbitrarily selected a portion of nodes in hidden layer and temporarily deleted them from the network,as well as all input and output connectivity at each iteration.As a side effect,the dropout technique also improves the training efficiency by requiring fewer computations.We also explored that the actual air quality is strongly linked to air quality levels in the past and future days.

    4.3 Evaluation Methods

    In this paper,we employed three assessment measures to access the performance of the developed model.When comparing predictions to actual values, these metrics were calculated:mean absolute error(MAE),root-mean-square error(RMSE),and mean absolute percentage error(MAPE).Smaller values indicate better performances.The Large error are given relatively high weights by the RMSE.These equations are follows:

    whereOirepresents the observed air quality,while predicted air quality denoted byPi,and the number of assessment samples showed byN.The absolute error is calculated using the previous two indices,whereas the relative error is calculated using the third.In other words,the extreme consequence and error scope of the projected values are expressed by RMSE and MAE, while the specificity of the average projected value is represented by MAPE[44].

    5 Results and Discussion

    In this section,three experiments were conducted to investigate the spatiotemporal relationships and to illustrate the efficacy of our proposed methodology.

    Experiment 1:network architectureto insert our spatiotemporal dataset,we initially investigated appropriate deep learning architecture.The purpose of our first experiment is determined to stability the efficacy of our spatial and temporal interpolation technique by selecting the dropout rate,epoch numbers,and batch size.We consider that both the variables of closest neighbors and the quantity of the influencing days are 1,i.e.,k= 1,t= 1.In this experiment,the training set is separated through a number of constant dimension batches during the neural network training, in which each batch being transformed in order to during one learning session.As a result, we notice that the gradient and frequency of weights updates by batch size.Smaller batch sizes are usually encountered in less training epochs,whereas higher batch sizes provide additional similarity and thus superior calculation competence,as the separate learning instances within a single batch might be procedure in similar[45].In this study,we experimented with numerous batch sizes because our training data set is rather tiny,with only about 7,000 entrances.we experimented with several batch sizes{4,8,16,32,64,128,256}.Tab.3 illustrates the results.Finally, we selected 32 as our batch size to attain a proportion among the computational efficacy and competence.An epoch is a single pass over the complete training set batch by batch.The drawbacks of neural networks include the possibility of overfitting and a high computational cost.

    Table 3:For 60 epochs,various batch sizes result in varied measurements and running times

    We trained our model over 60 epochs when the batch size was 32,and the temporal training and validation losses were reported in Fig.4.During the training process, we noticed that both kinds of losses generally remain constant when the epoch number is greater than 45.Therefore, for our subsequent experiments,we set the epoch number up to 45.As we discussed in the previous section,the dropout technique is employed to enhance the performance of our developed approach by neglecting a smaller faction of interconnections at randomly.We have attempted eight various dropout rates to determine the dropout rate:{0.00,0.05,0.10,0.15,0.20,0.25,0.30,0.35}.Tab.4 contains the statistical data,and Fig.5.Depicts a performance of MAPE in the term of visualizations representation.In this case,we noticed that the values of MAPE increases as the dropout rate increases,as shown in Fig.5.Which indicates a weak model for a higher dropout rate.

    Figure 4:The training and validation losses

    Table 4:Measurements with/without 10-fold cross validation (CV) for various dropout rates.The k-cross validation technique increases the performance except for the emphasized cases

    Figure 5:MAPE for various dropout rate

    For improving the performance of our developed approach, we adopted another approach, 10-fold cross-validation,during the training procedure.The previous experiment was replicated without the 10-fold cross validation approach, as well as the findings are summarized in Tab.4.The 10-fold cross validation certainly enhance the robustness of our developed approach in the vast majority of scenarios.

    Experiment 2:number of influencing neighbors and daysWe examined variouskandtat the interested point to investigate how environmental and sequential neighbours affect air quality.We setk∈{1, 2, 3, 4, 5, 6} andt∈{1, 2, 3, 4, 5, 6} in a more specific way.Tabs.5 and 6 reported the statistical measurements were collected by experiment.In this experiment,we noticed that during the training process the network takes into the account additional geographical neighbours of the interested site and the MAPE tends to reduces.On the other hand,when the network considers further previous and future days,these reducing features probably applies.

    Table 5:Assessments for our method based on the amount of days influencing the outcome

    Table 5:Continued

    Table 6:Assessments for our method based on various number of neighbors

    Table 6:Continued

    Experiment 3:comparison with GRU-base RNNIn our final experiment, we compared the developed TS-GRU model with the existing deep GRU discover if the present condition of the air quality is associated with the future outcomes.In this experimental procedure,we build a GRU-based deep RNN, that is comparable to the network in Fig.2 besides that the Two-State GRU layers are adjusted as the standard GRU architecture.In the GRU, we suppose that the existing level of air pollution is unaffected by descriptive statistics.In other words,the existing GRU is a spatiotemporal prediction network.As a experimental results,the left subfigure of Fig.6 depicts a three-dimensional mesh representation of the MAPE values.On the right side,a three-dimensional mesh representation for the TS-GRU is illustrated for comparison.When we compared to the present GRU, the MAPE values reduces askortincreases,which is a comparable observation of GRU.However,the intensity is much smaller for the GRU.Another interesting observation has been made.The GRU attains superior results than the TS-GRU whentis small (t ≤3) no matter whatkis.In contract, iftis substantial adequate,i.e.,k >3,the TS-GRU got remarkable performance than traditional GRU for allkvalues.More particularly,historical levels of air pollution have a greater impact on future levels of air pollution.

    Figure 6:MAPE for traditional GRU and the proposed TS-GRU models

    Despite the fact that the TS-GRU model analyses based on informative contents from the future,the near future data brings extra unpredictability or uncertainty into the system, causing the TSGRU to perform poorly whentis small.The existing GRU approach picks up noise from the past information,whereas the TS-GRU model can calibrate these noises through future information.As a result,the TS-GRU illustrates excellent performance as compared to existing GRU whentis large enough.

    Fig.7 presents the comparison analysis of four experimental approaches.The real data is shown by the solid blue line.Usually, the LSTM and GRU models showed the poor match to the actual data,whereas another hybrid model was consistent.The hybrid approach mostly performed superior than the single approaches.In order to forecasting PM2.5levels,both the GRU and LSTM approaches were ineffective in forecasting the future higher and lower levels.The hybrid approach predicts the extreme events and commonly outperforms the single approaches.The proposed TS-GRU approach remarkable predicted PM2.5concentration levels, as compared to hybrid CNN–GRU model over 3 days in the term of future hours.The proposed TS-GRU model outperformed as compared to existing approaches and might be used to predict high PM concentrations in the future.

    Figure 7:Predicted 3-day PM2.5 concentration;all approaches

    6 Conclusion

    In this study,we proposed a novel spatiotemporal technique for interpolating PM2.5concentrations based on Two-State gated recurrent unit.This technique is based on recently proposed deep learning techniques and considers both spatial and temporal aspects simultaneously.In order to remember facts from the past as well as the future,we used the Two-State GRU to split the neurons of an existing GRU into two directions.The particulate matter(PM2.5)predictions are done using deep learning approaches based on the statistical computations of parameters including;MAE,RMSE and MAPE.The results illustrate that our proposed model is perform superior than the existing approaches and also present the actual values and predicted values are very near to each other.To the best of our observation,it is the first time that the Two-State GRU has been used in the spatiotemporal interpolation of air pollutants concentrations.Our future research will focus on this technique for further investigation on ground PM2.5measurements as well as auxiliary data such as satellite-derived aerosol optical depth(AOD), land use, roads, elevation, and weather circumstances.We will also further investigate the robustness of this strategy for prediction of other pollutant concentrations including ozone(O3)and nitrogen dioxide(NO2)and increase our research field to cover a larger geographical domain.In the future research, we will also explore how to speed up the developed model through using cluster computing frameworks.

    Acknowledgement:The authors thank to King Khalid University of Saudi Arabia for supporting this research under the grant number R.G.P.1/365/42.

    Funding Statement:This research work supported by Khalid University of Saudi Arabia under the grant number R.G.P.1/365/42.

    Conflicts of Interest:The authors declare that they have no conflicts of interest to report regarding the present study.

    韩国精品一区二区三区 | 精品卡一卡二卡四卡免费| 亚洲人与动物交配视频| 老熟女久久久| 不卡视频在线观看欧美| 伊人亚洲综合成人网| 国产精品国产三级国产av玫瑰| 黄色怎么调成土黄色| 人妻系列 视频| 亚洲国产毛片av蜜桃av| 美女脱内裤让男人舔精品视频| 哪个播放器可以免费观看大片| 91久久精品国产一区二区三区| av国产久精品久网站免费入址| 女的被弄到高潮叫床怎么办| 国产午夜精品一二区理论片| 免费高清在线观看视频在线观看| 亚洲av电影在线观看一区二区三区| 亚洲国产色片| av视频免费观看在线观看| 全区人妻精品视频| 日本vs欧美在线观看视频| 啦啦啦视频在线资源免费观看| 亚洲五月色婷婷综合| 男人添女人高潮全过程视频| 一级片免费观看大全| 国产男人的电影天堂91| 精品一区二区三区视频在线| 久久这里有精品视频免费| 男女免费视频国产| 又粗又硬又长又爽又黄的视频| 性色avwww在线观看| 亚洲图色成人| 久久精品人人爽人人爽视色| 国产成人91sexporn| av卡一久久| 三上悠亚av全集在线观看| 在线精品无人区一区二区三| 黄片无遮挡物在线观看| 久久97久久精品| 欧美3d第一页| 女人久久www免费人成看片| av在线观看视频网站免费| 97人妻天天添夜夜摸| 日本欧美视频一区| 午夜福利网站1000一区二区三区| 国产精品欧美亚洲77777| 久久久久精品性色| 国产伦理片在线播放av一区| 日产精品乱码卡一卡2卡三| 多毛熟女@视频| 久久久久精品性色| 日韩在线高清观看一区二区三区| 制服诱惑二区| 毛片一级片免费看久久久久| 久久久a久久爽久久v久久| 黑人巨大精品欧美一区二区蜜桃 | 国产精品 国内视频| 国产麻豆69| 视频中文字幕在线观看| 一本大道久久a久久精品| 免费看av在线观看网站| 免费人成在线观看视频色| 在线精品无人区一区二区三| 99视频精品全部免费 在线| 天天操日日干夜夜撸| 蜜臀久久99精品久久宅男| 日韩伦理黄色片| 一边亲一边摸免费视频| 卡戴珊不雅视频在线播放| 欧美 亚洲 国产 日韩一| 欧美成人午夜精品| 丝袜喷水一区| 亚洲国产精品999| 色网站视频免费| a级毛片在线看网站| 日日撸夜夜添| 亚洲成人手机| 亚洲少妇的诱惑av| 久久久国产精品麻豆| 日本wwww免费看| 欧美精品av麻豆av| 久久人人爽人人片av| 国产色婷婷99| 日韩av在线免费看完整版不卡| 亚洲综合色网址| 免费日韩欧美在线观看| 考比视频在线观看| 观看av在线不卡| 久久国产亚洲av麻豆专区| 18禁观看日本| 交换朋友夫妻互换小说| 午夜免费鲁丝| 午夜福利视频在线观看免费| 国产永久视频网站| 久久99热这里只频精品6学生| 国产精品蜜桃在线观看| 全区人妻精品视频| 成人18禁高潮啪啪吃奶动态图| 麻豆乱淫一区二区| 免费看光身美女| 亚洲色图 男人天堂 中文字幕 | 赤兔流量卡办理| 汤姆久久久久久久影院中文字幕| 国产亚洲欧美精品永久| 久久国产亚洲av麻豆专区| 国产亚洲一区二区精品| 国产亚洲av片在线观看秒播厂| 人人妻人人爽人人添夜夜欢视频| 大陆偷拍与自拍| 视频在线观看一区二区三区| 一区二区av电影网| 欧美另类一区| 国产片特级美女逼逼视频| 亚洲精品一区蜜桃| 色5月婷婷丁香| 国产成人精品久久久久久| 久久久久精品久久久久真实原创| 啦啦啦在线观看免费高清www| 久久精品久久精品一区二区三区| 午夜激情av网站| av黄色大香蕉| 亚洲国产精品999| 男女啪啪激烈高潮av片| 日本vs欧美在线观看视频| 久久国内精品自在自线图片| 亚洲欧美成人精品一区二区| 精品久久久久久电影网| 精品一区二区三区视频在线| 免费大片黄手机在线观看| 日本vs欧美在线观看视频| 在线 av 中文字幕| 在线天堂中文资源库| 日本vs欧美在线观看视频| 老司机亚洲免费影院| 国产成人午夜福利电影在线观看| 精品国产一区二区久久| 熟女人妻精品中文字幕| 亚洲精品美女久久av网站| 极品人妻少妇av视频| 热99国产精品久久久久久7| 日韩欧美一区视频在线观看| 国产精品一国产av| 王馨瑶露胸无遮挡在线观看| 考比视频在线观看| 日韩制服骚丝袜av| 99热这里只有是精品在线观看| 亚洲精品美女久久av网站| 亚洲av.av天堂| 美女国产高潮福利片在线看| 伦精品一区二区三区| 看非洲黑人一级黄片| 人妻人人澡人人爽人人| 国产精品不卡视频一区二区| 中国三级夫妇交换| 99热这里只有是精品在线观看| 五月开心婷婷网| 各种免费的搞黄视频| 国产精品99久久99久久久不卡 | 亚洲三级黄色毛片| 五月伊人婷婷丁香| av女优亚洲男人天堂| 亚洲,欧美,日韩| 亚洲美女视频黄频| 侵犯人妻中文字幕一二三四区| 夜夜爽夜夜爽视频| 久久99一区二区三区| 亚洲国产精品专区欧美| 最近的中文字幕免费完整| 日本黄色日本黄色录像| 国产成人免费观看mmmm| 韩国av在线不卡| 人人妻人人澡人人爽人人夜夜| av又黄又爽大尺度在线免费看| 少妇人妻精品综合一区二区| 久久国产精品大桥未久av| 有码 亚洲区| 性色av一级| 国产精品一区二区在线观看99| 五月玫瑰六月丁香| 久热久热在线精品观看| 肉色欧美久久久久久久蜜桃| av在线播放精品| 在线观看人妻少妇| 亚洲av中文av极速乱| 91精品国产国语对白视频| 久久久久久久亚洲中文字幕| 最黄视频免费看| 日本欧美国产在线视频| 精品人妻熟女毛片av久久网站| 亚洲人成77777在线视频| 一本—道久久a久久精品蜜桃钙片| 亚洲欧美一区二区三区国产| 五月开心婷婷网| 少妇的逼好多水| 另类精品久久| 满18在线观看网站| 好男人视频免费观看在线| 精品一品国产午夜福利视频| 一区二区av电影网| 性色av一级| 日本免费在线观看一区| 午夜免费鲁丝| 少妇被粗大的猛进出69影院 | 99热全是精品| 成年美女黄网站色视频大全免费| 亚洲精品久久午夜乱码| 中文字幕亚洲精品专区| 日韩欧美一区视频在线观看| 99国产综合亚洲精品| 最新中文字幕久久久久| 国产免费一区二区三区四区乱码| 少妇精品久久久久久久| 中文字幕另类日韩欧美亚洲嫩草| 18禁裸乳无遮挡动漫免费视频| 99久久综合免费| 夜夜爽夜夜爽视频| 日韩一本色道免费dvd| 亚洲精品国产色婷婷电影| 下体分泌物呈黄色| 久久av网站| 久久精品国产自在天天线| 美女福利国产在线| 中文字幕免费在线视频6| 女人久久www免费人成看片| 精品久久久久久电影网| 国产成人a∨麻豆精品| 乱人伦中国视频| 黑丝袜美女国产一区| 国产一区二区在线观看av| 久久精品国产综合久久久 | 五月伊人婷婷丁香| 91在线精品国自产拍蜜月| 免费看av在线观看网站| 亚洲精华国产精华液的使用体验| 亚洲激情五月婷婷啪啪| 久久ye,这里只有精品| 人妻少妇偷人精品九色| 精品视频人人做人人爽| 亚洲第一区二区三区不卡| 亚洲av福利一区| 中文乱码字字幕精品一区二区三区| 夜夜爽夜夜爽视频| 在线看a的网站| 欧美另类一区| 在线亚洲精品国产二区图片欧美| 免费女性裸体啪啪无遮挡网站| av一本久久久久| 久久久久久人人人人人| 久久久国产精品麻豆| 中文精品一卡2卡3卡4更新| 欧美精品亚洲一区二区| 成年女人在线观看亚洲视频| 熟女电影av网| 自拍欧美九色日韩亚洲蝌蚪91| 午夜激情av网站| 在线观看免费视频网站a站| 免费女性裸体啪啪无遮挡网站| 亚洲综合色网址| 9热在线视频观看99| 午夜福利视频在线观看免费| 国产成人精品久久久久久| 国产亚洲欧美精品永久| 熟女人妻精品中文字幕| 亚洲精华国产精华液的使用体验| 亚洲一区二区三区欧美精品| 一级a做视频免费观看| 人妻少妇偷人精品九色| 国产精品国产av在线观看| 久久99蜜桃精品久久| 亚洲,一卡二卡三卡| 国产在线一区二区三区精| 精品国产露脸久久av麻豆| 亚洲国产欧美在线一区| 国产成人aa在线观看| 国产午夜精品一二区理论片| 中文欧美无线码| 女性被躁到高潮视频| 久久久久久久久久久免费av| 亚洲,一卡二卡三卡| 亚洲欧美成人精品一区二区| 丰满乱子伦码专区| 两个人免费观看高清视频| 我的女老师完整版在线观看| 日日啪夜夜爽| 国产国语露脸激情在线看| 国产亚洲一区二区精品| 免费高清在线观看视频在线观看| 最近的中文字幕免费完整| 成年美女黄网站色视频大全免费| 亚洲精品国产av成人精品| 伦理电影大哥的女人| 欧美性感艳星| 亚洲人成网站在线观看播放| 97在线视频观看| 亚洲欧美色中文字幕在线| 搡女人真爽免费视频火全软件| 韩国高清视频一区二区三区| 欧美日韩成人在线一区二区| 国产精品国产三级国产专区5o| 交换朋友夫妻互换小说| 美女国产高潮福利片在线看| 男女下面插进去视频免费观看 | 男的添女的下面高潮视频| 最近手机中文字幕大全| 国产av精品麻豆| 午夜免费鲁丝| 国产在线视频一区二区| 黄片播放在线免费| 蜜桃在线观看..| 国产亚洲午夜精品一区二区久久| 亚洲欧美色中文字幕在线| 色婷婷av一区二区三区视频| 亚洲国产精品国产精品| 美女国产视频在线观看| av黄色大香蕉| 成人国产av品久久久| 夜夜骑夜夜射夜夜干| 精品酒店卫生间| 日韩成人av中文字幕在线观看| 久久久欧美国产精品| 亚洲内射少妇av| 国产精品麻豆人妻色哟哟久久| 亚洲国产精品专区欧美| 乱码一卡2卡4卡精品| 成人国产麻豆网| 亚洲精品中文字幕在线视频| 国产精品无大码| a级毛色黄片| 亚洲精品日韩在线中文字幕| 少妇熟女欧美另类| 欧美日韩成人在线一区二区| 久久久精品区二区三区| 久久久久久久久久久久大奶| av在线播放精品| 亚洲成人一二三区av| 国产成人a∨麻豆精品| 涩涩av久久男人的天堂| 成人手机av| 久久国产亚洲av麻豆专区| 成人免费观看视频高清| 亚洲一级一片aⅴ在线观看| 成年人午夜在线观看视频| 久久久久久久亚洲中文字幕| 丝袜人妻中文字幕| 啦啦啦视频在线资源免费观看| 亚洲精品一二三| 夫妻午夜视频| 午夜免费男女啪啪视频观看| 中国国产av一级| 97超碰精品成人国产| 伦理电影免费视频| 蜜桃在线观看..| 伦理电影免费视频| 国产成人一区二区在线| 综合色丁香网| 精品少妇黑人巨大在线播放| 国精品久久久久久国模美| 亚洲国产日韩一区二区| 毛片一级片免费看久久久久| 99国产综合亚洲精品| 日韩欧美精品免费久久| 狠狠婷婷综合久久久久久88av| 美女内射精品一级片tv| 插逼视频在线观看| 免费日韩欧美在线观看| 国产av精品麻豆| 日本爱情动作片www.在线观看| 久热这里只有精品99| 日韩精品有码人妻一区| av不卡在线播放| 亚洲久久久国产精品| 日韩不卡一区二区三区视频在线| 亚洲国产色片| 日韩熟女老妇一区二区性免费视频| 国产亚洲欧美精品永久| 日韩制服丝袜自拍偷拍| 午夜日本视频在线| 一本久久精品| 97超碰精品成人国产| 十分钟在线观看高清视频www| 狂野欧美激情性bbbbbb| videosex国产| 国产片内射在线| 国产亚洲av片在线观看秒播厂| 国产一区二区三区av在线| 在线 av 中文字幕| 国产精品.久久久| 亚洲欧洲精品一区二区精品久久久 | 少妇 在线观看| 日韩av不卡免费在线播放| 久久精品夜色国产| 国产熟女欧美一区二区| 亚洲 欧美一区二区三区| 一区二区日韩欧美中文字幕 | 日日摸夜夜添夜夜爱| 久久婷婷青草| 亚洲美女视频黄频| 日韩一区二区三区影片| 亚洲av电影在线进入| 黑人猛操日本美女一级片| 亚洲少妇的诱惑av| av播播在线观看一区| 久久久久网色| 国产在线免费精品| 黑人猛操日本美女一级片| 涩涩av久久男人的天堂| 亚洲熟女精品中文字幕| 亚洲欧美中文字幕日韩二区| 久久精品人人爽人人爽视色| 在线观看国产h片| 精品一区二区三卡| 亚洲国产精品专区欧美| 激情视频va一区二区三区| 亚洲av日韩在线播放| 男男h啪啪无遮挡| 久久久久久久久久久免费av| 春色校园在线视频观看| 边亲边吃奶的免费视频| 丰满饥渴人妻一区二区三| 日韩中字成人| 乱码一卡2卡4卡精品| 欧美精品国产亚洲| 久久亚洲国产成人精品v| 人人妻人人添人人爽欧美一区卜| 波野结衣二区三区在线| 欧美人与性动交α欧美软件 | 免费看av在线观看网站| 草草在线视频免费看| 免费黄频网站在线观看国产| 少妇的逼好多水| 97超碰精品成人国产| 日本爱情动作片www.在线观看| 久久精品人人爽人人爽视色| 老司机影院成人| 这个男人来自地球电影免费观看 | 亚洲精品成人av观看孕妇| 制服诱惑二区| 亚洲少妇的诱惑av| 色哟哟·www| 免费在线观看完整版高清| 亚洲,一卡二卡三卡| 99国产综合亚洲精品| a级毛片黄视频| av在线观看视频网站免费| 在线亚洲精品国产二区图片欧美| 亚洲精品乱久久久久久| kizo精华| 国产精品久久久久久av不卡| 高清黄色对白视频在线免费看| 亚洲欧美激情在线| 国产成人一区二区三区免费视频网站| 欧美在线黄色| 黄片播放在线免费| 亚洲性夜色夜夜综合| 欧美日韩瑟瑟在线播放| 欧美精品一区二区免费开放| 午夜免费成人在线视频| svipshipincom国产片| www.999成人在线观看| 精品国产国语对白av| 69av精品久久久久久| 日韩中文字幕欧美一区二区| 精品一区二区三区四区五区乱码| 成年动漫av网址| 91大片在线观看| 成人免费观看视频高清| 一边摸一边抽搐一进一出视频| 悠悠久久av| 黄色片一级片一级黄色片| 涩涩av久久男人的天堂| svipshipincom国产片| 亚洲av成人av| 无限看片的www在线观看| 国产精品久久视频播放| 女人被躁到高潮嗷嗷叫费观| 狂野欧美激情性xxxx| 午夜免费观看网址| 精品卡一卡二卡四卡免费| 天天操日日干夜夜撸| 999久久久精品免费观看国产| 国产精品秋霞免费鲁丝片| 国产成人系列免费观看| 两个人看的免费小视频| 精品久久久久久久毛片微露脸| 免费日韩欧美在线观看| 欧美精品一区二区免费开放| 亚洲美女黄片视频| 欧美大码av| 人人妻人人澡人人爽人人夜夜| a级毛片黄视频| 后天国语完整版免费观看| 婷婷精品国产亚洲av在线 | 男女床上黄色一级片免费看| 精品卡一卡二卡四卡免费| 夜夜爽天天搞| 亚洲专区中文字幕在线| av网站在线播放免费| 国产精品免费一区二区三区在线 | 十八禁网站免费在线| 国产在视频线精品| 最近最新免费中文字幕在线| 亚洲专区中文字幕在线| 国产成人啪精品午夜网站| 在线天堂中文资源库| 欧美国产精品va在线观看不卡| 国产成人影院久久av| 18禁观看日本| 日韩欧美在线二视频 | 色婷婷久久久亚洲欧美| 男人操女人黄网站| 日本欧美视频一区| 精品第一国产精品| 视频区欧美日本亚洲| 欧美日韩精品网址| 99热国产这里只有精品6| 天天躁狠狠躁夜夜躁狠狠躁| 正在播放国产对白刺激| 黄色视频,在线免费观看| 久久国产精品影院| 午夜老司机福利片| 两个人免费观看高清视频| 黄色毛片三级朝国网站| 电影成人av| 国产成人欧美| 久99久视频精品免费| 日本五十路高清| 18禁裸乳无遮挡动漫免费视频| 纯流量卡能插随身wifi吗| 国产国语露脸激情在线看| 91字幕亚洲| 99精品久久久久人妻精品| 精品一区二区三区视频在线观看免费 | 女性被躁到高潮视频| 男女免费视频国产| 欧美不卡视频在线免费观看 | 十八禁网站免费在线| 一级毛片精品| 亚洲精品国产精品久久久不卡| 日日爽夜夜爽网站| 女性生殖器流出的白浆| 精品卡一卡二卡四卡免费| 亚洲九九香蕉| 老司机亚洲免费影院| 母亲3免费完整高清在线观看| 一级a爱视频在线免费观看| 日韩人妻精品一区2区三区| 亚洲欧美激情在线| 国产欧美日韩一区二区精品| 亚洲全国av大片| 国产成人免费观看mmmm| 精品久久久久久,| 欧美国产精品一级二级三级| 一个人免费在线观看的高清视频| 国产视频一区二区在线看| 久久这里只有精品19| 1024香蕉在线观看| 欧美人与性动交α欧美软件| 久久久国产成人免费| 日韩精品免费视频一区二区三区| 99国产精品99久久久久| 一级片免费观看大全| 国产在线一区二区三区精| 成人影院久久| 性色av乱码一区二区三区2| 亚洲国产欧美日韩在线播放| 国产成人啪精品午夜网站| 露出奶头的视频| 亚洲三区欧美一区| 欧美一级毛片孕妇| 女人久久www免费人成看片| 亚洲专区国产一区二区| 国产97色在线日韩免费| 国产欧美日韩精品亚洲av| 欧美日韩av久久| 老司机午夜十八禁免费视频| 国产91精品成人一区二区三区| 亚洲专区字幕在线| 国产av又大| 国产高清激情床上av| 9191精品国产免费久久| 欧美成狂野欧美在线观看| 国产精品香港三级国产av潘金莲| 在线国产一区二区在线| 成人手机av| 成年动漫av网址| 91在线观看av| 如日韩欧美国产精品一区二区三区| 亚洲国产看品久久| 亚洲中文日韩欧美视频| 男人的好看免费观看在线视频 | 免费人成视频x8x8入口观看| 亚洲专区中文字幕在线| 久久午夜综合久久蜜桃| 男女免费视频国产| 黑人巨大精品欧美一区二区蜜桃| 9色porny在线观看| 国产精品久久久久久人妻精品电影| 91字幕亚洲| xxx96com| 国产精品久久久久久人妻精品电影| 99国产极品粉嫩在线观看| 亚洲欧美日韩高清在线视频| 电影成人av| 亚洲成人免费av在线播放| 日日夜夜操网爽| 日韩大码丰满熟妇| 精品一区二区三卡| netflix在线观看网站| 男人操女人黄网站| 在线永久观看黄色视频| av不卡在线播放| 久久久精品国产亚洲av高清涩受| 人人妻人人爽人人添夜夜欢视频| 欧美日韩瑟瑟在线播放|