• <tr id="yyy80"></tr>
  • <sup id="yyy80"></sup>
  • <tfoot id="yyy80"><noscript id="yyy80"></noscript></tfoot>
  • 99热精品在线国产_美女午夜性视频免费_国产精品国产高清国产av_av欧美777_自拍偷自拍亚洲精品老妇_亚洲熟女精品中文字幕_www日本黄色视频网_国产精品野战在线观看 ?

    Automatic Surveillance of Pandemics Using Big Data and Text Mining

    2021-12-14 09:57:26AbdullahAlharbiWaelAlosaimiandIrfanUddin
    Computers Materials&Continua 2021年7期

    Abdullah Alharbi,Wael Alosaimi and M.Irfan Uddin

    1Department of Information Technology,College of Computers and Information Technology,Taif University,P.O.Box 11099,Taif,21944,Saudi Arabia

    2Institute of Computing,Kohat University of Science and Technology,Kohat,26000,Pakistan

    Abstract:COVID-19 disease is spreading exponentially due to the rapid transmission of the virus between humans.Different countries have tried different solutions to control the spread of the disease, including lockdowns of countries or cities, quarantines, isolation, sanitization, and masks.Patients with symptoms of COVID-19 are tested using medical testing kits; these tests must be conducted by healthcare professionals.However, the testing process is expensive and time-consuming.There is no surveillance system that can be used as surveillance framework to identify regions of infected individuals and determine the rate of spread so that precautions can be taken.This paper introduces a novel technique based on deep learning (DL) that can be used as a surveillance system to identify infected individuals by analyzing tweets related to COVID-19.The system is used only for surveillance purposes to identify regions where the spread of COVID-19 is high; clinical tests should then be used to test and identify infected individuals.The system proposed here uses recurrent neural networks(RNN)and word-embedding techniques to analyze tweets and determine whether a tweet provides information about COVID-19 or refers to individuals who have been infected with the virus.The results demonstrate that RNN can conduct this analysis more accurately than other machine learning(ML)algorithms.

    Keywords: Disease surveillance; social media analysis; recurrent neural networks; text mining

    1 Introduction

    Humankind is going through an unprecedented time due to the spread of the novel virus SARS-CoV-2, which causes COVID-19.As of this writing, while the scientific community has developed a vaccine to protect humans from this deadly virus, it is only just beginning to be distributed and administered.So far, the only solution is to control the spread of the virus; to do this, patients with COVID-19 must be isolated.Some countries allow patients to self-quarantine;other governments force people to stay home.Some have also set up quarantine centers to separate infected or possibly infected individuals from the general public.The World Health Organization(WHO)1https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public.and the U.S.Center for Disease Control (CDC)2https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/prevention.html.have issued guidelines to slow the spread of the virus.These guidelines include social distancing, sanitization, wearing masks and gloves, and isolating those who are infected with COVID-19.The virus is believed to have first emerged in the Wuhan province of China at the end of December 2019.Patients infected with COVID-19 were first identified in January 2020.Even as many people in Wuhan fell ill with similar symptoms, healthcare professionals did not realize they were witnessing the start of an outbreak.Doctors initially treated these patients as they would anyone with a fever; it was not until the end of January 2020 that they realized that the illness was caused by the spread of a highly contagious virus.The entire province was then locked down to stop the spread, but the virus had already spread beyond the borders of the lockdown.

    So far, the only method for identifying individuals infected with COVID-19 is to test them.However, the testing kits are expensive resources, and the test must be conducted by a medical professional.Therefore, is not possible to test everyone.COVID-19 cases can also be identified by the symptoms of the illness, which include fever, cough, breathing difficulties, and a loss of smell and/or taste.However, physical checks must be performed to identify cases based on symptoms.Therefore, there is a need for a surveillance system that can automatically analyze social media posts to identify individuals with symptoms of COVID-19.Once possible cases have been identified, individuals with symptoms can be tested for COVID-19, and infected individuals can be isolated.The system can function as a complementary tool to analyze the spread of the virus and identify regions where it is spreading at an alarming rate.This information can then be used to determine appropriate precautionary measures.Such an approach might limit the need for total lockdowns of countries and cities and restrictions on all types of travel, neither of which is healthy for humans or good for the economy.

    The novel surveillance system proposed in this paper can analyze the content of social media posts to identify possible cases of COVID-19.It will analyze the content of social media posts to identify posts referencing common symptoms of COVID-19, including fever, coughing, pain,headache, difficulty breathing, etc.Machine learning (ML) techniques will then be used to determine whether a post indicates a possible COVID-19 infection or only references the key terms.For instance, a tweet saying, “My daughter gave a lecture on COVID-19” provides information but does not indicate a possible case.However, a tweet saying “My neighbor’s daughter has had a fever for the last two days and is coughing constantly.I hope she is not infected with COVID-19”could indicate a possible infection.The proposed deep learning (DL) algorithms will analyze the content of posts to determine whether the post indicates that someone needs to be physically tested for COVID-19.We have also designed a surveillance system that can help measure the rate at which COVID-19 is spreading in a particular region.This system can help healthcare professionals automatically monitor people for possible symptoms of COVID-19 and decide on actions to control the spread particularly in regions where test kits and access to COVID-19 tests are limited.

    The objectives of this study are (i) to determine how the system can distinguish posts mentioning information related to COVID-19 from those that could indicate possible cases; (ii) to train traditional machine learning algorithms to identify people infected with COVID-19; (iii) to train a recurrent neural network (RNN) using long short-term memory (LSTM) and compare its performance to that of traditional ML techniques; and (iv) to identify clusters of people with symptoms of COVID-19 and determine whether these clusters are growing at disturbing rates so that healthcare organizations can be informed to take actions if needed.

    This paper is structured as follows.Section 2 describes the latest research in the field.This is followed by a detailed discussion of the surveillance framework and machine learning algorithms used to analyze social media text posts in Section 3.Section 4 describes and analyzes the experiments performed to test the system.Section 5 concludes the paper and offers suggestions for future research.

    2 Literature Review

    A call [1] for global AI researchers to develop novel techniques for text mining and data mining that could be used to help trace the spread of COVID-19 was issued by the White House,with collaboration from several research centers and technology companies.To support research requiring real-time data about COVID-19, the Allen Institute of AI developed a COVID-19 Open Research Dataset [2] that is open source and updated weekly.ML researchers can apply ML algorithms to this open-source dataset to better understand the patterns of the spread of the virus.They can also propose ways to improve the speed and accuracy of diagnoses, recommend therapeutic techniques, and identify individuals who are more susceptible to severe illness based on genetic and physiological characteristics.Different ML algorithms have been used to taxonomically classify the COVID-19 genome [3], to conduct Clustered Regularly Interspaced Short Palindromic Repeats (CRISPR-based) identification of COVID-19 [4], to predict survival rates for patients with severe COVID-19 [5], and to identify drugs that can be used to treat COVID-19 [6].It is important to identify cases of COVID-19 at an early stage to treat patients effectively and control the spread of the virus.A reverse-transcription polymerase chain reaction (RT-PCR) test is used to diagnosis COVID-19 patients [7].Chest computed tomography (CT) images are also considered a reliable way to identify cases of COVID-19, particularly in regions experiencing an epidemic.However,this technique requires the expertise of a radiologist and is time-consuming.Expertise and time are the most valuable resources in the current pandemic, especially in areas with uncontrolled spread of COVID-19.Therefore, an automatic analysis technique is desirable.In [8], a convolutional neural network (CNN) was used to identify cases of COVID-19.The experimental analysis of that technique demonstrated that CNN can efficiently classify CT images and identify cases of COVID-19.

    Another study [9] made predictions about COVID-19 vaccine candidates using the Vasign reverse vaccinology tool and Vaxign-ML.That study found that the N protein is contained in highly pathogenic strains of coronaviruses (SARS/MERS/COVID-19) but not in those that cause mild symptoms.They also found that the S protein and five different non-structural proteins are adhesive and play key roles in the ability of SARS-CoV-2 to spread and invade a host.Predicting vaccine candidates can identify new strategies for the development of effective, safe vaccines.Major outbreaks like the COVID-19 pandemic require speedy identification of possible cases at an early stage.The genomic sequence of the virus must also be determined to control, treat,and contain the virus.One study [3] used a ML technique to classify SARS-CoV-2 with a high degree of accuracy and scalability.Digital signal processing and ML techniques, augmented by the decision tree technique, were used to analyze the viral genome.The results were validated using Spearman’s rank correlation coefficient.The genome causing COVID-19 has now been sequenced with 100% accuracy.In another study [10], COVID-19 cases were automatically identified using a dataset of X-ray images of lungs.The dataset included images of the lungs of patients with pneumonia, of the lungs of patients who tested positive for COVID-19, and of healthy lungs.CNN and transfer learning techniques were used to classify the images.In that study, the use of DL to analyze the X-ray images achieved the best accuracy, sensitivity, and specificity.

    The COVID-19 outbreak began in the Wuhan province of China in the middle of January 2020.To control the spread of the virus, China implemented interventions such as quarantines,travel bans, and careful monitoring of all suspected cases.However, the impact of these policies on the epidemic is not known.One study [11] analyzed the impact of these measures on the spread of the virus using migration data and other data relevant to the spread of the virus and the pandemic curve.They then used AI techniques trained on SARS data to predict the course of the pandemic.Another study [12] used SIR and ML tools to analyze the COVID-19 pandemic in real scenarios.Another [13] used DL techniques to analyze CT images of the lungs of patients infected with COVID-19.In that study, 325 images from confirmed COVID-19 cases were analyzed, along with images of the lungs of patients with a history of pneumonia; a total of 740 images were examined.A transfer learning technique was used on ImageNet using Inception CNN.The model developed in that study could identify COVID-19 cases with 89.5%, 0.88 specificity, and 0.87 sensitivity.That study serves as proof of concept of the use of AI to identify cases of COVID-19 based on features of radiology scans.In another study [14], CT images were analyzed using AI to distinguish cases of COVID-19 from cases of pneumonia.The model developed in that study is called the COVID-19 Neural Network, or COVNet.It uses DL techniques to identify features in CT images that can be used to diagnose cases of COVID-19.The model also analyzed CT images to distinguish images of cases of pneumonia from those of healthy lungs.The images in that study were collected from six different hospitals from August 2016 to February 2020.The model’s performance was evaluated based on area under curve (AUC), sensitivity, and specificity.Yet another study [15] used AI techniques to help protect healthcare professionals from contracting COVID-19.

    Another approach [16] used AI technologies and a mobile application to detect cases of COVID-19 by analyzing the sound of the patient’s cough.The main objective of that study was to minimize the rate of misclassifications.The application was able to differentiate the coughs of COVID-19 patients from regular coughs with 90% accuracy.The app is intended to complement clinical tests and thereby conserve resources.Meanwhile, another study [17] used different AI applications to diagnose COVID-19, examining different dimensions of the COVID-19 pandemic using ML techniques.They studied SARS-CoV-2 at the molecular level, using different clinical trials and different social perspectives.They also investigated the execution of various AI projects aimed at controlling the COVID-19 pandemic.In another study [18], ML algorithms were used to better understand COVID-19 pandemic, particularly its early dynamics.That study examined increases in the number of infections within a given period and sought to identify certain patterns in the pandemic, such as the rate at which mild symptoms become critical, the influence of asymptotic infections, the force of infection.It also sought to establish a mechanism for generating daily predictions of the number of new cases.The authors used U.S.data; in the United States,the first case was confirmed on January 20, 2020.Their mechanism is efficient and robust and can predict the course of the pandemic; it can also be generalized to other pandemics.In fact, they claim that the mechanism is so generic that it can be used to predict the spread of any virus in any population.

    All of these studies used AI techniques to make predictions or classify features related to COVID-19.These AI techniques have demonstrated reasonably accurate performance.In the present paper, tweets (this research could be expanded to include other data and social media such as Facebook, phone messages, emails, etc.) were analyzed for content using AI.The goal was to identify tweets containing information that might indicate the existence of COVID-19 cases.These cases were then mapped to identify clusters.Clusters that were growing at alarming rates were then identified; an “alarming rate” might mean a cluster that doubled in size within one day.Quickly growing clusters need to be further analyzed; healthcare professionals must test the possible cases and implement the necessary precautionary measures.

    3 Materials and Methods

    This section describes the framework used to analyze the content of tweets to identify possible cases of COVID-19.The dataset used in the present study is described, and the DL algorithms used to analyze the content of tweets is explained.

    3.1 Data Analysis

    The present paper proposes a method for identifying possible cases of COVID-19 based on the content of tweets.Twitter streaming application programming interface (API)3https://www.developer.twitter.com/was used to collect tweets related to COVID-19.Using this API, tweets posted from January 2020 to May 2020 and including the keywords (with hashtags) “fever,” “headache,” “cough,” “body ache,”“pain,” “quarantine,” “isolation,” “sanitization,” and “social distancing” were collected.Twitter’s streaming API4was used to collect tweets containing these keywords.This open-source API allowed us to access tweets in real time using JavaScript object notation (JSON).A total of 245,098 tweets in English were collected from around the world.The tweets were then manually labelled to indicate which contained information that could indicate possible COVID-19 infections.These annotated data were then analyzed by the ML and DL algorithms.In order to eliminate bias, three researchers from different fields annotated the tweets independently.Each tweet was annotated with 1 or 0; a tweet indicating a possible COVID-19 infection was labelled 1, and a tweet that did not indicate a possible infection was labelled 0.If more than one researcher labels data, it is important to evaluate the level of agreement between different annotators.A technique proposed by McHugh [19], the Kappa test, was used here to evaluate inter-annotator agreement.A high Kappa number indicates high agreement across annotators and thus high reliability.The Kappa number for our annotations was 0.895, indicating strong agreement among the annotators.

    On Twitter, tweets are restricted to 140 characters; tweets are therefore informal and noisy in nature.Many tweets contain abbreviation or hashtags and express sarcasm or humor.This kind of content is easily understood by humans, but for ML algorithms it poses a challenging task.

    Only tweets in English were included in this study.First, stop word removal, stemming,and tokenization were performed to clean the data.Next, short tweets (tweets containing fewer than four words) were removed from the dataset, as short tweets usually do not contain enough information to extract the idea behind the tweet [20].

    3.2 Word Embedding

    Word embedding techniques are used to represent vocabulary in a document.These techniques are used to capture the context of words in document, including syntactic and semantic similarities, relationships with other words, and so on.The vector representation of given words is illustrated using word embedding.Word2Vec [21] is a popular neural network consisting of two layers; it is used to process vectorized representations of words.The text is input to Word2Vec and produce a set of vectors containing features representative of the words in thatcorpus.Word2Vec places similar words into the same vector space.Given sufficient text and enough examples of words in context, Word2Vec can make accurate guesses about the meaning of a word based on previous occurrences of that word.This knowledge can be used for various purposes, such as to establish the association of one word with another word, to cluster and classify documents by topic, to analyze content, to search for key words, and to make recommendations.

    For example, let’s consider a dictionary containing 10,000 English words.If these words are embedded using one-hot encoding, the entire dictionary would be represented in 10,000 different dimensions; no word would have a relationship with any other words.Therefore, this system would not identify the meaning or context of the words.A sample representation of the wordsComputer,Doctor,King,Man,Nurse,Queen,Table, andWomenis shown in the top part of Fig.1.The words are shown in a single dimension.Although words likeKing,Man, andDoctorare related, a linear representation does not show the relationships among these words.However, if we use word embedding, as in Word2Vec, around 300 dimensions can be used to represent the relationships of the 10,000 words in the dictionary.For example, the wordsKingandManare related by gender.In the example Doctor and Nurse indicates gender baseness of the model, as both doctor and nurse can be male or female.The relationships among a group of sample words are shown in Fig.1.

    Figure 1:An example of word embedding (Word2Vec)

    3.3 Recurrent Neural Networks

    In a neural network, the input has a fixed size.As a result, the accuracy is low when the input involves sequences that do not have a predetermined size (such as sentences).Another issue with neural networks is that they do not account for the relationships among features, which are important in sentences since the words in a sentence are related to each other.A recurrent neural network (RNN) solves these issues.In an RNN, the input does not need to be a fixed size, and relationships among features of a sequence can be accounted for.An RNN can also remember things it has learned.For example, given a word in a sentence, an RNN remembers which words appear before the given word.A sample architecture of an RNN processing tweets and classifying them as positive or negative is shown in Fig.2.

    Figure 2:An RNN with an LSTM module classifying tweets

    A sample training process for an RNN is provided in Algorithm 1.First, the input sequence is taken and a value fromWa,bais taken, then the sigmoid activation function is utilized.Loss is computed at the output layer.A common type of loss is binary cross-entropy loss(CEL); the objective of the optimization algorithm is to minimize the cross-entropy loss.A simple optimization algorithm, such as gradient descent algorithm, is used.After a few iterations, the optimization algorithm has minimized loss and optimized the values of W and b.

    Algorithm 1:Training an RNN Wa,Wya,ba,bya=Glorot uniform initializer while i ≤num_iterations do A=g(Wa■A+X■+ba)?y=g(WyaA+by)L(?y,Y)=?1m∑mi=0 Yi log(?y)Wa=Wa ?α dL dWa ba=ba ?α dL dba

    Wya=Wya ?α dL dWya by=by ?α dL dby

    3.4 Long Short-Term Memory

    RNN is an efficient architecture for connecting previous information with current information,such as predicting the next word based on the previous word.Consider the sentence:“I am suffering from COVID-19.” This clearly indicates that someone is infected with COVID-19; no further context is needed.But consider the tweet:“Last week I went to the hospital, where I stayed with other patients for two weeks; now I am feeling better and hopefully COVID-19 negative.” This tweet does not indicate a positive COVID-19 case because the patient stayed in the hospital for two weeks.The gap between the current task and the previous information can be very large.As this gap increases, an RNN is unable to capture the correct information; that is, it may fail to capture long-term dependencies [22].This issue is solved using long short-term memory (LSTM).

    An LSTM is a specific type of RNN that is used to capture long-term dependencies.An LSTM includes four neural network layers that operate in a special fashion.The operations of these layers are shown in Algorithm 2; the architecture of an LSTM is illustrated in Fig.3.The first sigmoid function is the forget gate, which determines which information should be forgotten from the previous cell state C.The second sigmoid function, along with the tanh activation,is known as the update gate.It determines which information should be saved to the cell state and which should be forgotten.The last sigmoid is called the output gate; it determines which information is provided to the next hidden state.

    Figure 3:A sample architecture of an LSTM

    Algorithm 2:A mathematical representation of the neural network layers in an LSTM 1 C~=tanh(Wc[A,X]+bc)2 Γu=σ(Wu[A,X]+bu)3Γf =σ(Wf[A,X]+bf)3 Γo=σ(Wo[A,X]+bo)4 C=Γu?C~+Γf ?C5 A=Γo?C

    3.5 Focal Loss

    In binary classification problems, binary CEL is usually used.The objective of the gradient descent optimization algorithm is to minimize this loss.The CEL is shown in Algorithm 1.To demonstrate the system, the CEL for binary class classification used in the COVID-19corpusis shown in Eq.(1), wherey∈{0,1}.In Eq.(1),yrepresents the ground truth class; that is,y=1 if the tweet indicates the presence of a COVID-19 case (positive) and 0 if not (negative).The probability thaty=1 is represented byp∈[0,1].Let’s defineptas given in Eq.(2).We can then rewrite Eq.(1) asCEL(p,y)=CEL(pt)=?log(pt).This CEL is shown as a blue curve in Fig.4.It can be observed that loss occurs in classes wherept>0.5.When the number of easily classified classes is large, then even small amounts of loss can overwhelm classes that occur only rarely.This class imbalance problem can be solved using a weighting factor; here,α∈[0,1] is used for class 1 and 1 ?αfor class 0.With this definition ofα, Eq.(2) is converted toCEL(pt)=?αtlog(pt).

    Figure 4:Cross-entropy loss vs.focal loss

    Previous studies have demonstrated that a large class imbalance during training overwhelms the CEL [23].Most loss consists of large numbers of easily classified negative classes; therefore,during the back propagation, this imbalance dominates the gradient computation.Where focal loss (FL) is an issue [23], a modulating factor(1 ?pt)γis introduced in the CEL, withγ≥0 as a hyper-parameter.FL is defined in Eq.(3).The FL for different values ofγ∈[0,5] are shown in Fig.4.It can be observed that whenptis small, the value of 1 ?ptis close to 1 and therefore does not affect the loss.As the value ofptapproaches 1, 1 ?ptapproaches 0, and therefore the loss value for classes that are easily classified is weighted down.Whenγ=0, FL is equal to CEL,and when the value ofγincreases, FL increases due to the effect of 1 ?pt.In our experiments,γ=2 effectively minimized FL.

    3.6 Clustering

    Clustering is used to divide data points into different groups based on characteristics.Clustering divides data points into different groups such that data points in one group are similar to each other but different from those in other groups.The objective is to separate groups with similar features to create clusters.To form clusters, we took the longitude and latitude values of tweets indicating a possible COVID-19 infection.The closer such tweets are in location and the more such tweets occur in one geographical area, the higher the chance that spread is high in that region.Clustering is a common technique for statistical analysis; it lies in the field of unsupervised learning.We used the k-means [24] algorithm to cluster positive COVID-19 cases and to analyze the rate at which these clusters were growing.The k-means algorithm was used because it is simple to implement, it scales to large datasets, it guarantees convergence, it can warm-start the positions of centroids, it can easily adapt to new examples, and it can generalize to clusters of different shapes and sizes.

    3.7 Surveillance Framework

    This section describes the surveillance framework.The system works by collecting tweets containing words related to possible symptoms of COVID-19, such as cough, fever, headache,body aches, and breathing difficulties.These tweets were pre-processed to remove unnecessary details and stored in our database.Then the word embedding technique Word2Vec was applied to convert the text to numbers.These numbers were processed by the RNN for training; the RNN identified tweets that indicated possible COVID-19 cases and those that did not.The tweets were then grouped into clusters, and the clusters were analyzed to identify regions where the spread was increasing at an alarming rate.This framework can then help the government decide whether to implement precautionary measures to control the spread of the virus, such as strict lockdowns.The entire framework works as a surveillance system that analyzes tweets in real time to clarify the pattern of spread.If the framework indicates that the virus is spreading very quickly—that is, if a cluster is growing faster than a specified threshold—notifications can be sent to the authorities.For example, healthcare professionals could engage in mass testing in the region, government organizations could implement lockdowns, or residents could be provided food at home to eliminate the need to interact with others.The surveillance framework is illustrated in Fig.5.

    Figure 5:A surveillance framework that uses tweets to identify clusters of COVID-19 cases

    4 Results

    In this paper, an RNN with LSTM is used to process sequence data.In this section, the performance of the RNN is compared to that of other ML algorithms.The performance of the RNN was compared to that of logistic regression, a na?ve Bayes classifier, a support vector machine (SVM), a decision tree, an artificial neural network (ANN), and a deep neural network(DNN).A DNN is different from the other ML algorithms as it includes many layers to efficiently process data.However, even a DNN cannot process sequence data efficiently [25], mainly because the input size is fixed.When the data are sentences, such as tweets, the input size cannot be fixed.Furthermore, different neurons in ANNs and DNNs do not share data with each other.Data sharing is important in sequence data as the different words in a sentence are related.

    Figure 6:(a) Train and test accuracy and (b) Precision, recall, and F1-scores of different ML models

    Different ML models trained on the dataset were executed and their performance was evaluated; we found that the RNN achieved the highest accuracy when processing tweet data.The train and test accuracies achieved by different ML models are shown in Fig.6a.As the figure shows, traditional ML techniques such as logistic regression, na?ve Bayes, and SVM achieved a maximum of 86% accuracy; ANN and DNN achieved higher accuracy.However, the sequence is best captured by RNN with LSTM, which achieved 98% accuracy.The recall, precision, and F1-scores of different models are shown in Fig.6b; again, RNN achieved the best results of the tested techniques.

    The confusion matrices computed by different ML algorithms are shown in Fig.7.LSTM achieved fewer false positives and false negatives and high rates of true positives and true negatives.This demonstrates that LSTM could more effectively analyze the complex structures in our dataset than other ML algorithms.

    Figure 7:Confusion matrices computed by different ML algorithms.(a) Logistic regression confusion matrix (b) Na?ve Bayes confusion matrix (c) SVM confusion matrix (d) ANN confusion matrix (e) DNN confusion matrix (f) LSTM confusion matrix

    Another technique that we used to evaluate the performance of different ML algorithms is the receiver operating characteristic (ROC).A higher curve to the left indicates higher accuracy.The ROC obtained by the different ML algorithms is shown in Fig.8.Traditional ML algorithms achieved accuracy of up to 88%.The highest accuracy was achieved by LSTM, demonstrating that LSTM can process tweet data efficiently and identify tweets that could indicate possible COVID-19 cases.

    Figure 8:ROC achieved by different ML algorithms.(a) Logistic regression ROC (b) Na?ve Bayes ROC (c) SVM ROC (d) ANN ROC (e) DNN ROC (f) LSTM ROC

    We used the ML and DL frameworks to classify the tweets as positive or negative.Tweets that did not contain information indicating a possible COVID-19 case were classed as negative; these were discarded from the surveillance framework.Tweets labelled as positive contained information indicating a possible case of COVID-19.We used the k-means algorithm to create clusters of positive cases in one country (Pakistan), shown in Fig.9.Here, the yellow and purple regions need further analysis as our data indicate high rates of spread in those regions.Since the surveillance system is used to continuously monitor the whole region, it can show when clusters increase in size and thereby help healthcare professionals implement measures to control the spread of the virus.

    Figure 9:Clusters of positive cases in Pakistan

    We also plotted the tweets in our database by country; the numbers of positive and negative tweets for several countries are shown in Fig.10.The figure shows that only a small number of tweets contained information indicating possible COVID-19 cases, while many tweets in the database only contained information about COVID-19.

    Figure 10:Distribution of positive and negative cases in several countries

    5 Conclusion

    The only way to identify individuals infected with COVID-19 is to test them.However, testing is an expensive resource that requires human effort.It is not possible to test all individuals to identify all cases of COVID-19.Therefore, there is a need for a surveillance system that can identify people who may have symptoms of COVID-19; clinical tests can then be used to confirm cases.The present paper proposes a surveillance system based on analyses of social media posts.The system can be used to identify regions where individuals with symptoms of COVID-19 and regions where the virus is spreading at an alarming rate.This system can help healthcare professionals take appropriate action to keep the situation under control and save precious lives.The surveillance system could also be extended to analyze other types of social medial or messages to identify COVID-19 cases.Our results show that a recurrent neural network is the most accurate type of machine learning technique for this surveillance system.Future research could extend this analysis to countries around the world and identify regions where the rate of spread is very high.

    Acknowledgement:The authors acknowledge Taif university support for this research through Taif university Researchers Supporting Project number (TURSP-2020/231), Taif University, Taif,Saudi Arabia.

    Funding Statement:Authors received financial support from Taif university through Researchers Supporting Project number (TURSP-2020/231), Taif University, Taif, Saudi Arabia.

    Conficts of Interest:The authors declare that they have no conflicts of interest to report regarding the present study.

    国产精品久久久久久精品古装| 色婷婷av一区二区三区视频| 亚洲经典国产精华液单| av专区在线播放| 日本欧美国产在线视频| 多毛熟女@视频| av国产免费在线观看| 欧美日韩综合久久久久久| 97在线人人人人妻| 国产成人aa在线观看| 夜夜骑夜夜射夜夜干| 久久精品久久久久久噜噜老黄| 午夜福利在线观看免费完整高清在| 亚洲久久久国产精品| 亚洲三级黄色毛片| 久热久热在线精品观看| 日韩亚洲欧美综合| 成年av动漫网址| 欧美日韩一区二区视频在线观看视频在线| 国产 精品1| 91在线精品国自产拍蜜月| 国产亚洲欧美精品永久| 这个男人来自地球电影免费观看 | 国产av国产精品国产| 日本wwww免费看| 午夜福利在线在线| www.av在线官网国产| 熟妇人妻不卡中文字幕| 2021少妇久久久久久久久久久| 在线观看美女被高潮喷水网站| 国产成人免费观看mmmm| 22中文网久久字幕| 亚洲,欧美,日韩| h视频一区二区三区| 精品亚洲成国产av| 欧美成人精品欧美一级黄| 一级黄片播放器| 婷婷色综合www| 久久久久人妻精品一区果冻| 18禁裸乳无遮挡动漫免费视频| 国产 一区精品| 日韩,欧美,国产一区二区三区| 亚洲人成网站高清观看| 欧美zozozo另类| 亚洲欧美一区二区三区黑人 | 夜夜看夜夜爽夜夜摸| 亚洲三级黄色毛片| 嘟嘟电影网在线观看| 久久久色成人| 嫩草影院入口| 国产精品人妻久久久影院| 日本vs欧美在线观看视频 | 九九在线视频观看精品| 人妻 亚洲 视频| av黄色大香蕉| 直男gayav资源| 国产视频内射| 一级av片app| 国产69精品久久久久777片| 国产精品99久久99久久久不卡 | 精品一区二区三区视频在线| 啦啦啦视频在线资源免费观看| 美女xxoo啪啪120秒动态图| 色哟哟·www| 丰满人妻一区二区三区视频av| 看非洲黑人一级黄片| 欧美日韩精品成人综合77777| 日本av免费视频播放| 久久久午夜欧美精品| 在线观看av片永久免费下载| 国产高清不卡午夜福利| 国产男女超爽视频在线观看| 国产欧美亚洲国产| 中文资源天堂在线| 亚洲人成网站在线观看播放| 精品一区二区三卡| 亚洲人成网站高清观看| 中文在线观看免费www的网站| 成年av动漫网址| 啦啦啦啦在线视频资源| 热re99久久精品国产66热6| 天堂俺去俺来也www色官网| 一本一本综合久久| 美女内射精品一级片tv| 久久国产亚洲av麻豆专区| 国精品久久久久久国模美| 在线观看美女被高潮喷水网站| 国产高清国产精品国产三级 | 欧美成人a在线观看| 我要看日韩黄色一级片| 舔av片在线| 夫妻午夜视频| 日日撸夜夜添| 99热网站在线观看| 少妇丰满av| 五月伊人婷婷丁香| 久久99蜜桃精品久久| 天天躁夜夜躁狠狠久久av| 午夜日本视频在线| 国产精品久久久久久久电影| 国产精品久久久久久久电影| 久久国产精品大桥未久av | 国产成人午夜福利电影在线观看| 亚洲精品一二三| 日日摸夜夜添夜夜添av毛片| 国产av一区二区精品久久 | 波野结衣二区三区在线| 99视频精品全部免费 在线| 久久久久久久久久成人| 国产精品99久久久久久久久| 成年女人在线观看亚洲视频| 久久久久久久久久久丰满| 亚洲国产成人一精品久久久| 亚洲av不卡在线观看| 极品教师在线视频| 三级国产精品片| 亚洲精品第二区| 丝袜脚勾引网站| 丝袜脚勾引网站| 51国产日韩欧美| 在线免费十八禁| 日韩亚洲欧美综合| 午夜老司机福利剧场| 男女边吃奶边做爰视频| 自拍欧美九色日韩亚洲蝌蚪91 | 久久 成人 亚洲| 制服丝袜香蕉在线| 日韩成人伦理影院| 国模一区二区三区四区视频| 深爱激情五月婷婷| 精品久久久久久久久av| a级毛片免费高清观看在线播放| 男女国产视频网站| 亚洲精品久久午夜乱码| 少妇猛男粗大的猛烈进出视频| 大片免费播放器 马上看| 好男人视频免费观看在线| 乱系列少妇在线播放| 中文乱码字字幕精品一区二区三区| av不卡在线播放| 亚洲四区av| 欧美xxxx性猛交bbbb| 美女高潮的动态| 久久精品国产亚洲av天美| 欧美97在线视频| 赤兔流量卡办理| 久久久久久久久久成人| 高清午夜精品一区二区三区| 成人毛片60女人毛片免费| 久久99蜜桃精品久久| 九九久久精品国产亚洲av麻豆| 亚洲国产欧美人成| 视频中文字幕在线观看| 亚洲欧美日韩卡通动漫| 91精品国产国语对白视频| 免费观看的影片在线观看| 性色av一级| 在线亚洲精品国产二区图片欧美 | 2022亚洲国产成人精品| 久久99蜜桃精品久久| 国产精品av视频在线免费观看| 成人国产av品久久久| 日本av手机在线免费观看| 免费观看无遮挡的男女| 久久青草综合色| 午夜福利视频精品| 99久国产av精品国产电影| 在现免费观看毛片| 日韩一区二区三区影片| 国产精品久久久久久精品古装| 久久久久久久国产电影| 免费少妇av软件| 又黄又爽又刺激的免费视频.| 一区二区av电影网| 五月伊人婷婷丁香| 亚洲综合色惰| 97在线视频观看| 天堂8中文在线网| 久久国产亚洲av麻豆专区| 99久久精品国产国产毛片| 韩国av在线不卡| 韩国高清视频一区二区三区| 国产欧美日韩一区二区三区在线 | 亚洲天堂av无毛| 国产精品国产三级国产av玫瑰| 免费久久久久久久精品成人欧美视频 | 好男人视频免费观看在线| 春色校园在线视频观看| 国产成人aa在线观看| 亚洲人成网站在线播| 成人综合一区亚洲| 久久精品国产亚洲av涩爱| av福利片在线观看| 亚洲精品乱码久久久久久按摩| 国产精品福利在线免费观看| 亚洲伊人久久精品综合| 亚洲一级一片aⅴ在线观看| 男女国产视频网站| 欧美成人一区二区免费高清观看| 黄色视频在线播放观看不卡| 青春草国产在线视频| 99热这里只有精品一区| 精品视频人人做人人爽| 黄色配什么色好看| 欧美区成人在线视频| 人妻夜夜爽99麻豆av| 一区在线观看完整版| 亚洲自偷自拍三级| 久久综合国产亚洲精品| 欧美成人一区二区免费高清观看| 亚洲欧美一区二区三区国产| 亚洲人成网站在线播| 大又大粗又爽又黄少妇毛片口| kizo精华| 欧美最新免费一区二区三区| 天堂中文最新版在线下载| 国产精品无大码| www.色视频.com| 舔av片在线| 最近手机中文字幕大全| 男人狂女人下面高潮的视频| 老女人水多毛片| 国产精品不卡视频一区二区| 国产男女超爽视频在线观看| 午夜福利高清视频| 看非洲黑人一级黄片| 亚洲自偷自拍三级| 女人十人毛片免费观看3o分钟| 亚洲国产精品成人久久小说| 欧美3d第一页| 内地一区二区视频在线| 另类亚洲欧美激情| 成人亚洲欧美一区二区av| 日韩人妻高清精品专区| 国产欧美另类精品又又久久亚洲欧美| 国产精品爽爽va在线观看网站| 亚洲精品久久午夜乱码| videossex国产| 啦啦啦啦在线视频资源| 国产日韩欧美在线精品| 99久久精品一区二区三区| 亚洲中文av在线| 久久久久久九九精品二区国产| 男女下面进入的视频免费午夜| 一级片'在线观看视频| 高清不卡的av网站| 亚洲精品成人av观看孕妇| 亚洲av成人精品一区久久| 国产成人freesex在线| 亚洲av国产av综合av卡| 丰满人妻一区二区三区视频av| 舔av片在线| 国产 精品1| 中文字幕久久专区| 欧美最新免费一区二区三区| 只有这里有精品99| av又黄又爽大尺度在线免费看| 91精品国产国语对白视频| av在线老鸭窝| 99视频精品全部免费 在线| 亚洲欧美精品专区久久| 欧美另类一区| 国产 精品1| 精品久久久噜噜| 国产黄片美女视频| 黄片无遮挡物在线观看| 夫妻午夜视频| 国语对白做爰xxxⅹ性视频网站| 三级国产精品片| 人妻 亚洲 视频| 制服丝袜香蕉在线| 国产一区二区在线观看日韩| 欧美日韩视频高清一区二区三区二| 久久国内精品自在自线图片| 韩国高清视频一区二区三区| 成年女人在线观看亚洲视频| 九九在线视频观看精品| 少妇丰满av| 黄色怎么调成土黄色| 99热全是精品| 少妇精品久久久久久久| 亚洲最大成人中文| 这个男人来自地球电影免费观看 | 一级毛片黄色毛片免费观看视频| 国产精品成人在线| 国产亚洲欧美精品永久| videossex国产| 久久久久久人妻| 欧美区成人在线视频| www.色视频.com| 久久国产亚洲av麻豆专区| 国产精品国产三级国产专区5o| 午夜免费观看性视频| 久久人妻熟女aⅴ| 菩萨蛮人人尽说江南好唐韦庄| 欧美zozozo另类| 中文字幕免费在线视频6| 人人妻人人爽人人添夜夜欢视频 | 亚洲国产精品国产精品| 少妇高潮的动态图| 精品久久久久久久久亚洲| 国产综合精华液| 久久精品国产亚洲网站| 国产伦在线观看视频一区| 一区二区三区精品91| 国产精品一区二区在线不卡| 亚洲欧美一区二区三区国产| 男女无遮挡免费网站观看| 边亲边吃奶的免费视频| 大片电影免费在线观看免费| 亚洲欧美清纯卡通| 一个人免费看片子| 波野结衣二区三区在线| 草草在线视频免费看| 在线观看美女被高潮喷水网站| 国产无遮挡羞羞视频在线观看| 欧美人与善性xxx| 亚洲欧美精品专区久久| 久久人人爽av亚洲精品天堂 | 男人舔奶头视频| 精品久久久久久久久av| 99热全是精品| 91精品一卡2卡3卡4卡| 国产一区二区三区av在线| 我要看日韩黄色一级片| 超碰97精品在线观看| 不卡视频在线观看欧美| 国产黄频视频在线观看| 亚洲精品久久午夜乱码| 如何舔出高潮| 亚洲av二区三区四区| 少妇人妻久久综合中文| 一级毛片我不卡| 国产亚洲av片在线观看秒播厂| 夜夜看夜夜爽夜夜摸| 欧美精品国产亚洲| 精品一区二区三区视频在线| 成人美女网站在线观看视频| 22中文网久久字幕| 亚洲精品乱久久久久久| av不卡在线播放| 久久国产精品男人的天堂亚洲 | 永久网站在线| 日本vs欧美在线观看视频 | 一本一本综合久久| 日本欧美视频一区| 制服丝袜香蕉在线| 精品久久久久久久久av| 亚洲欧美日韩另类电影网站 | 亚洲av欧美aⅴ国产| 激情五月婷婷亚洲| 女性被躁到高潮视频| 内地一区二区视频在线| .国产精品久久| 国产精品国产三级国产av玫瑰| 最近手机中文字幕大全| 成人一区二区视频在线观看| 边亲边吃奶的免费视频| 夫妻午夜视频| 国产美女午夜福利| 小蜜桃在线观看免费完整版高清| 欧美亚洲 丝袜 人妻 在线| 欧美日韩视频高清一区二区三区二| 干丝袜人妻中文字幕| 国产精品人妻久久久久久| 欧美精品一区二区大全| 色哟哟·www| 99热这里只有是精品在线观看| 18+在线观看网站| av在线观看视频网站免费| 在线观看美女被高潮喷水网站| 99热这里只有精品一区| 肉色欧美久久久久久久蜜桃| 国产国拍精品亚洲av在线观看| 韩国av在线不卡| 高清视频免费观看一区二区| 亚洲欧洲国产日韩| 国产成人免费无遮挡视频| 涩涩av久久男人的天堂| 日韩欧美 国产精品| 男女边吃奶边做爰视频| 国产v大片淫在线免费观看| .国产精品久久| 一级片'在线观看视频| 麻豆乱淫一区二区| 久久久久久久久久久免费av| 视频区图区小说| 能在线免费看毛片的网站| 久热这里只有精品99| 一区二区三区精品91| 亚洲aⅴ乱码一区二区在线播放| 免费黄网站久久成人精品| 久久鲁丝午夜福利片| 少妇人妻久久综合中文| 精品久久久久久久末码| 久久精品国产鲁丝片午夜精品| 日本免费在线观看一区| 亚洲精品乱久久久久久| 在线免费观看不下载黄p国产| 人人妻人人看人人澡| 黄片wwwwww| 一区二区三区乱码不卡18| 国产淫语在线视频| 国产精品一区二区性色av| 噜噜噜噜噜久久久久久91| 91精品国产九色| 亚洲性久久影院| 欧美变态另类bdsm刘玥| 亚洲美女黄色视频免费看| 啦啦啦视频在线资源免费观看| 国产色爽女视频免费观看| 亚洲第一区二区三区不卡| 成人18禁高潮啪啪吃奶动态图 | av在线老鸭窝| 男人舔奶头视频| av卡一久久| 黄色欧美视频在线观看| 汤姆久久久久久久影院中文字幕| 一区二区三区四区激情视频| 中文在线观看免费www的网站| 亚洲精品aⅴ在线观看| 午夜免费鲁丝| 亚洲av成人精品一区久久| 欧美亚洲 丝袜 人妻 在线| 午夜福利视频精品| 老女人水多毛片| 婷婷色麻豆天堂久久| 人人妻人人添人人爽欧美一区卜 | h视频一区二区三区| 日本av免费视频播放| 日本一二三区视频观看| av专区在线播放| 最新中文字幕久久久久| 在线免费十八禁| 久久久久国产网址| 久久久久久久久大av| 久久精品夜色国产| 女人久久www免费人成看片| 七月丁香在线播放| 三级国产精品片| 精品国产一区二区三区久久久樱花 | 日韩制服骚丝袜av| 下体分泌物呈黄色| 成人高潮视频无遮挡免费网站| 色吧在线观看| 国产乱来视频区| 亚洲色图av天堂| 一级片'在线观看视频| 国产精品久久久久久久久免| 欧美三级亚洲精品| 色视频在线一区二区三区| 中文在线观看免费www的网站| 男女边摸边吃奶| 亚洲高清免费不卡视频| 国产精品国产av在线观看| 亚洲av.av天堂| 少妇 在线观看| 大陆偷拍与自拍| 日韩强制内射视频| 观看免费一级毛片| 日本色播在线视频| 中文字幕精品免费在线观看视频 | 18+在线观看网站| 成人国产麻豆网| 麻豆乱淫一区二区| 亚洲欧美精品自产自拍| 成人毛片a级毛片在线播放| 一区二区av电影网| 99久国产av精品国产电影| 日韩一区二区视频免费看| 日韩中字成人| 少妇熟女欧美另类| 国产爱豆传媒在线观看| 欧美成人一区二区免费高清观看| 久久毛片免费看一区二区三区| 成人黄色视频免费在线看| 简卡轻食公司| 国产一区二区三区综合在线观看 | 男人舔奶头视频| 综合色丁香网| 亚洲av在线观看美女高潮| 插逼视频在线观看| 午夜激情久久久久久久| 精品久久久精品久久久| 国产91av在线免费观看| 国产伦精品一区二区三区四那| 国产精品99久久久久久久久| 免费看不卡的av| 亚洲经典国产精华液单| 2018国产大陆天天弄谢| 国产久久久一区二区三区| 久久热精品热| 国产亚洲精品久久久com| 久久女婷五月综合色啪小说| 亚洲色图综合在线观看| 欧美老熟妇乱子伦牲交| 啦啦啦在线观看免费高清www| 久久精品国产a三级三级三级| 亚洲精品视频女| av不卡在线播放| 黑丝袜美女国产一区| 亚洲欧美日韩卡通动漫| 蜜桃在线观看..| 久久久久视频综合| 99热这里只有精品一区| 国产午夜精品久久久久久一区二区三区| av女优亚洲男人天堂| av天堂中文字幕网| 国精品久久久久久国模美| 日韩成人伦理影院| 九色成人免费人妻av| 亚洲美女搞黄在线观看| 国产黄频视频在线观看| 狂野欧美白嫩少妇大欣赏| 男女免费视频国产| 亚洲精品国产av成人精品| 三级经典国产精品| 亚洲国产精品一区三区| 在线观看免费视频网站a站| 国产精品国产三级国产av玫瑰| 久久精品国产亚洲av天美| 少妇丰满av| 国产一级毛片在线| 午夜日本视频在线| 热99国产精品久久久久久7| 精品国产露脸久久av麻豆| 卡戴珊不雅视频在线播放| 国产成人一区二区在线| 色哟哟·www| 免费黄频网站在线观看国产| 搡女人真爽免费视频火全软件| 亚洲av综合色区一区| 欧美亚洲 丝袜 人妻 在线| 乱系列少妇在线播放| 欧美精品一区二区大全| 国产午夜精品久久久久久一区二区三区| 97热精品久久久久久| 女人久久www免费人成看片| 日韩成人av中文字幕在线观看| 日韩在线高清观看一区二区三区| 自拍欧美九色日韩亚洲蝌蚪91 | 嘟嘟电影网在线观看| 男女啪啪激烈高潮av片| 亚洲欧美清纯卡通| 99精国产麻豆久久婷婷| av卡一久久| 亚洲中文av在线| 欧美zozozo另类| 九草在线视频观看| 免费观看性生交大片5| 91精品一卡2卡3卡4卡| 一级a做视频免费观看| 又黄又爽又刺激的免费视频.| 日本wwww免费看| 国产精品蜜桃在线观看| av播播在线观看一区| 国产视频内射| 一区二区三区精品91| 青春草国产在线视频| 男人舔奶头视频| 亚洲精品第二区| 日日啪夜夜撸| 秋霞在线观看毛片| 自拍偷自拍亚洲精品老妇| 国产中年淑女户外野战色| 亚洲一区二区三区欧美精品| 亚洲欧美中文字幕日韩二区| 寂寞人妻少妇视频99o| 女性被躁到高潮视频| 国产成人精品久久久久久| 婷婷色综合www| 亚洲国产高清在线一区二区三| 免费观看的影片在线观看| 欧美日韩一区二区视频在线观看视频在线| 大片免费播放器 马上看| 99精国产麻豆久久婷婷| 久久国产亚洲av麻豆专区| 亚洲色图av天堂| 久久影院123| 99热这里只有是精品50| 少妇丰满av| 在线免费观看不下载黄p国产| 大陆偷拍与自拍| 久久6这里有精品| 久久鲁丝午夜福利片| 国产黄片视频在线免费观看| 一个人看视频在线观看www免费| 嫩草影院新地址| 国产一区二区三区综合在线观看 | 亚洲精品国产成人久久av| 另类亚洲欧美激情| 国产精品精品国产色婷婷| 欧美激情国产日韩精品一区| 91在线精品国自产拍蜜月| 亚洲色图av天堂| 午夜福利影视在线免费观看| 国产精品一区二区性色av| 久久久久网色| 亚洲精品亚洲一区二区| 国产精品一二三区在线看| 一区在线观看完整版| 午夜精品国产一区二区电影| 亚洲国产av新网站| 国产成人精品一,二区| 亚洲内射少妇av| 久久久精品免费免费高清| 亚洲国产精品一区三区| 看免费成人av毛片| 国产精品久久久久久av不卡| 人体艺术视频欧美日本| 久久久久精品性色| 这个男人来自地球电影免费观看 | 九九爱精品视频在线观看| 亚洲伊人久久精品综合| 久久久a久久爽久久v久久|