Development and psychometric assessment of the public healthemergency risk perception scale:Under the outbreak of COVID-19

Zhiying Shen ,Zhuqing Zhong ,Jianfei Xie ,Siqing Ding ,Shougen Li ,Chengyuan Li

a Department of Hematology,the Third Xiangya Hospital,Central South University,Changsha,Hunan,China

b Clinical Nursing Safety Management Reasearch Center of Central South University,the Third Xiangya Hospital,Central South University,Changsha,Hunan,China

c Department of Emergency and Critical Care Medicine,the Third Xiangya Hospital,Central South University,Changsha,Hunan,China

Keywords:COVID-19 Emergencies Pandemics Public health Risk perception Surveys and questionnaires

ABSTRACT Objective:Correctly understanding and evaluating the level of public risk perception toward public health emergencies not only helps experts and decision-makers understand the public’s preventative health behaviors to these emergencies but also enhances their risk information communication with the public.The aim of this study was to develop a risk perception scale for public health emergencies and test its validity and reliability during the coronavirus disease 2019 (COVID-19) pandemic.Methods:Guided by the theoretical model of risk perception,an initial scale was generated through literature review,group meetings,resident interviews,and expert consultation.A pretest and item screening were then conducted to develop a formal risk perception scale for public health emergencies.Finally,the reliability and validity of the scale were validated through a questionnaire survey of 504 Chinese adults.Results:The final scale had 9 items.The content validity index of the scale was 0.968,and the content validity index of individual items ranged from 0.83 to 1.00.Three common factors,dread risk perception,severe risk perception,and unknown risk perception,were extracted for exploratory factor analysis,and together they explained 66.26%of the variance in the score.Confirmatory factor analysis showed that the model had a satisfactory fit,where χ2/df=1.384,the goodness-of-fit index (GFI)=0.989,root mean square error of approximation (RMSEA)=0.028,root mean square residual (RMR)=0.018,comparative fit index (CFI)=0.995,normed fit index (NFI)=0.982,and non-normed fit index (NNFI)=0.990.The correlations between dimensions ranged from 0.306 to 0.483 (P < 0.01).Cronbach’s α was 0.793 for the total scale and ranged between 0.687 and 0.801 for the individual dimensions.The split-half coefficient was 0.861 for the total scale and ranged from 0.727 to 0.856 for induvial dimensions.The test-retest coefficient was 0.846 for the total scale and ranged from 0.843 to 0.868 for induvial dimensions.Conclusion:The developed scale for the risk perception of public health emergencies showed acceptable levels of reliability and validity,suggesting that it is suitable for evaluating residents’ risk perception of public health emergencies.

What is known?

·Risk perception was correlated significantly with the public’s adoption of protective action recommendations,and it was also identified as an important mediating factor between government intervention and the publics behaviors during public health emergencies.

What is new?

·The Public Health Emergency Risk Perception Scale (PHERPS)constructed in this study has 9 items and has good reliability and validity.It evaluates the public’s risk perception level in response to public health emergencies in the three dimensions of dread risk perception,severe risk perception,and unknown risk perception.

1.Introduction

At the end of 2019,an outbreak of the coronavirus disease 2019(COVID-19) caused by the novel coronavirus SARS-CoV-2 was reported in Wuhan,Hubei Province,China,and over 200 countries are facing the challenge against COVID-19 [1,2].It is one of the emerging infectious diseases in recent years,which pose a serious threat to human health,cause huge economic losses and cause panic.As of 8 November 2020,over 49 million people have been infected,and over 1 million have died from COVID-19 worldwidely[3].In fact,several detrimental infectious diseases have been emerging consecutively globally these years,such as COVID-19,H1N1 and Ebola virus disease,which have caused great harm to human health and slowed economic development in some countries [4-6].On 30 January 2020,the World Health Organization declared the COVID-19 outbreak a “public health emergency of international concern”.As the epidemic has spread,so has the fear.In the face of public health emergencies,both individuals and organizations may act irrationally[7,8].By now,most people around the world have been aware of the absolute necessity of maintaining hand hygiene and keeping an appropriate distance away from each other so as to prevent being infected from COVID-19 [9].Simultaneously,most governments have taken strong measures to prevent the further spread of the epidemic,though some people have low acceptance of vaccinations,medical isolation,and wearing masks[10].These obstacles not only caused great public panic but also compromised the effectiveness of crucial measures governments have taken to contain the outbreaks of diseases[11-13].Individuals act discrepantly in response to this epidemic indicates that the risk perception relating to COVID-19 strongly differs between different places and individuals.In addition,public risk perception can potentially be a powerful modifier of the epidemic evolution,as it can influence the number of newly infected cases [9].To identify the behavior and response pattern of people in a crisis or pandemic,we should start by understanding how people perceive the crisis[14,15].Therefore,appropriate tools are needed to assess people’s risk perception in the face of public health emergencies,which is of great significance for governments or organizations to construct management strategies correctly.

Risk perception refers to an individual’s feeling and understanding of objective risks in the outside world.This concept emphasizes the influence on cognition caused by the experience gained from the individual’s intuitive judgment and subjective feelings [16].The assessment of risk perception is influenced by a considerable number of factors pertaining to an individual or society[17].Previous studies have suggested that risk perception was correlated significantly with the public’s adoption of protective action recommendations,and it was also identified as an important mediating factor between government intervention and the public’s behaviors during public health emergencies [14,18,19].In Duan’s study,risk perception was considered to be a significant mediator between government intervention and public adoption of protective measures [20].Liao et al.’s longitudinal survey of Hong Kong residents during the H7N9 outbreak showed that perceived personal infection risks and health effects were associated with protective behavior[21].In addition,some studies have shown that risk perception plays an important role in affecting mental health during public health crises.In Yue et al.’s study of 308 Chinese pregnant women during COVID-19,perception of risk was a mediating factor between social support and anxiety [22].The results of Ding et al.and Zhong et al.also showed that risk perception was related to depression [23,24].Based on these studies,during the outbreak of public health emergencies,a timely understanding of the public’s risk perception might guide the formulation and implementation of epidemic control measures.Therefore,when an unexpected public incident occurs,it is necessary to assess the public’s risk perception and analyze its associated factors timely and accurately.It can provide evidence geared to implement targeted risk management strategies.Therefore,the negative impact of the public health incident and a public sentiment disturbance might be avoided.At present,there are no tools to evaluate the risk perception of public health emergencies worldwide.

Many scholars have investigated the risk perception of severe public health emergencies such as COVID-19 [25-27],H1N1[28-30],and Ebola [31].These studies all use different risk perception assessment tools,but reviews have pointed out these tools’following defects.For example,the COVID-19 Risk Perception Scale including 6 items was developed mainly aiming to evaluate participants’ perceived seriousness of the COVID-19,perceived likelihood that they or their family and friends would be infected with the virus in the next 6 months,and their present level of worry about the virus [19].However,its development process was based on previous research experience rather than relevant scientific theories.Zanin et al.designed and applied the Public Risk Perception questionnaire to investigate Ttalians’perception of health risks during COVID-19 [8].However,the definition of risk perception in this study was not clear,and the reliability and validity of the questionnaire were not reported.In the study of Taghrir et al.only two items “I may be affected with COVID-19 more easily than others”and“I am afraid to be affected with COVID-19”were used to measure the risk perception level of subjects,which was obviously not comprehensive[32].In addition,the risk perception measurement tools designed by Chan et al.and Olagoke et al.also lack the report on results of tool psychology measurement [12,33].

In Slovic’s view,the research of risk perception can be realized by using the psychometric paradigm [34,35].Risk perception assessment that uses simple,effective scientific tools to assess public health emergencies’risk perception can provide guidance in taking effective measures to maintain and enhance public health and safety.Therefore,this study aims to develop a public health emergency risk perception scale (PHERPS) and validate its reliability and validity under the COVID-19 epidemic as an example and provide a reference for the effective assessment of the public’s risk perception of public health emergencies.

2.Methods

2.1.Theoretical framework

This study was guided by a theoretical model of risk perception on the basis of Slovic’s research that revealed multidimensional characteristics of risk perception [34,35].This theoretical model describes risk perception characteristics in the form of a spatial model with two dimensions (unknown and dread dimensions)(Fig.1).In the model,the degree of risk perception of an emergency is determined by the spatial location of the emergency.The dimensions used to evaluate a risk can be set according to the characteristics of the risk,through which people’s attitude toward and perception of the risk are quantified to form a risk cognitive map.The horizontal axis represents the fear risk dimension,which refers to the degree of fear caused by the public health emergency,and the far right side is defined as uncontrollable,dread,global catastrophic,lethal,high risk to future generations,not easily reduced and risk increasing.The ordinate represents the unknown risk dimension,which refers to the extent to which the public knows about the public health emergency.The top of it is defined as unobservable,unknown,effect delayed,new and unknown to science.Based on the risk perception model,this study proposed to evaluate the public risk perception of public health emergencies from multiple aspects,including the unknown risk dimension and dread risk dimension.

Fig.1.Theoretical multidimensional model of risk perception.

2.2.Phases of development

A first draft of the scale (32 items) was developed through literature review,research group discussion,and resident interviews.Afterward,the first drafted item pool was evaluated in an expert panel meeting,applied in a pretest performed to 10 residents,and the comments were recorded to delete or modify items.After the expert panel meeting and pre-test,10 items were deleted or merged because of similar meanings.In addition,6 items were removed according to comments and grades of a two-round expert consultation.Therefore,a primary risk perception scale with 16 items was reached.Then,the 16-item primary scale was used to run a preliminary study with 198 adult Chinese and 7 unqualified items were deleted according to the requirement of item screening.Finally,a formal survey was conducted using a scale that retained 9 items,and the reliability and validity were analyzed.

2.3.Development of a first item pool

Under the guidance of the theoretical risk perception model,the following approaches were used to establish the item pool.1)Literature review:Previous studies on risk events,including the Wenchuan earthquake[36]and SARS[37],the African swine fever virus[38],and H1N1[29]were used as references.2)Research group discussion:Two rounds of research group discussion were held to investigate the consistency of the items in the item pool with the theoretical framework and the logic of each item’s wording and to discuss item deletion and addition.3)Resident interviews:10 residents were invited to participate in the interview to discuss their self feelings or experience of the epidemic.The interviews were conducted face-to-face in a quiet,private room,and the concerns and opinions of the interviewees were recorded.The duration of each interview was 40-60 min.Finally,an item pool containing 32 items was constructed through the above methods.

2.4.Primary risk perception scale development

Methods for the development of the initial risk perception scale were as follows.1) Expert panel meetings:An expert group meetings were held,relevant experts specialized in psychology,public health and epidemiological research to review the clarity of drafted items,as well as the relevance and suitability of each item.2)Pretest:after items were modified according to the suggestions in expert consultation,the revised drafted scale was imposed on the interviews performed with 10 community residents.The doubts and advice put forward by interviewed residents on each item of the revised drafted scale were considered,according to which complicated items with specialized words that were hard to understand by residents were modified.3) Two-round expert consultation:six experts were invited to evaluate the structure and items of the scale and give suggestions for adding,deleting,and modifying items according to their understanding of the evaluation indicators.The expert team included three males and three females aged between 35 and 54 years who had more than 10-year’s experience working in the fields of public health,psychology and Epidemiology.All experts had a master’s degree or above and had a professional title of associate professor or above.According to the Likert 5-point scoring system,the experts graded the importance of each item,with scores 1 to 5 indicating extremely important,important,somewhat important,unimportant,and very unimportant,respectively.In addition,the experts were encouraged to present their opinions on the items and state their reasons.Two reiterations of feedback and discussion among the experts generated the revised version.The content validity indices of items (ICVI) and the scale (S-CVI) were calculated.After the random consistency was adjusted using the kappa value(k)and the items with I-CVI<0.78 were removed [39].

2.5.Pilot survey

Since people were restricted from going out during the COVID-19 pandemic,a “Questionnaire Star” (Wenjuanxing) online survey was conducted in this study.In March 2020,210 residents of Changsha,Hunan,China,were surveyed.To ensure that the constructed scale could be generalized,there were no special participant requirements,and all residents aged 18 years or older could voluntarily fill out the questionnaire.In order to ensure the validity of the data,three data screening methods were adopted after the questionnaire collection.1) If questionnaires were submitted via the same IP address,only the first submitted questionnaire will be retained.2) Questionnaires with a response time less than 3 min will be deleted.3) Questionnaires with answers that contained common sense errors,such as“one year of age,”were deleted.The screening was carried out by two researchers with a master’s degree,and in the case of disagreement,the decision was made by an associate professor of psychology.Finally,198 effective questionnaires were obtained,with an effective response rate of 94.29%.The items were screened according to the following criteria.1)Extreme-value comparison analysis:the collected questionnaires with the total score in the top 27% and the bottom 27% were grouped as the high-score group and the low-score group,respectively.Then,the score of each item in the scale was compared between the two groups by using the independent-sample t-test,and the items with no statistically significant difference (P > 0.05)were removed.2) Correlation coefficient method:the Pearson’s correlation coefficient between each item score and the total score was analyzed,and the items with a Pearson’s correlation coefficient r < 0.3 were removed.3) The items that significantly reduced Cronbach’s α coefficient were removed.4) The items with a factor loading coefficient <0.4 and commonality (common factor variance) < 0.4 were removed.After the procedures above,a formal version of the scale resulted.The scale contained 9 items and was scored according to the Likert 5-point scoring system,with 1-5 representing strongly disapprove,disapprove,neutral,approve,and strongly approve,respectively.The total score could be 9 to 45 points.The higher the score,the higher the risk perception level of public health emergencies.

2.6.Formal investigation

2.6.1.Participants

Using a convenience sampling method,the survey questionnaire was delivered to the residents aged ≥18 years old in Hunan on the“Questionnaire Star”platform in April 2020.The research group invited mobile phone users in Hunan Province to fill in the questionnaire through online recruitment by sending a QR code or link of the questionnaire.A total of 550 questionnaires were collected from voluntary participants,and 504 effective questionnaires were obtained after screening,with an effective response rate of 91.6%.The average age of the respondents was 34.46 years (SD=9.58).There were 264 males and 240 females,including 130 unmarrieds,358 married,and 16 divorced or widowed(Table 1).The study was approved by the ethics committee of the Third Xiangya Hospital of Central South University (No.2020-S028).

2.6.2.Validity test

Content validity and construct validity were tested.Content validity was evaluated by calculating the I-CVI and the S-CVI [40].The calculations have been figured out according to the feedbacks of the second iteration expert consultation.I-CVI≥0.78 indicates good item-level content validity,and S-CVI≥0.90 means a good scale-level content validity[41].For construct validity,exploratory factor analysis(EFA)was used to explore the structure of the scale first,and then confirmatory factor analysis(CFA)was conducted by using a structural equation model.Out of the 504 collected questionnaires,we used 252 questionnaires to explore the factor structure of this scale,and the rest 252 responses were used to confirm factor structure with fit indices.The items remaining after item analysis were subjected to EFA through principal component analysis and a varimax rotation,and the factors with an eigenvalue>1 were extracted as common factors [42].Maximum-likelihood estimation was used for CFA.The overall fitting performance of the model was evaluated using χ2/df,goodness-of-fit index (GFI),root mean square error of approximation (RMSEA),root mean square residual(RMR),comparative fit index(CFI),normed fit index(NFI),and non-normed fit index (NNFI) [43].

2.6.3.Reliability test

The Cronbach’s α coefficient,split-half reliability coefficient and test-retest reliability coefficient of the overall scale and of each domain were calculated.The value of Cronbach’s α ≥0.60 was considered acceptable,and ≥0.70 was considered good internalreliability [44,45].Spearman-Brown split-half reliability was also measured.A correlation coefficient ≥0.70 indicates good internal reliability [46].The test-retest reliability was measured by Pearson’s correlation coefficient between two time-points with a gap of 2 weeks in 40 randomly collected residents.The value of correlation coefficient over time ≥0.75 was considered good test-retest reliability [47].

Table 1 Participant characteristics (n=504).

3.Results

3.1.Item analysis

When we analyzed the 16 items of the primary scale,no item was removed through extreme-value comparison analysis,but 4 items were removed based on correlation coefficients:“The pandemic has rapidly affected the society.” “Adhering to correct protective measures can prevent infection.” “The pandemic is invincible.” and “The pandemic will show a downward trend.”Three items with commonality<0.40 or factor loading<0.40 were removed:“The pandemic can be controlled.” “The pandemic will cause other social hazards.”and“The pandemic poses a high risk to our future generations.” The remaining 9 items did not reduce Cronbach’s α coefficient and thus were retained for reliability and validity evaluation.The results of the item analysis are shown in Table 2.

3.2.Validity analysis

3.2.1.Content validity

According to the evaluation by the six experts,the proposed risk perception scale for public health emergencies had an S-CVI of 0.97 and I-CVIs between 0.83 and 1.0.The k values of all items were higher than 0.74,suggesting that all the items were excellent and none of them should be removed.

3.2.2.Exploratory factor analysis

Totally 252 collected questionnaires were randomly extracted from total questionnaires of 504 to conduct the EFA for the scale.After four iterations,the rotation converged; the Kaiser-Meyer-Olkin (KMO) value was 0.747 and the χ2value from Bartlett’s spherical test was 1390.014,reaching the significance level of P < 0.001.This indicated that the proposed scale was suitable for draw factors [48].

The results of EFA demonstrated that three components with eigenvalues>1.00 were identified.According to the risk perception theory,risk perception features are expressed as two-dimensional factors,which are unknown dimension and dread dimension,respectively.On a theoretical basis,item 1,“The pandemic is highly contagious.”,item 2,“The pandemic is widespread.”,item 3,“The health damage caused by the pandemic is fatal.” should belong to the dread risk dimension.However,in the EFA,these three items were assigned to an independent factor.After a panel discussion,we have agreed that these three items represent the level of severity at which a pandemic can have consequences.Therefore,we named this factor“severity risk perception.”The factor loading coefficients of all items were between 0.436 and 0.875 (all >0.4),and the cumulative variance explanation percentage was 66.26%.The factor names and loading levels are given in Table 3.

3.2.3.Confirmatory factor analysis

The results showed that the standardized factor loading coefficients of all items were in the range from 0.533 to 0.828,so all were >0.400.All fit indices met the criteria (χ2/df=1.384;GFI=0.989; RMSEA=0.028; RMR=0.018; CFI=0.995;NFI=0.982;NNFI=0.990),indicating that the model had a good fit(Table 4).The structure equation modeling was showed in Fig.2.

3.2.4.Internal correlation

The results of correlation analysis showed that the correlations between the dimensions were between 0.306 and 0.483(P <0.001),and the correlations between each dimension and the total scale score were between 0.587 and 0.832 (P < 0.001)(Table 5).

3.3.Reliability analysis

For all three dimensions (dread risk perception,severe risk perception,and unknown risk perception) and the total scale,the Cronbach’s α coefficient was 0.801,0.687,0.697,and 0.793,respectively,and the split-half coefficient was 0.865,0.727,0.777,and 0.861,respectively.The test-retest Pearson’s correlation coefficient was 0.868,0.855,0.843,and 0.846,respectively.

4.Discussion

The study has developed a self-reporting scale,the PHERPS,which is also aimed at exploring its psychometric properties in Chinese adults.The quality of items is crucial to the reliability and validity of a scale.In this study,the item pool was established from theoretical research regarding the dimensions of risk perception.By reviewing relevant literature and using research tools reported in China and other countries as references,the item pool was initially chosen through group meetings and interviews with community residents.Next,six experts were invited to analyze and evaluate the indices and items at all levels,and the items were revised according to the experts’ suggestions.Finally,the performance of each item in the scale was analyzed based on the test data from 504 questionnaires to yield a formal 9-item scale.

According to the theory on the dimensions of risk perception,the public’s dread risk perception of a public health emergency event isrelated to various factors,including whether the event is control-lable,the severity of the event,how wide it spreads,how fatal it is,whether it is persistent,how fast the risk can be reduced,and whether there is risk accumulation [34,35].Unknown risk perception is analyzed from the aspects of whether the virus can be detected,whether it is a known disease,whether its impact is rapid,whether it is known in scientific research,and whether it is familiarto the public [34,35].Accordingly,the items corresponding to that information,including “The pandemic has rapidly affected the society.” “Adhering to correct protective measures can prevent infection.” “The pandemic is invincible.” “The pandemic can be controlled.” “The pandemic will cause other social hazards.” “The pandemic poses a high risk to our future generations.” and “The pandemic will show a downward trend.”were included in the item pool in this study.However,these items did not meet the statistical requirements in the item analysis and were removed from the scale.The reason for this shortcoming may be that the public believes that the epidemic has a downward trend and will eventually pass thanks to the rapid and strict prevention and control actions of the government and social organizations in response to COVID-19 and the public’s experience from similar incidents that have occurred frequently in recent years.Therefore,the abovementioned aspects make a limited contribution to risk perception.

Table 2 Results of item analysis of the PHERPS(n=198).

Table 3 Exploratory factor analysis of the PHERPS (n=252).

Table 4 Fit indices of the PHERPS.

Fig.2.Structure equation modeling of three-domain with 9 items.

Table 5 Correlations among domains and the overall scale of the PHERPS.

Instead,the public paid more attention to the high contagiousness of the disease,how wide it spreads,how fatal it is,and fear that oneself or relatives/friends will be infected by the virus.The novel coronavirus that causes COVID-19 is a new viral strain that humans had never been exposed to and has multiple transmission routes that are not yet fully understood.Humans are generally susceptible to this disease,which is difficult to detect at the initial stage,and asymptomatic patients may also become infection sources [15].Therefore,the high-unknowingness nature of the epidemic is also an important contributor to the public perception of risk.

The validity of the proposed risk perception scale for public health emergencies was evaluated mainly from two aspects,content validity and construct validity.In the content validity analysis,the I-cvis,the k values,and the S-CVI all met the statistical criteria,indicating that the scale had good content validity[42].In the EFA of the present study,the factor loadings of all 9 items were >0.4,and the three common extracted factors were consistent with the theoretical concept [43].“Dread risk perception” is determined using the degree of fear that oneself or relatives/friends will be infected and the overall degree of fear.“Severe risk perception”can be evaluated from the perspectives of the contagiousness of the disease,how wide it spreads,and how fatal it is.“Unknown risk perception” can be evaluated from the perspectives of humans’understanding of the epidemic in modern medicine,as well as whether the infection can be predicted and accurately detected.In the CFA,the validated factor model was basically in accordance with the assumed dimensions of public health emergency risk perception,and the fit indices of the model met the assessment standards,suggesting that the risk perception scale constructed in this study is in line with the theory[43].Results demonstrated that good content and face validity of this newly developed PHERPS was satisfactory,indicating that the items of this scale were applicable to its domains as well as to its whole scale,and consensus of experts on items was reached.

In this study,the reliability of the PHERPS and each domain was evaluated by Cronbach’s α coefficient,split-half reliability coefficient,and test-retest reliability coefficient.The split-half reliability and retest reliability all reached a good standard[43].However,the Cronbach’s α coefficient of two dimensions,unknown risk perception,and severe risk perception,failed to meet the good standard,meeting only the acceptable standard[44,45].It might be attributed to the small number of items contained in the two dimensions,so the internal consistency of the two dimensions was compromised.Besides,it may also relate to the limited sample size of the survey.Therefore,although the value is acceptable,further study on this scale is necessary in order to re-confirm the internal consistency of the scale.

Limitations:Our study has some limitations.Due to the strict epidemic management measures,the offline investigation was not feasible,so this study could only adopt online investigation.Depending on the sampling method,the information collected may not be more accurate than offline surveys.In addition,China was the first country to report COVID-19,so Chinese people likely had experienced higher levels of risk perception than other countries’.The test population of this scale is also limited to Chinese adults.Therefore,the generalizability of the scale needs to further verify in other countries or regions.

5.Conclusions

The PHERPS constructed in this study has 9 items.It evaluates the public’s risk perception level in response to public health emergencies in the three dimensions of dread risk perception,severe risk perception,and unknown risk perception.The scale conforms to the theory of risk perception and has good reliability and validity.It contains only a few items and is easy to complete.The proposed scale can serve as an effective tool for evaluating public risk perception in response to COVID-19 and future public health emergency events.It also provides a basis for governments and organizations to observe public opinion,stabilize public sentiment,and implement effective risk management and control measures.

Funding

This research received no external funding.

CRediT authorship contribution statement

Zhiying Shen:Methodology,Writing -original draft.Zhuqing Zhong:Conceptualization,Writing -review &editing.Jianfei Xie:Methodology,Data curation.Siqing Ding:Supervision.Shougen Li:Software,Validation.Chengyuan Li:Methodology,Writing -review&editing.

Declaration of competing interest

The authors declare no conflict of interest.

Acknowledgements

The authors would like to acknowledge all participants in the study for their support.

Appendix A.Supplementary data

Supplementary data to this article can be found online at https://doi.org/10.1016/j.ijnss.2020.12.012.