Ontology Driven Testing Strategies for IoT Applications

Muhammad Raza Naqvi,Muhammad Waseem Iqbal,Muhammad Usman Ashraf,Shafiq Ahmad,Ahmed T.Soliman,Shahzada Khurram,Muhammad Shafiqand Jin-Ghoo Choi

1INP-ENIT,University of Toulouse,Tarbes,65000,France

2Department of Software Engineering,Superior University,Lahore,54000,Pakistan

3University of Management and Technology,Sialkot Campus,Pakistan

4Industrial Engineering Department,College of Engineering,King Saud University,P.O.Box 800,Riyadh,11421,Saudi Arabia

5Faculty of Computing,The Islamia University of Bahawalpur,Bahawalpur,63100,Pakistan

6Department of Information and Communication Engineering,Yeungnam University,Gyeongsan,38541,Korea

Abstract: Internet-of-Things (IoT) has attained a major share in embedded software development.The new era of specialized intelligent systems requires adaptation of customized software engineering approaches.Currently, software engineering has merged the development phases with the technologies provided by industrial automation.The improvements are still required in testing phase for the software developed to IoT solutions.This research aims to assist in developing the testing strategies for IoT applications,therein ontology has been adopted as a knowledge representation technique to different software engineering processes.The proposed ontological model renders 101 methodology by using Protégé.After completion,the ontology was evaluated in three-dimensional view by the domain experts of software testing,IoT and ontology engineering.Satisfied results of the research are showed in interest of the specialists regarding proposed ontology development and suggestions for improvements.The Proposed reasoning-based ontological model for development of testing strategies in IoT application contributes to increase the general understanding of tests in addition to assisting for the development of testing strategies for different IoT devices.

Keywords: Ontology; software testing; internet of things; automation

1 Introduction

Internet of Things (IoT) is a concept that allows billions of tiny machines, such as sensors, to be connected to the internet.Software testing is the crucial process of software quality assurance because it represents the final revision of specification, design patterns and code generation [1,2].The main goal of conducting software testing is to reduce the likelihood of errors occurring when the system is in production [3].It is verified through this research that testers face problems and difficulties which refer to the complexity between tests in IoT applications [4].The internet and its things are only limited for mere moments in time, so the test is problematic.Furthermore,one issue analyzers will confront is the manner by which to characterize a test architecture with a related environment that is adequate and exhaustive [5].Likewise, the absence of legitimate information about IoT testing open new research challenges including several quality attributes including interoperability, user-friendly in context of end user satisfaction, and reliability [6].The research problem is the fact that, in addition to the evidence of problems and difficulties mentioned above, the study conducted in this study did not identify patterns, models or rules regarding tests on IoT devices.The IoT applications of the consulted jobs use convenient ways for different products [7].The objective of this work is to assist in the development of testing strategies in IoT applications.Thus, the contribution of this work is to provide help in ontology development of a testing strategy focused on the IoT.To maintain good monitoring and performance in IoT it is necessary to improve the quality of processes and one of the most important steps to maintain them, is the testing phase.Still, software testing is essential to the proper functioning of the IoT.After ontology development, it is evaluated by domain experts of IoT, software testing and ontology engineering.The consistency and coherency of developed ontology checked by using “Pellet Reasoner” which aims to determine the satisfaction.It shows interest for specialists in current research.It also provided the reflection of suggestions for improvements in ontology development as well as future work.

To ensure IoT application quality, this research proposed the ontological modelling technique for test strategies development and consequent execution.The proposed testing methodology has expressed the potentials for domain specific attributes incorporation in the testing process planning.We concluded our study with the proven Potentials of Ontology Driven Information System Development Lifecycle being utilized for IoT Application Testing.Hence, the work adds to build the overall comprehension of Tests in IoT, as well as aiding the Development of Testing Strategies for various IoT gadgets, applications, devices.

The rest of the paper is structured as follows.Section 2 describes summary of the literature review.Section 3, elaborates the problem statement.Section 4 explains ontology engineering.Section 5 defines ontology development.The validation is done in Section 6 while data analysis and discussion are stated in Section 7.Section 8 is about the conclusion of our research and provides horizons towards the future.

2 Literature Review

Ontology development, specifically for the domain of software testing in IoT, still has research gap.However, the description of some ontological based IoT approaches is discussed in this section.

To accomplish consistent software development, researchers like Meng et al.[8], Pinheiro et al.[9], Wang et al.[10], Gyrard, et al.[11], Kim et al.[12], Bali et al.[13], Uskov et al.[14]have shown that certain model families typically have some features which are considered better than others.Bermudez-edo et al.proposed an ontology for the network of semantic sensors that describe the main concepts of IoT data in heterogeneous platforms [15].According to Voas et al.there are three factors for software failure including, a failure is performed, a faulty internal data state is created and the faulty state propagates and so resulting incorrect output [16].These failure factors can be avoided by applying an appropriate testing methodology for the product or application.According to Geiger et al.automated testing frameworks are effective because IoT-enabled devices have the ability to be self-diagnosed.It is important to note that automated testing is a powerful in an IoT application, as it is applicable in all layers [17].Furthermore,in the research by Murad et al.emphasize that there are several types of tests that can be used in IoT.There has been a huge trend to shift data analytics from OLAP to Big Data Architectures [18].

? Usability Testing: It is important to check the usability of system in IoT testing because the perception varies from one user to another.

? Reliability and Scalability Testing: IoT testing can provide reliability and scalability in an environment that involves simulating sensors using virtualization tools and technologies.

? Compatibility Testing: The IoT compatibility testing may provide configurations that can be connected with various devices.

? Security Testing: It is important to control the users’access in IoT environment, by defining the user authentication and data privacy control.

Another study by Bernardino et al.proposed an ontology in performance testing domain.The ontology was represented in the OWL (Web Ontology Language), developed in the editor Protégé and following the methodology of Noy and McGuinness, being directed to assist testers with test planning [19].It was found, through the literature study, that testers faced problems and difficulties which refer to the complexity between tests in IoT applications.The motivation of this research is to help the professionals to carry out their testing activities in the domain of IoT.It also concentrates that testers can adopt testing strategies driven by ontological model.It is necessary to improve the quality of the processes, their steps to maintain good monitoring and performance in IoT.Further, the software testing is essential for the correct functioning of IoT and must be very well modeled and standardized.

The IoT applications of the consulted jobs use convenient ways for different products.The problems are still existing in the development of testing strategies to carry out software testing in IoT.The study carried out in this work did not identify standards, models or rules with regard to tests on IoT applications.Thus, the objective of this work is to assist, through an ontology,in the development of test strategies in IoT for various connecting devices.In addition, the tests can be applied in a more standardized way by defining phases, strategies and context.

3 Ontology Engineering

Ontologies in software testing process deliver the common shared knowledge for understanding of concerned entities and their relationships with a rather simple and easy structure,maintenance and updates [20].This research has exploratory theme and our ontology is a domain type, that developed in semi-formal languages.Ontology development 101 is the well-known ontology engineering methodology.It consists of seven objective and simple steps of building an ontology process [21].Uschold and Gruninger emphasize on the importance of defining the scope of ontology [22].They also provide the list of significant competency questions to define the domain scope of ontology.

These standardized questions also incorporate to enrich our research.

? What is the domain of ontology?

? What is the purpose of building this ontology?

? What kind of questions, ontology should answer?

? Who will use and maintain the ontology?

Tab.1 presents the scope of determination for our ontology and view the answers to previous questions.After defining ontology scope, we consider the method of ontology reuse that aims to identify whether it required or not.In assisting the construction of ontology, two ontologies have been reused.

Table 1: Scope determination

The most important step in ontology construction is terms enumeration, the concepts of terms can be defined in primitive classes and defined classes.Classes serve to describe basic concepts of a domain and represent the broadest concepts in a hierarchy.Next step is defining properties that present the relationships between concepts as attributes.A property must have domain and scope, so properties connect individuals from a domain to individuals of a scope [23].Finally,defining constraints that demonstrate a class of individuals according to the relationships of class members.

4 Ontology Development

For the development of ontology, research was carried out in order to seek strategies and techniques for testing in IoT applications.The construction of the proposed ontology is carried out based on seven stages of methodology 101, justified and conceptualized in the previous topics.Ontology is represented in English to increase its scope and follow the pattern adopted in reuse ontologies.For the development, the Protégé tool was used and it is an open-source free software with tools to build models and applications based on the areas of knowledge using ontologies.

4.1 Ontology Reuse Consideration

Fig.1 presents proposed ontology by reusing two ontologies (Onto test and software test ontology).

Figure 1: Structure of the 1st reuse ontology

Figure 2: Structure of the 2nd reuse ontology

Figure 3: Main classes

4.2 List Classes(Concepts)

The terms of the ontologies start their construction, remembering that the terms presented below and defined from the reuse ontologies.In the following Fig.3 it is possible to see the terms defined in the Protégé and Fig.4 defining the test context class.

Figure 4: Text context class visualization

In Tab.2, the definition of each class has been defined.

Table 2: Definition of concepts of ontology terms

(Continued)

Table 2: Continued

4.3 Terms and Set Classes/Subclasses Enumeration

For each created term, their respective classes were defined according to the IoT testing techniques and strategies.In this Fig.5 the body of the ontology is created where the test actions are defined.

Figure 5: Ontology structure (classes & subclasses)

4.4 Properties Setting and Instances Creation

Fig.6 presents the properties and individuals defined in Protégé.In the case of this ontology,the object property type was constructed.Consequently, in each of the properties, individuals from a domain connected to individuals of a scope.

Figure 6: Ontology object properties & ontology instances

Being an instance, the realization of a class, were then defined in each class of the proposed ontology.For example, the TestActivity class aims to represent a test activity, with the result that test cases (TestCases), test plans (TestPlan), test planning (TestPlanning) and test reports(TestReport) must be generated to represent the instances.

4.5 Define Properties

In the Tab.3, it is possible to view the properties defined in Protégé, as well as the definition of each one.In the case of this ontology, the object property type was built.

Table 3: Properties definitions

(Continued)

Table 3: Continued

4.6 Ontology Restrictions

It is necessary to define their respective restrictions whereas the object properties describe the relationships between individuals.This is done through a class of individuals created by the relationships in which they are supposed to participate.

For centuries my mother s family, the Van der Veldes, had owned a highly successful tulip business, which provided jobs for many in our village of Ridderkerk. Their bulbs were popular throughout Europe and abroad, and the family name was known far and wide. But the war shut their business down, and during the winter of hunger, my grandfather, Arnoldus, donated all his tulip bulbs to feed the hungriest villagers.

The restrictions covered here are of the “Quantifier Restriction” type, with two available quantifiers being: i) the existential quantifier (some) (?), which define classes of individuals who participate in one relationship (at least) through a specific feature with member individuals of a certain class, ii) the universal quantifier (only) (?), which define classes of individuals for a particular property, only have relationships by that property member individuals of that class.The definition of restrictions can made in three parts:

? The quantifier, which can be an “some” existential quantifier (?) or a universal “only” (?).

? A property, on which the constraint acts.

? A complement to the constraint (filler), which correspond to name class whose individuals meet the constraint.

We have shown the constraints between classes in Fig.7.For example, the constraint property on the TestActivity class: hasArtifact; the type of constraint: “some” (existential constraint); the mandatory complement of the restriction (Filler).

Figure 7: Visualizes the constraints between the classes

The TestArtifact class; then there is hasArtifact property has some (TestArtifact) The informed constraint is specifying that the test activity (TestActivity) has at least one test artifact or deliverable TestArtifact, through the teamArtifact includes hasArtifact property.

Another example, the constraint property on the TestActivity class: hasGoal; the type of restriction: “only” (universal restriction); the mandatory complement of the restriction (Filler).

The TestGoal class; Then there is: hasGoal only (TestGoal).The informed constraint is specifying that a test activity (TestActivity) has only one objective TestGoal through the object property hasGoal.

5 Validation

Protégé provides third-party Reasoner like HermiT and FaCT++ and others to validate the ontologies [26].Reasoner detects and finds inconsistencies or contradictions of ontologies structure and data based on mathematical models [27].It provides logical deductions based on inference rules defined and specified in description logic and uses forward chaining or backward chaining to perform inference [28].Pellet Reasoner is used to validate our ontology model.Previously researchers and ontology engineers use reasoner to validate their work [29-31].It can be used in unification with Jena and OWL APIs.Fig.8 shows the validation of our ontology.

6 Data Analysis and Discussion

The technique for data analysis of this work was performed to determine the satisfaction of ontology, whether it meets the necessary requirements referring to software testing, IoT and ontology engineering.The proposed ontology was evaluated by specialists from the domain.For data collection, the experts were sent a questionnaire containing 15 questions to cover the aspects of the ontological model with regard to the satisfaction of ontology.These are semi-open questions with alternatives “Satisfies”, “Does not satisfy” and “other Option”, when choosing the last option, the professional will have the opportunity to express themselves reporting questions or suggestions.Along with the questionnaire, the ontology documentation is sent, so that it can be evaluated.15 questions were answered by experts, 8 of them obtained 87% satisfaction.In Tab.4 below aims to demonstrate the opinion of the experts regarding the satisfaction of ontology.

Figure 8: Ontology validation using “Pellet” reasoner

Table 4: Ontology satisfaction

(Continued)

According to the percentage of ontology satisfaction and the comments of the experts mentioned in Tab.4, it can be said that ontology can help in the development of a testing strategy focused on the IoT.The choice of professionals participating in the research was due to the experience in at least 5 years working with IoT.The same criterion of choice was used for software testing and ontology engineering professionals.

7 Conclusion

IoT is a specialized domain of computer applications including embedded systems, communication, cloud, fog, edge services and data stores.These specialized information system architecture,process flow and functionality are engineered and tested in their own way.The study here identified the research gap related to domain specific software engineering and more precisely the testing phase for the IoT applications.

To ensure IoT application quality, this research proposed the ontological modelling technique for test strategies development and consequent execution.The proposed testing methodology has expressed the potentials for domain specific attributes incorporation in the testing process planning.The testing model’s consistency is verified through the reasoning software that can highlight existing anomalies in test plans.The challenging part of the research is formal representation of testing processes and the constraints among them.The identified prerequisite,dependencies, overlapping tasks and synchronous behavior of complete test plan are the examples of the constraints in the studied testing models.Furthermore, the proposed model is reviewed through the domain experts with a high satisfaction rate (87%) observed via conducted survey.The study concluded with the proven potentials of ontology driven information system development lifecycle being used for IoT application testing.Thus, the work contributes to increase the general understanding of tests in IoT, in addition to assisting in the development of testing strategies for different IoT devices.

The presented testing model, can be generalized for any domain specific application testing through domain concept definition and respective knowledgebase linking.The future work in this research directions specific to IoT includes, the variety of tests plan development for individual unit/component and integrated testing with the required span of knowledge sharing in the global software engineering perspectives.In the case of possible studies and future studies in which the research treated in this article can advance we can mention: Measure the cost with testers and the impact of this cost with later support of a project in which the ontology proposal is applied and to one that was not used ontology; Practical application of ontology methods to verify how robust it is to test on IoT equipment and products; Improvement ontology in terms of techniques,strategies and processes.

Acknowledgement:The authors extend their appreciation to King Saud University for funding this work through Researchers Supporting Project number (RSP-2021/387), King Saud University,Riyadh, Saudi Arabia.

Funding Statement:This work was supported by the King Saud University (in Riyadh, Saudi Arabia) through the Researcher Support Project Number (RSP-2021/387).

Conflicts of Interest:The authors declare that they have no conflicts of interest to report regarding the present study.