Probe-it Project

PROBE-IT ( ) was a two years European project aiming at supporting exploitation of European research advances in IoT deployments. It was indeed needed to ensure interoperability and acceptance of validated IoT solutions in a global context to avoid unnecessary competitions and overlaps. For that, PROBE-IT focused on analyzing existing and ongoing worldwide deployments in different perspectives filling the needs of policy makers, deployments drivers, technology providers and users.


Internet of Things (IoT)

Few lines from “Vision and Challenges for Realising the Internet of Things” by Cluster of European Research projects on the Internet of Things:

“Internet of Things” points out a vision of the machines of the future: in the nineteenth century, machines learned to do; in the twentieth century, they learned to think; and in the twenty-first century, they are learning to perceive – they actually sense and respond.

“The Internet of Things has the potential to change the world, just as the Internet did. Maybe even more so.” - Kevin Ashton, 2009

So what is really an Internet of Things ? It is a future vision to connect everything and from everywhere to build a gigantic network of different hardware, different standards, different protocols, different data, etc.

Involvement of IRISA in PROBE-IT

IRISA is a potential partner in PROBE-IT project. It contributes for developing a roadmap for Internet of Things (IoT) testing. In order to achieve this objective, it contributes its network testing expertise by participating in interoperability test events organised for IoT. IRISA is leader for Workpackage 4 of PROBE-IT. Workpackage 4 has following objectives:

  1. Studying worlwide existing test platforms and test beds
  2. Analysing existing solutions for IoT interoperability testing and associated methodologies
  3. Identifying key requirements and needs for IoT testing and validation
  4. Defining roadmap for future research for an efficient testing of IoT

Workpackage 4 : Pre-requirements validation and deployement - explored


Workpackage 4 (WP4) is divided into two major tasks. They are:

  • Task 4.1 : Requirements on architeture and needs for testing

Task 4.1 has the objective to study worlwide existing IoT testing solutions (Test methods, test tools, certifcation programs, test events etc). A thorough analysis on this study will help to identify the key requirements and needs for IoT testing and validation.

  • Task 4.2 : Technological roadmap for testing

Task 4.2 focus on two or three domains where there are emerging technologies and it provides research agenda leading to efficient IoT interoperability testing.

IRISA take care of providing the following deliverables:

  • D4.1 - Framework for studying existing IoT testing solutions (M12)
  • D4.1v2 - Update Framework for studying existing IoT testing solutions (M24)
  • D4.2 - First report on state fo the art , requirementys on architeture and needs for IoT testing (M12)
  • D4.2v2 - Updated version of the report on state fo the art , requirementys on architeture and needs for IoT testing (M18)
  • D4.3 - Report on roadmap for future research on interoperability testing (M24)

All deliverables can be found from

SWOT analysis


  • Strength: IRISA's strength in WP4 is its expertise in network testing domain. It carried its experience from IPv6 ready logo program and Go4IT project to support PROBE-IT in defining a roadmap for IoT testing. WP 4 partners such as BUPT, China and EGM support IRISA with their long experinec in Network testing.
  • Opportunities : The possible opportunities for IRISA from involving in PROBE -IT are first -hand experince in IoT field, sharing its knowledge to IoT community, possible collaboration with other resaerch projects.
  • Weakness : It is the first IoT related project involvement for the team. So, there is no knowledge of IoT market and domains.
  • Threats : Predicting new testing requirements for IoT domain appears to be challenge.

Contribution to other WPs

  • IRISA support WP1 for Communication and dissemination activities by presenting the project activities in many scientific conference and seminars.
  • IRISA supports WP3 for validation support and roadmapping of IoT technologies
  • WP5 is for networking and workshops organisation. IRISA contributes to the WP by sharing interoperability testing knowledge to IoT community.

Main works

With a strong background in conformance and interoperability testing, IRISA to contribute for developing roadmaps for IoT testing, developing test specifcation and tools for test events and knowledge sharing with workshops organised by PROBE-IT consortium.

Objective: To sketch the roadmap for IoT testing by analysing the current status of IoT testing activities.

The following steps explains the overall methodology to develop the roadmap.

Roadmap development

In order to develop a roadmap, two major steps to be done. First, a state of the art should be developed to know the current status of testing activities in IoT. Second, an analysis should be made on current testing activities with evaluation criteria for testing to develop a roadmap. This study can be made with different approaches as depicted in the section approach.


Since, IoT is a vast domain to explore, there are different approach possible to realize the work. The study can be made by collecting testing information from popular IoT communication standards, popular IoT application domains, popular use cases or by applying all. Wr took the first approach of gathering testing information from popular IoT communication standard. The choice of IoT technologies made as shown in the figure below.


The promotion of technology in the market, technology from a popular application, number of appearance in the press and expert surveys are considered to select a technology for this work.


The study was started with the approach explained above. The popular technologies identified from surveys, IoT public projects and from market analysis were studied deeply from the point of view of testing. In the study, certification process, test methods & tools, test coverage, test events, test developers & test labs were investigated thoroughly. This work will be published as a deliverable in the end of 12 months.


Test event involvement

First CoAP interoperabilty test event

CoAP is considered to be an attractive protocol which fit into Internet of Things paradigm. This pushed to conduct an interoperability event on CoAP. This was the first interoperability testing event for CoAP and it was declared as success which seems to be interesting for IRISA and Probe-IT project to conduct many more events like this in future to promote interoperability testing in the context of Internet of Things architecture .

Contribution to test specification

A typical formalised methodology was followed during the test specification process. Four different entities (ETSI, IRISA, BUPT and IPSO alliance) with expertise in standardisation of test specification, test methodology and tool development , protocol standardisation were involved in the definition of test specification process. The past experiences from these entities helped to develop a best preliminary test suite for CoAP. Only basic functionalities from CoAP were considered. Since CoAP is young protocol and not yet stabilised, we could not expect the implementation to support all functionalities of CORE. Test specification process steps were majorly divided into two phases called task and review. The steps were followed during definition of test specification were give below:

  1. Definition of test purpose
  2. Review of defined test purpose
  3. Definition of test suites
  4. Review of test suites by test event organisers
  5. Review of test suites by participants
  6. Finalising the test suites

The test specification can be found from

Test coverage : A total of 27 test objectives were defined in that 16 were considered as mandatory and 11 were considered as optional tests. The 16 mandatory tests were based on the CORE base specification. The following features were covered for the 1st CoAP plugtests:

  • CoAP base specification (16 tests)
  • CoRE link format (2 tests)
  • Observing resources in CoAP (5 tests)
  • Blockwise transfers in CoAP (4 tests)

Test bed architecture :

testbed_archi1.jpg tes.jpg

The test configuration shown in the figure requires a client to connect with a server by means of wire. Client and server might from the same vendor or different. Generally, the initial configuration comes under test arrangement before engaging in interoperability testing session. Test operator provides preamble for the test suite before its execution. Since, it is a passive testing activity; the packet sniffer is used to capture the exchange between client and server to have a test report from the tool developed by IRISA.

Test tool development

IRISA team provided a passive validation tool for the CoAP plugtests. Figure above demonstrates the test tool architecture. As shown in the figure, a web interface was developed to get pcap trace files captured during the event from the participant. These pcap files were processed to analyse the packet exchanged. Depends on request and response exchenged between client and server, the verdict was given. More info on this tool can be found from Passive Validation Tool For Coap

A white paper was drafted on 1st CoAP plugtests which can be found from

Second CoAP interoperabilty test event

————- Under construction ————-

Workshop involvement

Interoperability workshop, March 2012, Paris

The FP7 PROBE-IT project organized its first Internet of Things interoperability workshop. It gathered around 45 attendees with the aim to identify and debate on IoT interoperability issues and practices and to provide a 2012 action plan and recommendations in IERC deliverable to be published by end of 2012. This workshop was divided into three discussion parts:

  1. Presentations of some IoT interoperability good practices
  2. what are the current interop issues in IoT and projects
  3. Overall discussion for 2012 actions plan and recommendations

IRISA presented its testing expertise in the work shop. The presentation slides are avilable from here

Interoperability workshop, November 2012, Sophia-antipolis

———– Under construction ——————

Arulnambi Nandagoban 05/07/2012 15:59

probe-it_project.txt · Last modified: 13/03/2016 11:03 by viho
© 2008 INRIA Recent changes RSS feed Donate Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki