research-article

Open access

CoVeriTeam Service: Verification as a Service

Authors:

Henrik WachowitzAuthors Info & Claims

ICSE '23: Proceedings of the 45th International Conference on Software Engineering: Companion Proceedings

Pages 21 - 25

https://doi.org/10.1109/ICSE-Companion58688.2023.00017

Published: 27 July 2023 Publication History

Abstract

The research community has developed numerous tools for solving verification problems, but we are missing a common web interface for executing them. This means, users have to commit to install and execute each new tool (version) on their local machine. We propose to use CoVeriTeam Service to make it easy for verification researchers to experiment with new verification tools. CoVeriTeam has already unified the command-line interface, and reduced the burden by taking care of tool installation and isolated execution. The new web service in addition enables tool developers to make their tools accessible on the web and users to include verification tools in their work flow. There are already further applications of our service: The 2023 competitions on software verification and testing used the service for their integration testing, and we propose to use CoVeriTeam Service for incremental verification as part of a continuous-integration process.

Demonstration video: https://youtu.be/0Ao0ZogSu1U

Demonstration service: https://coveriteam-service.sosy-lab.org

References

[1]

Docker. https://www.docker.com/, accessed: 2023-02-09

[2]

Podman. https://github.com/containers/podman, accessed: 2023-02-09

[3]

Ball, T., de Halleux, P., Swamy, N., Leijen, D.: Increasing human-tool interaction via the web. In: Proc. PASTE. pp. 49--52. ACM (2013).

Digital Library

[4]

Beyer, D.: Advances in automatic software testing: Test-Comp 2022. In: Proc. FASE. pp. 321--335. LNCS 13241, Springer (2022).

Digital Library

[5]

Beyer, D.: Progress on software verification: SV-COMP 2022. In: Proc. TACAS (2). pp. 375--402. LNCS 13244, Springer (2022).

Digital Library

[6]

Beyer, D., Dresler, G., Wendler, P.: Software verification in the Google App-Engine cloud. In: Proc. CAV. pp. 327--333. LNCS 8559, Springer (2014).

Digital Library

[7]

Beyer, D., Kanav, S.: CoVeriTeam: On-demand composition of cooperative verification systems. In: Proc. TACAS. pp. 561--579. LNCS 13243, Springer (2022).

Digital Library

[8]

Beyer, D., Kanav, S., Richter, C.: Construction of verifier combinations based on off-the-shelf verifiers. In: Proc. FASE. pp. 49--70. Springer (2022).

Digital Library

[9]

Beyer, D., Kanav, S., Wachowitz, H.: Demonstration video of CoVeriTeam Service. https://youtu.be/0Ao0ZogSu1U, accessed: 2023-02-16

[10]

Beyer, D., Kanav, S., Wachowitz, H.: Source-code repository of CoVeriTeam. https://gitlab.com/sosy-lab/software/coveriteam, accessed: 2023-02-09

[11]

Beyer, D., Kanav, S., Wachowitz, H.: Source-code repository of CoVeriTeam Service. https://gitlab.com/sosy-lab/software/coveriteam-service, accessed: 2023-02-09

[12]

Beyer, D., Kanav, S., Wachowitz, H.: Reproduction package for the ICSE2023 article 'CoVeriTeam service: Verification as a service'. Zenodo (2023).

[13]

Beyer, D., Kanav, S., Wachowitz, H.: CoVeriTeam release 1.0. Zenodo (2023).

[14]

Beyer, D., Kanav, S., Wachowitz, H.: CoVeriTeam Service release 1.1. Zenodo (2023).

[15]

Beyer, D., Löwe, S., Novikov, E., Stahlbauer, A., Wendler, P.: Precision reuse for efficient regression verification. In: Proc. FSE. pp. 389--399. ACM (2013).

Digital Library

[16]

Beyer, D., Löwe, S., Wendler, P.: Reliable benchmarking: Requirements and solutions. Int. J. Softw. Tools Technol. Transfer 21(1), 1--29 (2019).

Digital Library

[17]

Eby, P.J.: PEP 3333 - Python web-server gateway interface v1.0.1. Tech. rep., https://peps.python.org/pep-3333/, accessed: 2023-02-09

[18]

Esen, Z., Rümmer, P.: TriCera: Verifying C programs using the theory of heaps. In: Proc. FMCAD. pp. 360--391. TU Wien Academic Press (2022).

[19]

Hashimoto, M.: Vagrant. https://github.com/hashicorp/vagrant, accessed: 2023-02-09

[20]

Heizmann, M., Christ, J., Dietsch, D., Ermis, E., Hoenicke, J., Lindenmann, M., Nutz, A., Schilling, C., Podelski, A.: Ultimate Automizer with SMTInterpol (competition contribution). In: Proc. TACAS. pp. 641--643. LNCS 7795, Springer (2013).

Digital Library

[21]

Horváth, B., Graics, B., Hajdu, Á., Micskei, Z., Molnár, V., Ráth, I., Andolfato, L., v. Gomes, I., Karban, R.: Model checking as a service: Towards pragmatic hidden formal methods. In: Proc. MODELS Companion. pp. 37:1--37:5. ACM (2020).

Digital Library

[22]

Macedo, N., Cunha, A., Pereira, J., Carvalho, R., Silva, R., Paiva, A.C.R., Ramalho, M.S., Silva, D.: Experiences on teaching Alloy with an automated assessment platform. Science of Computer Programming 211, 102690 (2021).

Digital Library

[23]

Margaria, T., Nagel, R., Steffen, B.: Remote integration and coordination of verification tools in JETI. In: Proc. ECBS. pp. 431--436 (2005).

Digital Library

[24]

Rothenberg, B., Dietsch, D., Heizmann, M.: Incremental verification using trace abstraction. In: Proc. SAS. pp. 364--382. LNCS 11002, Springer (2018).

[25]

Steffen, B., Margaria, T., Braun, V.: The Electronic Tool Integration platform: Concepts and design. STTT 1(1--2), 9--30 (1997).

Digital Library

[26]

Vašíček, O., Fiedor, J., Kratochvíla, T., Bohuslav, K., Smrčka, A., Vojnar, T.: Unite: An Adapter for Transforming Analysis Tools to Web Services via OSLC. In: Proc. ESEC/FSE. ACM (2022).

Digital Library

Cited By

Beyer DWachowitz H(2024)FM-Weck: Containerized Execution of Formal-Methods ToolsFormal Methods10.1007/978-3-031-71177-0_3(39-47)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-71177-0_3
Beyer D(2023)Safeguarding AI-Based Software Development and Verification using Witnesses (Position Paper)Bridging the Gap Between AI and Reality10.1007/978-3-031-73741-1_22(351-361)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1007/978-3-031-73741-1_22

Recommendations

CoVeriTeam: On-Demand Composition of Cooperative Verification Systems
Tools and Algorithms for the Construction and Analysis of Systems
Abstract
There is no silver bullet for software verification: Different techniques have different strengths. Thus, it is imperative to combine the strengths of verification tools via combinations and cooperation. CoVeriTeam is a language and tool for on-...
An Interface Theory for Program Verification
Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles
Abstract
Program verification is the problem, for a given program and a specification , of constructing a proof of correctness for the statement “program satisfies specification ” () or a proof of violation ([inline-graphic not available: see fulltext]). ...
Incremental predicate analysis for regression verification

Software products are evolving during their life cycles. Ideally, every revision need be formally verified to ensure software quality. Yet repeated formal verification requires significant computing resources. Verifying each and every revision can be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '23: Proceedings of the 45th International Conference on Software Engineering: Companion Proceedings

May 2023

416 pages

ISBN:9798350322637

General Chair:
John Grundy
Department of Software Systems and Cybersecurity, Faculty of IT, Monash University, Australia

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

IEEE CS

Publisher

IEEE Press

Publication History

Published: 27 July 2023

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '23

Sponsor:

SIGSOFT

ICSE '23: 45th International Conference on Software Engineering: Companion Proceedings

May 14 - 20, 2023

Victoria, Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
94
Total Downloads

Downloads (Last 12 months)62
Downloads (Last 6 weeks)13

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Beyer DWachowitz H(2024)FM-Weck: Containerized Execution of Formal-Methods ToolsFormal Methods10.1007/978-3-031-71177-0_3(39-47)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-71177-0_3
Beyer D(2023)Safeguarding AI-Based Software Development and Verification using Witnesses (Position Paper)Bridging the Gap Between AI and Reality10.1007/978-3-031-73741-1_22(351-361)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1007/978-3-031-73741-1_22

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten