English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Specifying and Testing k-Safety Properties for Machine-Learning Models

Christakis, M., Eniser, H. F., Hoffmann, J., Singla, A., & Wüstholz, V. (2022). Specifying and Testing k-Safety Properties for Machine-Learning Models. Retrieved from https://arxiv.org/abs/2206.06054.

Item is

Basic

show hide
Genre: Paper
Latex : Specifying and Testing $k$-Safety Properties for Machine-Learning Models

Files

show Files
hide Files
:
arXiv:2206.06054.pdf (Preprint), 412KB
Name:
arXiv:2206.06054.pdf
Description:
File downloaded from arXiv at 2022-08-03 15:36
OA-Status:
Visibility:
Public
MIME-Type / Checksum:
application/pdf / [MD5]
Technical Metadata:
Copyright Date:
-
Copyright Info:
-

Locators

show

Creators

show
hide
 Creators:
Christakis, Maria1, Author           
Eniser, Hassan Ferit1, Author           
Hoffmann, Jörg2, Author
Singla, Adish3, Author           
Wüstholz, Valentin2, Author
Affiliations:
1Group M. Christakis, Max Planck Institute for Software Systems, Max Planck Society, ou_2541696              
2External Organizations, ou_persistent22              
3Group A. Singla, Max Planck Institute for Software Systems, Max Planck Society, ou_2541698              

Content

show
hide
Free keywords: Computer Science, Learning, cs.LG,Computer Science, Software Engineering, cs.SE
 Abstract: Machine-learning models are becoming increasingly prevalent in our lives, for
instance assisting in image-classification or decision-making tasks.
Consequently, the reliability of these models is of critical importance and has
resulted in the development of numerous approaches for validating and verifying
their robustness and fairness. However, beyond such specific properties, it is
challenging to specify, let alone check, general functional-correctness
expectations from models. In this paper, we take inspiration from
specifications used in formal methods, expressing functional-correctness
properties by reasoning about $k$ different executions, so-called $k$-safety
properties. Considering a credit-screening model of a bank, the expected
property that "if a person is denied a loan and their income decreases, they
should still be denied the loan" is a 2-safety property. Here, we show the wide
applicability of $k$-safety properties for machine-learning models and present
the first specification language for expressing them. We also operationalize
the language in a framework for automatically validating such properties using
metamorphic testing. Our experiments show that our framework is effective in
identifying property violations, and that detected bugs could be used to train
better models.

Details

show
hide
Language(s): eng - English
 Dates: 2022-06-132022
 Publication Status: Published online
 Pages: 16 p.
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: arXiv: 2206.06054
URI: https://arxiv.org/abs/2206.06054
BibTex Citekey: Christaikis2206.06054
 Degree: -

Event

show

Legal Case

show

Project information

show

Source

show