This paper presents PyResBugs, a curated dataset of residual bugs, i.e., defects that persist undetected during traditional testing but later surface in production - collected from major Python frameworks. Each bug in the dataset is paired with its corresponding fault-free (fixed) version and annotated with multi-level natural language (NL) descriptions. These NL descriptions enable natural language-driven fault injection, offering a novel approach to simulating real-world faults in software systems. By bridging the gap between Software Fault Injection techniques and real-world representativeness, PyResBugs provides researchers with a high-quality resource for advancing AI-driven automated testing in Python systems.

PyResBugs: A Dataset of Residual Python Bugs for Natural Language-Driven Fault Injection / Cotroneo, D., De Rosa, G., Liguori, P.. - (2025), pp. 146-150. (2nd IEEE/ACM International Conference on AI Foundation Models and Software Engineering, FORGE 2025 Ottawa, Canada 27–28 April 2025) [10.1109/forge66646.2025.00024].

PyResBugs: A Dataset of Residual Python Bugs for Natural Language-Driven Fault Injection

De Rosa, Giuseppe
;
2025

Abstract

This paper presents PyResBugs, a curated dataset of residual bugs, i.e., defects that persist undetected during traditional testing but later surface in production - collected from major Python frameworks. Each bug in the dataset is paired with its corresponding fault-free (fixed) version and annotated with multi-level natural language (NL) descriptions. These NL descriptions enable natural language-driven fault injection, offering a novel approach to simulating real-world faults in software systems. By bridging the gap between Software Fault Injection techniques and real-world representativeness, PyResBugs provides researchers with a high-quality resource for advancing AI-driven automated testing in Python systems.
2025
Dataset
Fault Injection
Natural Language
Python
Residual Bugs
File in questo prodotto:
File Dimensione Formato  
PyResBugs_A_Dataset_of_Residual_Python_Bugs_for_Natural_Language-Driven_Fault_Injection.pdf

non disponibili

Tipologia: Versione Editoriale (PDF)
Licenza: Copyright dell'editore
Dimensione 418.52 kB
Formato Adobe PDF
418.52 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
2505.05777v1.pdf

accesso aperto

Tipologia: Documento in Pre-print
Licenza: Creative commons
Dimensione 521.54 kB
Formato Adobe PDF
521.54 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11771/41658
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • OpenAlex ND
social impact