NeoScore: a new tool to assess technical and non-technical skills during neonatal resuscitation

Leonardo Meggiolaro; Gary Weiner; Alex Staffler; Fiorenzo Lupi; Tommaso Canesso; Daniele Trevisanuto

doi:10.1038/s41372-025-02210-7

NeoScore: a new tool to assess technical and non-technical skills during neonatal resuscitation

Leonardo Meggiolaro
, Gary Weiner
, Alex Staffler
, Fiorenzo Lupi
, Tommaso Canesso
, Daniele Trevisanuto

Krankenhaus Bozen

Publikation: Beitrag in Fachzeitschrift › Originalarbeit › Begutachtung

Abstract

BACKGROUND: Training with high-technology manikins improves cardio-pulmonary resuscitation (CPR) skill retention, but a checklist to assess both technical and non-technical skills is lacking. This study aimed to develop a standardized checklist to evaluate healthcare's performance during simulated Neonatal Resuscitation Program (NRP) scenarios.

MATERIALS AND METHODS: Twenty-two international neonatal resuscitation experts participated in a two-step modified Delphi process, rating each checklist item on a scale of 1-5 and providing feedback. Items with a mean rating below 4 or receiving comments were reviewed. Inter-rater reliability (IRR) of the final tool was assessed using video-recordings of simulated scenarios.

RESULTS: The final checklist, validated by 15 experts, includes 33 items. Mean expert rating of all items was 4.35. The checklist showed moderate inter-rater reliability (ICC = 0.67) overall, with excellent reliability (ICC = 0.8) for technical skills.

CONCLUSION: The tool effectively evaluates technical skills but requires further refinement for non-technical skills assessment.

Originalsprache	Englisch
Seiten (von - bis)	1573-1578
Seitenumfang	6
Fachzeitschrift	JOURNAL OF PERINATOLOGY
Jahrgang	45
Ausgabenummer	11
Frühes Online-Datum	Jan. 2025
DOIs	https://doi.org/10.1038/s41372-025-02210-7
Publikationsstatus	Veröffentlicht - Nov. 2025

Zugriff auf Dokument

10.1038/s41372-025-02210-7

Dieses zitieren

@article{f1d1e2e0286e4f909b1f90459b32be2c,

title = "NeoScore: a new tool to assess technical and non-technical skills during neonatal resuscitation",

abstract = "BACKGROUND: Training with high-technology manikins improves cardio-pulmonary resuscitation (CPR) skill retention, but a checklist to assess both technical and non-technical skills is lacking. This study aimed to develop a standardized checklist to evaluate healthcare's performance during simulated Neonatal Resuscitation Program (NRP) scenarios.MATERIALS AND METHODS: Twenty-two international neonatal resuscitation experts participated in a two-step modified Delphi process, rating each checklist item on a scale of 1-5 and providing feedback. Items with a mean rating below 4 or receiving comments were reviewed. Inter-rater reliability (IRR) of the final tool was assessed using video-recordings of simulated scenarios.RESULTS: The final checklist, validated by 15 experts, includes 33 items. Mean expert rating of all items was 4.35. The checklist showed moderate inter-rater reliability (ICC = 0.67) overall, with excellent reliability (ICC = 0.8) for technical skills.CONCLUSION: The tool effectively evaluates technical skills but requires further refinement for non-technical skills assessment.",

author = "Leonardo Meggiolaro and Gary Weiner and Alex Staffler and Fiorenzo Lupi and Tommaso Canesso and Daniele Trevisanuto",

note = " Division of Neonatology/NICU, Hospital of Bolzano (SABES-ASDAA), Teaching Hospital of Paracelsus Medical University (PMU), Bolzano-Bozen, Italy",

year = "2025",

month = nov,

doi = "10.1038/s41372-025-02210-7",

language = "English",

volume = "45",

pages = "1573--1578",

journal = "JOURNAL OF PERINATOLOGY",

issn = "0743-8346",

publisher = "Nature Publishing Group ",

number = "11",

}

TY - JOUR

T1 - NeoScore

T2 - a new tool to assess technical and non-technical skills during neonatal resuscitation

AU - Meggiolaro, Leonardo

AU - Weiner, Gary

AU - Staffler, Alex

AU - Lupi, Fiorenzo

AU - Canesso, Tommaso

AU - Trevisanuto, Daniele

N1 - Division of Neonatology/NICU, Hospital of Bolzano (SABES-ASDAA), Teaching Hospital of Paracelsus Medical University (PMU), Bolzano-Bozen, Italy

PY - 2025/11

Y1 - 2025/11

N2 - BACKGROUND: Training with high-technology manikins improves cardio-pulmonary resuscitation (CPR) skill retention, but a checklist to assess both technical and non-technical skills is lacking. This study aimed to develop a standardized checklist to evaluate healthcare's performance during simulated Neonatal Resuscitation Program (NRP) scenarios.MATERIALS AND METHODS: Twenty-two international neonatal resuscitation experts participated in a two-step modified Delphi process, rating each checklist item on a scale of 1-5 and providing feedback. Items with a mean rating below 4 or receiving comments were reviewed. Inter-rater reliability (IRR) of the final tool was assessed using video-recordings of simulated scenarios.RESULTS: The final checklist, validated by 15 experts, includes 33 items. Mean expert rating of all items was 4.35. The checklist showed moderate inter-rater reliability (ICC = 0.67) overall, with excellent reliability (ICC = 0.8) for technical skills.CONCLUSION: The tool effectively evaluates technical skills but requires further refinement for non-technical skills assessment.

AB - BACKGROUND: Training with high-technology manikins improves cardio-pulmonary resuscitation (CPR) skill retention, but a checklist to assess both technical and non-technical skills is lacking. This study aimed to develop a standardized checklist to evaluate healthcare's performance during simulated Neonatal Resuscitation Program (NRP) scenarios.MATERIALS AND METHODS: Twenty-two international neonatal resuscitation experts participated in a two-step modified Delphi process, rating each checklist item on a scale of 1-5 and providing feedback. Items with a mean rating below 4 or receiving comments were reviewed. Inter-rater reliability (IRR) of the final tool was assessed using video-recordings of simulated scenarios.RESULTS: The final checklist, validated by 15 experts, includes 33 items. Mean expert rating of all items was 4.35. The checklist showed moderate inter-rater reliability (ICC = 0.67) overall, with excellent reliability (ICC = 0.8) for technical skills.CONCLUSION: The tool effectively evaluates technical skills but requires further refinement for non-technical skills assessment.

U2 - 10.1038/s41372-025-02210-7

DO - 10.1038/s41372-025-02210-7

M3 - Original Article

C2 - 39824896

SN - 0743-8346

VL - 45

SP - 1573

EP - 1578

JO - JOURNAL OF PERINATOLOGY

JF - JOURNAL OF PERINATOLOGY

IS - 11

ER -

NeoScore: a new tool to assess technical and non-technical skills during neonatal resuscitation

Abstract

Zugriff auf Dokument

Fingerprint

Dieses zitieren