Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus

Evan J. Propst; Nikolaus E. Wolter; Stacey L. Ishman; Karthik Balakrishnan; Ashley R. Deonarain; Deepak Mehta; George Zalzal; Seth M. Pransky; Soham Roy; Charles M. Myer; Michele Torre; Romaine F. Johnson; Jeffrey P. Ludemann; Craig S. Derkay; Robert H. Chun; Paul Hong; David W. Molter; Jeremy D. Prager; Lily H. P. Nguyen; Michael J. Rutter; Charles M. Myer; Karen B. Zur; Douglas R. Sidell; Liane B. Johnson; Robin T. Cotton; Catherine K. Hart; J. Paul Willging; Carlton J. Zdanski; John J. Manoukian; Derek J. Lam; Nancy M. Bauman; Eric A. Gantwerker; Murad Husein; Andrew F. Inglis; Glenn E. Green; Luv Ram Javia; Scott Schraff; Marlene A. Soma; Ellen S. Deutsch; Steven E. Sobol; Jonathan B. Ida; Sukgi Choi; Trina C. Uwiera; Udayan K. Shah; David R. White; Christopher T. Wootten; Hamdy El-Hakim; Matthew A. Bromwich; Gresham T. Richter; Shyan Vijayasekaran; Marshall E. Smith; Jean-Philippe Vaccani; Christopher J. Hartnick; Erynne A. Faucett

doi:10.1002/lary.28461

Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus

Evan J. Propst, Nikolaus E. Wolter, Stacey L. Ishman, Karthik Balakrishnan, Ashley R. Deonarain, Deepak Mehta, George Zalzal, Seth M. Pransky, Soham Roy, Charles M. Myer, Michele Torre, Romaine F. Johnson, Jeffrey P. Ludemann, Craig S. Derkay, Robert H. Chun, Paul Hong, David W. Molter, Jeremy D. Prager, Lily H. P. Nguyen, Michael J. RutterCharles M. Myer, Karen B. Zur, Douglas R. Sidell, Liane B. Johnson, Robin T. Cotton, Catherine K. Hart, J. Paul Willging, Carlton J. Zdanski, John J. Manoukian, Derek J. Lam, Nancy M. Bauman, Eric A. Gantwerker, Murad Husein, Andrew F. Inglis, Glenn E. Green, Luv Ram Javia, Scott Schraff, Marlene A. Soma, Ellen S. Deutsch, Steven E. Sobol, Jonathan B. Ida, Sukgi Choi, Trina C. Uwiera, Udayan K. Shah, David R. White, Christopher T. Wootten, Hamdy El-Hakim, Matthew A. Bromwich, Gresham T. Richter, Shyan Vijayasekaran, Marshall E. Smith, Jean-Philippe Vaccani, Christopher J. Hartnick, Erynne A. Faucett

Research output: Contribution to journal › Article › peer-review

9 Citations (Scopus)

Abstract

Objectives/Hypothesis Create a competency-based assessment tool for pediatric tracheotomy. Study Design Blinded, modified, Delphi consensus process. Methods Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as "keep" or "remove," and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as "keep," and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence 5 Laryngoscope, 2019

Original language	English
Pages (from-to)	2700-2707
Number of pages	8
Journal	Laryngoscope
Volume	130
Issue number	11
DOIs	https://doi.org/10.1002/lary.28461
Publication status	Published - 1 Nov 2020

Access to Document

10.1002/lary.28461

Cite this

Propst, E. J., Wolter, N. E., Ishman, S. L., Balakrishnan, K., Deonarain, A. R., Mehta, D., Zalzal, G., Pransky, S. M., Roy, S., Myer, C. M., Torre, M., Johnson, R. F., Ludemann, J. P., Derkay, C. S., Chun, R. H., Hong, P., Molter, D. W., Prager, J. D., Nguyen, L. H. P., ... Faucett, E. A. (2020). Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus. Laryngoscope, 130(11), 2700-2707. https://doi.org/10.1002/lary.28461

@article{bde34d0ea67a421989a76250593dc5d8,

title = "Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus",

abstract = "Objectives/Hypothesis Create a competency-based assessment tool for pediatric tracheotomy. Study Design Blinded, modified, Delphi consensus process. Methods Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as {"}keep{"} or {"}remove,{"} and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as {"}keep,{"} and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence 5 Laryngoscope, 2019",

keywords = "Tracheostomy, tracheotomy, Delphi, assessment, education, objective structured assessment of technical skills, Objective Structured Assessment of Technical Skill, OSAT, OSATS, TECHNICAL SKILL",

author = "Propst, {Evan J.} and Wolter, {Nikolaus E.} and Ishman, {Stacey L.} and Karthik Balakrishnan and Deonarain, {Ashley R.} and Deepak Mehta and George Zalzal and Pransky, {Seth M.} and Soham Roy and Myer, {Charles M.} and Michele Torre and Johnson, {Romaine F.} and Ludemann, {Jeffrey P.} and Derkay, {Craig S.} and Chun, {Robert H.} and Paul Hong and Molter, {David W.} and Prager, {Jeremy D.} and Nguyen, {Lily H. P.} and Rutter, {Michael J.} and Myer, {Charles M.} and Zur, {Karen B.} and Sidell, {Douglas R.} and Johnson, {Liane B.} and Cotton, {Robin T.} and Hart, {Catherine K.} and Willging, {J. Paul} and Zdanski, {Carlton J.} and Manoukian, {John J.} and Lam, {Derek J.} and Bauman, {Nancy M.} and Gantwerker, {Eric A.} and Murad Husein and Inglis, {Andrew F.} and Green, {Glenn E.} and Javia, {Luv Ram} and Scott Schraff and Soma, {Marlene A.} and Deutsch, {Ellen S.} and Sobol, {Steven E.} and Ida, {Jonathan B.} and Sukgi Choi and Uwiera, {Trina C.} and Shah, {Udayan K.} and White, {David R.} and Wootten, {Christopher T.} and Hamdy El-Hakim and Bromwich, {Matthew A.} and Richter, {Gresham T.} and Shyan Vijayasekaran and Smith, {Marshall E.} and Jean-Philippe Vaccani and Hartnick, {Christopher J.} and Faucett, {Erynne A.}",

year = "2020",

month = nov,

day = "1",

doi = "10.1002/lary.28461",

language = "English",

volume = "130",

pages = "2700--2707",

journal = "Laryngoscope",

issn = "0023-852X",

publisher = "John Wiley & Sons",

number = "11",

}

Propst, EJ, Wolter, NE, Ishman, SL, Balakrishnan, K, Deonarain, AR, Mehta, D, Zalzal, G, Pransky, SM, Roy, S, Myer, CM, Torre, M, Johnson, RF, Ludemann, JP, Derkay, CS, Chun, RH, Hong, P, Molter, DW, Prager, JD, Nguyen, LHP, Rutter, MJ, Myer, CM, Zur, KB, Sidell, DR, Johnson, LB, Cotton, RT, Hart, CK, Willging, JP, Zdanski, CJ, Manoukian, JJ, Lam, DJ, Bauman, NM, Gantwerker, EA, Husein, M, Inglis, AF, Green, GE, Javia, LR, Schraff, S, Soma, MA, Deutsch, ES, Sobol, SE, Ida, JB, Choi, S, Uwiera, TC, Shah, UK, White, DR, Wootten, CT, El-Hakim, H, Bromwich, MA, Richter, GT, Vijayasekaran, S, Smith, ME, Vaccani, J-P, Hartnick, CJ & Faucett, EA 2020, 'Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus', Laryngoscope, vol. 130, no. 11, pp. 2700-2707. https://doi.org/10.1002/lary.28461

TY - JOUR

T1 - Competency-Based Assessment Tool for Pediatric Tracheotomy

T2 - International Modified Delphi Consensus

AU - Propst, Evan J.

AU - Wolter, Nikolaus E.

AU - Ishman, Stacey L.

AU - Balakrishnan, Karthik

AU - Deonarain, Ashley R.

AU - Mehta, Deepak

AU - Zalzal, George

AU - Pransky, Seth M.

AU - Roy, Soham

AU - Myer, Charles M.

AU - Torre, Michele

AU - Johnson, Romaine F.

AU - Ludemann, Jeffrey P.

AU - Derkay, Craig S.

AU - Chun, Robert H.

AU - Hong, Paul

AU - Molter, David W.

AU - Prager, Jeremy D.

AU - Nguyen, Lily H. P.

AU - Rutter, Michael J.

AU - Myer, Charles M.

AU - Zur, Karen B.

AU - Sidell, Douglas R.

AU - Johnson, Liane B.

AU - Cotton, Robin T.

AU - Hart, Catherine K.

AU - Willging, J. Paul

AU - Zdanski, Carlton J.

AU - Manoukian, John J.

AU - Lam, Derek J.

AU - Bauman, Nancy M.

AU - Gantwerker, Eric A.

AU - Husein, Murad

AU - Inglis, Andrew F.

AU - Green, Glenn E.

AU - Javia, Luv Ram

AU - Schraff, Scott

AU - Soma, Marlene A.

AU - Deutsch, Ellen S.

AU - Sobol, Steven E.

AU - Ida, Jonathan B.

AU - Choi, Sukgi

AU - Uwiera, Trina C.

AU - Shah, Udayan K.

AU - White, David R.

AU - Wootten, Christopher T.

AU - El-Hakim, Hamdy

AU - Bromwich, Matthew A.

AU - Richter, Gresham T.

AU - Vijayasekaran, Shyan

AU - Smith, Marshall E.

AU - Vaccani, Jean-Philippe

AU - Hartnick, Christopher J.

AU - Faucett, Erynne A.

PY - 2020/11/1

Y1 - 2020/11/1

N2 - Objectives/Hypothesis Create a competency-based assessment tool for pediatric tracheotomy. Study Design Blinded, modified, Delphi consensus process. Methods Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as "keep" or "remove," and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as "keep," and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence 5 Laryngoscope, 2019

AB - Objectives/Hypothesis Create a competency-based assessment tool for pediatric tracheotomy. Study Design Blinded, modified, Delphi consensus process. Methods Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as "keep" or "remove," and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as "keep," and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence 5 Laryngoscope, 2019

KW - Tracheostomy

KW - tracheotomy

KW - Delphi

KW - assessment

KW - education

KW - objective structured assessment of technical skills

KW - Objective Structured Assessment of Technical Skill

KW - OSAT

KW - OSATS

KW - TECHNICAL SKILL

U2 - 10.1002/lary.28461

DO - 10.1002/lary.28461

M3 - Article

C2 - 31821571

SN - 0023-852X

VL - 130

SP - 2700

EP - 2707

JO - Laryngoscope

JF - Laryngoscope

IS - 11

ER -

Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus

Abstract

Access to Document

Fingerprint

Cite this