Laboratory validation studies in Ki-67 digital image analysis of breast carcinoma: a pathway to routine quality assurance

Morgan Wang, Sally Mclaren, Roopaa Jeyathevan, Benjamin Michael Allanson, Amanda Ireland, Alexandra Kang, Katie Meehan, Carla Thomas, Cleo Robinson, Marais Combrinck, Jennet Harvey, Greg Sterrett, Benjamin Dessauvagie

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Ki-67 proliferative index (PI) has prognostic and predictive value in invasive breast carcinoma (IBC), but clinical uptake has been hampered by suboptimal accuracy, reproducibility and standardisation. Published guidelines have addressed pre-analytical and analytical factors to improve Ki-67 PI utility; however, practicalities of ongoing monitoring of Ki-67 PI quality in IBC reporting have not been established. We aimed to evaluate the internal and external quality of our established digital Ki-67 PI IBC reporting practice at a tertiary institution.

In the 5 years since initial validation work, we've completed a series of internal and external quality assurance (QA) projects: (1) an interobserver agreement study, (2) a two site interlaboratory agreement study, (3) determination of the error of our Ki-67 results, (4) an audit of the year-toyear Ki-67 values, (5) an audit of Ki-67 in neoadjuvant chemotherapy (NAC) treated cases, and (6) comparison of our Ki-67 datasets with similar published datasets.

There was excellent concordance (intra-class correlation = 0.98) and good agreement [kappa (k) = 0.76-0.96] between pathologists, excellent concordance [Pearson correlation (R) = 0.94] and very good agreement (k = 0.80) between laboratories and excellent concordance (R = 0.92-0.95) and good agreement (k = 0.67-1.0) over time for our Ki-67 results. No significant difference was observed in Ki-67 data from year-to-year. Expected associations with clinico-pathological prognosticators, pathological complete response following NAC and mitotic index were evident. The median Ki-67 values from the overall and NAC treated datasets were within the range reported in other studies, and our data could be separated into similarly proportioned 'high' and 'low' Ki-67 PI groups when dichotomised as per protocols in other studies.

Collectively, our work provides evidence of adequate internal and external quality control for our digital Ki-67 PI IBC reporting protocols. Given the paucity of formal Ki-67 QA programs, our approach could be emulated, and results compared between laboratories as a framework for internal and external Ki-67 QA.

Original languageEnglish
Pages (from-to)246-252
Number of pages7
JournalPathology
Volume51
Issue number3
DOIs
Publication statusPublished - Apr 2019

Cite this

Wang, Morgan ; Mclaren, Sally ; Jeyathevan, Roopaa ; Allanson, Benjamin Michael ; Ireland, Amanda ; Kang, Alexandra ; Meehan, Katie ; Thomas, Carla ; Robinson, Cleo ; Combrinck, Marais ; Harvey, Jennet ; Sterrett, Greg ; Dessauvagie, Benjamin. / Laboratory validation studies in Ki-67 digital image analysis of breast carcinoma : a pathway to routine quality assurance. In: Pathology. 2019 ; Vol. 51, No. 3. pp. 246-252.
@article{9282d51c53ce48958cb3522b1633dcdc,
title = "Laboratory validation studies in Ki-67 digital image analysis of breast carcinoma: a pathway to routine quality assurance",
abstract = "Ki-67 proliferative index (PI) has prognostic and predictive value in invasive breast carcinoma (IBC), but clinical uptake has been hampered by suboptimal accuracy, reproducibility and standardisation. Published guidelines have addressed pre-analytical and analytical factors to improve Ki-67 PI utility; however, practicalities of ongoing monitoring of Ki-67 PI quality in IBC reporting have not been established. We aimed to evaluate the internal and external quality of our established digital Ki-67 PI IBC reporting practice at a tertiary institution.In the 5 years since initial validation work, we've completed a series of internal and external quality assurance (QA) projects: (1) an interobserver agreement study, (2) a two site interlaboratory agreement study, (3) determination of the error of our Ki-67 results, (4) an audit of the year-toyear Ki-67 values, (5) an audit of Ki-67 in neoadjuvant chemotherapy (NAC) treated cases, and (6) comparison of our Ki-67 datasets with similar published datasets.There was excellent concordance (intra-class correlation = 0.98) and good agreement [kappa (k) = 0.76-0.96] between pathologists, excellent concordance [Pearson correlation (R) = 0.94] and very good agreement (k = 0.80) between laboratories and excellent concordance (R = 0.92-0.95) and good agreement (k = 0.67-1.0) over time for our Ki-67 results. No significant difference was observed in Ki-67 data from year-to-year. Expected associations with clinico-pathological prognosticators, pathological complete response following NAC and mitotic index were evident. The median Ki-67 values from the overall and NAC treated datasets were within the range reported in other studies, and our data could be separated into similarly proportioned 'high' and 'low' Ki-67 PI groups when dichotomised as per protocols in other studies.Collectively, our work provides evidence of adequate internal and external quality control for our digital Ki-67 PI IBC reporting protocols. Given the paucity of formal Ki-67 QA programs, our approach could be emulated, and results compared between laboratories as a framework for internal and external Ki-67 QA.",
keywords = "Ki-67, digital image analysis, breast cancer, ESTROGEN-RECEPTOR, PROGNOSTIC VALUE, LABELING INDEX, CANCER, KI67, PROLIFERATION, CHEMOTHERAPY, MARKER, REPRODUCIBILITY, METAANALYSIS",
author = "Morgan Wang and Sally Mclaren and Roopaa Jeyathevan and Allanson, {Benjamin Michael} and Amanda Ireland and Alexandra Kang and Katie Meehan and Carla Thomas and Cleo Robinson and Marais Combrinck and Jennet Harvey and Greg Sterrett and Benjamin Dessauvagie",
year = "2019",
month = "4",
doi = "10.1016/j.pathol.2018.12.416",
language = "English",
volume = "51",
pages = "246--252",
journal = "Pathology",
issn = "0031-3025",
publisher = "Pergamon",
number = "3",

}

Laboratory validation studies in Ki-67 digital image analysis of breast carcinoma : a pathway to routine quality assurance. / Wang, Morgan; Mclaren, Sally; Jeyathevan, Roopaa; Allanson, Benjamin Michael; Ireland, Amanda; Kang, Alexandra; Meehan, Katie; Thomas, Carla; Robinson, Cleo; Combrinck, Marais; Harvey, Jennet; Sterrett, Greg; Dessauvagie, Benjamin.

In: Pathology, Vol. 51, No. 3, 04.2019, p. 246-252.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Laboratory validation studies in Ki-67 digital image analysis of breast carcinoma

T2 - a pathway to routine quality assurance

AU - Wang, Morgan

AU - Mclaren, Sally

AU - Jeyathevan, Roopaa

AU - Allanson, Benjamin Michael

AU - Ireland, Amanda

AU - Kang, Alexandra

AU - Meehan, Katie

AU - Thomas, Carla

AU - Robinson, Cleo

AU - Combrinck, Marais

AU - Harvey, Jennet

AU - Sterrett, Greg

AU - Dessauvagie, Benjamin

PY - 2019/4

Y1 - 2019/4

N2 - Ki-67 proliferative index (PI) has prognostic and predictive value in invasive breast carcinoma (IBC), but clinical uptake has been hampered by suboptimal accuracy, reproducibility and standardisation. Published guidelines have addressed pre-analytical and analytical factors to improve Ki-67 PI utility; however, practicalities of ongoing monitoring of Ki-67 PI quality in IBC reporting have not been established. We aimed to evaluate the internal and external quality of our established digital Ki-67 PI IBC reporting practice at a tertiary institution.In the 5 years since initial validation work, we've completed a series of internal and external quality assurance (QA) projects: (1) an interobserver agreement study, (2) a two site interlaboratory agreement study, (3) determination of the error of our Ki-67 results, (4) an audit of the year-toyear Ki-67 values, (5) an audit of Ki-67 in neoadjuvant chemotherapy (NAC) treated cases, and (6) comparison of our Ki-67 datasets with similar published datasets.There was excellent concordance (intra-class correlation = 0.98) and good agreement [kappa (k) = 0.76-0.96] between pathologists, excellent concordance [Pearson correlation (R) = 0.94] and very good agreement (k = 0.80) between laboratories and excellent concordance (R = 0.92-0.95) and good agreement (k = 0.67-1.0) over time for our Ki-67 results. No significant difference was observed in Ki-67 data from year-to-year. Expected associations with clinico-pathological prognosticators, pathological complete response following NAC and mitotic index were evident. The median Ki-67 values from the overall and NAC treated datasets were within the range reported in other studies, and our data could be separated into similarly proportioned 'high' and 'low' Ki-67 PI groups when dichotomised as per protocols in other studies.Collectively, our work provides evidence of adequate internal and external quality control for our digital Ki-67 PI IBC reporting protocols. Given the paucity of formal Ki-67 QA programs, our approach could be emulated, and results compared between laboratories as a framework for internal and external Ki-67 QA.

AB - Ki-67 proliferative index (PI) has prognostic and predictive value in invasive breast carcinoma (IBC), but clinical uptake has been hampered by suboptimal accuracy, reproducibility and standardisation. Published guidelines have addressed pre-analytical and analytical factors to improve Ki-67 PI utility; however, practicalities of ongoing monitoring of Ki-67 PI quality in IBC reporting have not been established. We aimed to evaluate the internal and external quality of our established digital Ki-67 PI IBC reporting practice at a tertiary institution.In the 5 years since initial validation work, we've completed a series of internal and external quality assurance (QA) projects: (1) an interobserver agreement study, (2) a two site interlaboratory agreement study, (3) determination of the error of our Ki-67 results, (4) an audit of the year-toyear Ki-67 values, (5) an audit of Ki-67 in neoadjuvant chemotherapy (NAC) treated cases, and (6) comparison of our Ki-67 datasets with similar published datasets.There was excellent concordance (intra-class correlation = 0.98) and good agreement [kappa (k) = 0.76-0.96] between pathologists, excellent concordance [Pearson correlation (R) = 0.94] and very good agreement (k = 0.80) between laboratories and excellent concordance (R = 0.92-0.95) and good agreement (k = 0.67-1.0) over time for our Ki-67 results. No significant difference was observed in Ki-67 data from year-to-year. Expected associations with clinico-pathological prognosticators, pathological complete response following NAC and mitotic index were evident. The median Ki-67 values from the overall and NAC treated datasets were within the range reported in other studies, and our data could be separated into similarly proportioned 'high' and 'low' Ki-67 PI groups when dichotomised as per protocols in other studies.Collectively, our work provides evidence of adequate internal and external quality control for our digital Ki-67 PI IBC reporting protocols. Given the paucity of formal Ki-67 QA programs, our approach could be emulated, and results compared between laboratories as a framework for internal and external Ki-67 QA.

KW - Ki-67

KW - digital image analysis

KW - breast cancer

KW - ESTROGEN-RECEPTOR

KW - PROGNOSTIC VALUE

KW - LABELING INDEX

KW - CANCER

KW - KI67

KW - PROLIFERATION

KW - CHEMOTHERAPY

KW - MARKER

KW - REPRODUCIBILITY

KW - METAANALYSIS

U2 - 10.1016/j.pathol.2018.12.416

DO - 10.1016/j.pathol.2018.12.416

M3 - Article

VL - 51

SP - 246

EP - 252

JO - Pathology

JF - Pathology

SN - 0031-3025

IS - 3

ER -