Comparison of Overall Accuracy and Cohen’s kappa coefficient of
the Manufacturers and the Operators
Table 3 presents a comparison of the overall accuracy and
Cohen’s kappa coefficient of three different manufacturers’ ICT kits and
the operators’ COVID-19 immunochromatographic rapid test (ICT) kits.
Overall accuracy varies with disease prevalence, and it may mislead if
the study population differs from the actual population. Cohen’s kappa
coefficient was used as an alternative to compare the prediction
performance of the ICT kits to rRT-PCR with kappa values indicating
agreement levels; >75% implying excellent/total agreement,
40-75% good agreement, and <40% poor agreement with rRT-PCR.
When the manufacturers’ and operators’ analysis are compared, the
overall accuracy and Cohen’s kappa coefficient of the operators’
analysis is lower than that of the manufacturers’ analysis for all three
kits. Nonetheless, the results still indicate that the DG Rapid kit is
the most reliable ICT kit in both manufacturers’ and operators’
analysis.