Skip to main content
Download PDF

Clinical application of the Panbio™ COVID-19 Ag rapid test device and SSf-COVID19 kit for the detection of SARS-CoV-2 infection

BMC Research Notes volume 15, Article number: 357 (2022) Cite this article

Abstract

Objective

We evaluated the sensitivity and specificity of the Panbio™ COVID-19 Ag rapid test device using nasal swabs and those of the SSf-COVID19 kit, one of RT-PCR tests, using saliva specimens. These tests were compared with RT-PCR tests using nasopharyngeal swabs for the diagnosis of SARS-CoV-2 infection. The three diagnostic tests were simultaneously conducted for patients aged ≥ 18 years, who were about to be hospitalized or had been admitted for COVID-19 confirmed by RT-PCR in two research hospitals from August 20 to October 29, 2021. Nasal swabs were tested using the Panbio™ COVID-19 Ag rapid test device. More than 1 mL of saliva was self-collected and tested using the SSf-COVID19 kit.

Results

In total, 157 patients were investigated; 124 patients who were about to be hospitalized and 33 patients already admitted for COVID-19. The overall sensitivity and specificity of the Panbio™ COVID-19 Ag rapid test device with nasal swabs were 64.7% (95% confidence interval [CI] 47.9–78.5%) and 100.0% (95% CI 97.0–100.0%), respectively. The median time to confirm a positive result was 180 s (interquartile range 60–255 s). The overall sensitivity and specificity of the SSf-COVID19 kit with saliva specimens were 94.1% (95% CI 80.9–98.4%) and 100.0% (95% CI 97.0–100.0%), respectively.

Introduction

Reverse transcription-polymerase chain reaction (RT-PCR) assay of nucleic acids using upper and/or lower respiratory specimens is the most widely used method for diagnosing severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection [1, 2]. Despite its high sensitivity and specificity, RT-PCR has disadvantages such as high cost, long turn-around time, and the need for equipment for testing [2, 3]. Rapid antigen tests (RATs) that detect SARS-CoV-2 antigens can be used for point-of-care diagnosis of coronavirus disease (COVID-19) [4,5,6,7]. Although RATs have the advantages of low cost, short turn-around time, and lack of instrument requirements for testing, their sensitivity in detecting SARS-CoV-2 is lower than that of RT-PCR, especially for clinical specimens with low viral loads [5,6,7]. Various nucleic acid amplification tests (NAAT), including RT-PCR or rapid isothermal amplification such as loop-mediated isothermal amplification are now recommended as diagnostic methods for the detection of SARS-CoV-2 [7, 8].

A nasopharyngeal (NP) swab is the standard sample collected for diagnosis because of its high sensitivity and specificity. However, it is relatively invasive, time consuming, and requires trained healthcare workers for sample collection, which are limitations for conducting repeated examinations [2, 3]. Although NP specimens remain the recommended samples for SARS-CoV-2 diagnostic testing, nasal (anterior nares or mid-turbinate) swabs or saliva specimens are acceptable alternatives [9].

In the era of the COVID-19 pandemic, school classes, religious activities, and other activities involving gatherings of people have been partly or fully restricted in the Republic of Korea [10]. As the current pandemic situation is prolonged, various measures are being taken to re-open schools worldwide. To prevent outbreaks in schools, repeated screening tests using rapid diagnostics and non-invasive samples like saliva specimens are considered as a method to support their safe re-opening [11]. This study aimed to evaluate the performance of the Panbio™ COVID-19 Ag rapid test device, a RAT that uses nasal swab specimens, and the SSf-COVID19 kit, a RT-PCR that uses self-collected saliva specimens, in comparison with RT-PCR tests that use NP swabs in the detection of SARS-CoV-2.

Methods

Study design

The performance of the Panbio™ COVID-19 Ag rapid test device (Abbott Diagnostic GmbH, Jena, Germany) using nasal swabs and the SSf-COVID19 kit (SEASUN BIOMATERIALS, Inc. Daejeon, Korea) using saliva specimens were compared with the RT-PCR test using NP swabs from August 20 to October 29, 2021. We conducted the three diagnostic tests simultaneously for patients aged ≥ 18 years who were about to be hospitalized at Seoul National University Hospital (SNUH) or were already admitted to SNUH or Seoul Metropolitan Government – Seoul National University Boramae Medical Center (SMG-SNUBMC) for COVID-19 confirmed by RT-PCR.

Sample collection and diagnostic tests

NP swabs were collected by a skilled nurse or a doctor. RT-PCR with NP swabs was performed using the Standard M nCoV Real-Time Detection kit (SD Biosensor, Inc. Suwon, Korea). Nasal swabs were collected by a skilled doctor, and the specimens were tested using the Panbio™ COVID-19 Ag rapid test device. For the sample collection from the nasal cavities, it is recommended that the swab be inserted less than 1 inch in the nostril, turbinated five times, and then inserted in the test tubes [12]. The time required to interpret the RAT was measured, and the results were observed after 60 min to determine whether the initial results changed during the extended period. More than 1 mL of saliva was collected in a sterile bottle. Before collecting the saliva specimen, a doctor educated the patients about collecting methods, such as open mouth and drooling, to avoid stimulation of the salivary gland. RT-PCR with saliva specimens was performed using SSf-COVID19 kit.

Statistical analysis

The sensitivity and specificity of the RAT using nasal specimens and the RT-PCR using saliva specimens were evaluated by comparing with results of RT-PCR using NP swabs. Cohen’s weighted kappa index was used to evaluate the agreement between the tests. The non-parametric Mann–Whitney U-test was used to compare the difference in the cycle threshold (Ct) values between RT-PCR with NP swabs and RT-PCR with saliva specimens. P-values < 0.05 were considered statistically significant. All statistical analyses were performed using Statistical Product and Service Solutions, version 27.0 (IBM, Armonk, NY, USA).

Results

During the study period, three diagnostic tests were conducted for 157 patients. Of the 157 patients, 124 were about to be hospitalized and 33 were already admitted for COVID-19. Among the 124 patients who were about to be hospitalized, 16 (12.9%) had symptoms compatible with COVID-19, and the most common symptom was sore throat. Among the 33 patients already admitted for COVID-19, 27 (81.8%) had symptoms compatible with COVID-19 at the time of testing, and the most common symptom was cough (n = 13, 39.4%), followed by fever (n = 12, 36.4%).

Sensitivity and specificity of RAT with nasal swabs compared with RT-PCR with NP swabs

When compared with the RT-PCR results with NP swabs, the overall sensitivity and specificity of the RAT with nasal swabs were 64.7% (95% confidence interval [CI] 47.9–78.5%) and 100.0% (95% CI 97.0–100.0%), respectively (Table 1). The Cohen’s weighted kappa value was 0.74. An analysis of the results using an RT-PCR Ct value ≤ 25 increased the sensitivity to 75.9% (95% CI 57.9–87.8%) (Table 1). In the symptomatic patients (n = 43), the sensitivity of the RAT was 71.4% (95% CI 52.9–84.8%). The median time to confirm a positive RAT result was 180 s (interquartile range 60–255 s; range 60–600 s). We observed test kits over a period of 60 min, and the results did not differ from the initial interpretation.

Table 1 The sensitivity and specificity of the Panbio™ COVID-19 Ag rapid test device compared with RT-PCR.
Full size table

Sensitivity and specificity of RT-PCR with saliva compared with RT-PCR with NP swabs

When compared with the RT-PCR results with NP swabs, the overall sensitivity and specificity of the RT-PCR with saliva were 94.1% (95% CI 80.9–98.4%) and 100.0% (95% CI 97.0–100.0%), respectively (Table 2). The Cohen’s weighted kappa value was 0.96. An analysis of the results using an RT-PCR Ct value ≤ 25 increased the sensitivity of the RT-PCR with saliva to 96.6% (95% CI 82.8–99.4%) (Table 2). RT-PCR with NP swabs had a lower Ct value than that of the RT-PCR with saliva specimens (18.5 [15.1–23.9] vs. 23.6 [17.9–29.4]; P = 0.015).

Table 2 The sensitivity and specificity of SSf-COVID19 kit with saliva compared with RT-PCR with nasopharyngeal swabs
Full size table

Discussion

The overall sensitivity of the Panbio™ COVID-19 Ag rapid test device using nasal swab specimens was 64.7% (95% CI 47.9–78.5%). RATs have some benefits in screening, such as rapid identification of test results, low cost, and no requirement of instrument or expert skills [5,6,7, 11]. However, previous studies have reported that RATs using nasal swabs have lower sensitivity than that of RT-PCR. Peto et al. demonstrated that the sensitivity of RAT with nasal swabs using four different kits, including the Panbio™ COVID-19 Ag rapid test device, ranged from 78.8% as tested by laboratory scientists to 57.5% as tested by self-trained personnel [6]. The results of our study are similar to those of previous studies. The results of RATs for the diagnosis of COVID-19 are available in < 15–30 min. In this study, the results were available within 10 min. Although there have been concerns that interpreting the RAT before or after a specified time could result in false-positive or false-negative test results, this was not observed in our study. Notably, the results of the Panbio™ COVID-19 Ag rapid test device did not differ from the initial interpretation despite the extended observation of 60 min.

Previous reports revealed that saliva specimens could be useful alternatives for detecting SARS-CoV-2 [3, 13, 14]. In a previous study, when compared with the RT-PCR results with NP swabs, the sensitivity and specificity of RT-PCR with saliva specimens were 85.19% and 89.19%, respectively, and the mean Ct value was 28.26 for NP swabs and 32.91 for saliva [13]. Another study revealed that the sensitivity and specificity of RT-PCR with saliva specimens were 94.1% and 98.6%, respectively, and the median Ct values of NP swabs and saliva were 29.4 and 32.7, respectively [14]. In our results, the sensitivity and specificity of RT-PCR using saliva specimens were 94.1% and 100.0%, respectively, and the median Ct values for NP swabs and saliva specimens were 18.5 (15.1–23.9) and 23.6 (17.9–29.4), respectively.

Although RT-PCR using NP swabs is considered the gold standard for diagnosing SARS-CoV-2 infection, it is not useful for repeated screening tests during school re-opening because of its long turn-around time and discomfort in acquiring NP specimens. Repeated rapid and non-invasive tests could be helpful for safe school re-opening. RATs using nasal swabs or RT-PCR using saliva specimens could be considered for repeated screening tests for COVID-19 [11]. In this study, we evaluated the clinical performance of Panbio™ COVID-19 Ag rapid test device and RT-PCR test using self-collected saliva specimens for the detection of SARS-CoV-2 infection.

In conclusion, the sensitivity and specificity of the Panbio™ COVID-19 antigen rapid test device using nasal swabs and those of SSf-COVID19 kit using self-collected saliva specimens were 64.7% and 100% and 94.1% and 100%, respectively.

Limitations

The small number of patients is a limitation of this study, and further investigations are warranted.

Data availability

The data collected and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

COVID-19:

Coronavirus disease.

NAAT:

Nucleic acid amplification tests.

NP:

Nasopharyngeal.

RATs:

Rapid antigen tests.

RT-PCR:

Reverse transcription-polymerase chain reaction.

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus 2.

SMG-SNUBMC:

Seoul Metropolitan Government-Seoul National University Boramae Medical Center.

SNUH:

Seoul National University Hospital.

References

  1. Sethuraman N, Jeremiah SS, Ryo A. Interpreting Diagnostic Tests for SARS-CoV-2. JAMA. 2020;323:2249–51.

    Article  CAS  Google Scholar 

  2. Centers for Disease Control and Prevention. CDC’s Diagnostic Test for COVID-19 Only and Supplies. https://www.cdc.gov/coronavirus/2019-ncov/lab/virus-requests.html. Accessed 21 Apr 2022.

  3. To KK, Tsang OT, Leung WS, et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. Lancet Infect Dis. 2020;20:565–74.

    Article  CAS  Google Scholar 

  4. Centers for Disease Control and Prevention. Guidance for Antigen Testing for SARS-CoV-2 for Healthcare Providers Testing Individuals in the Community. https://www.cdc.gov/coronavirus/2019-ncov/lab/resources/antigen-tests-guidelines.html. Accessed 21 Apr 2022.

  5. Oh SM, Jeong H, Chang E, et al. Clinical Application of the Standard Q COVID-19 Ag Test for the Detection of SARS-CoV-2 Infection. J Korean Med Sci. 2021;36:e101.

    Article  CAS  Google Scholar 

  6. Peto T, UK COVID-19 Lateral Flow Oversight Team. COVID-19: Rapid antigen detection for SARS-CoV-2 by lateral flow assay: A national systematic evaluation of sensitivity and specificity for mass-testing. EClinicalMedicine. 2021;36:100924.

    Article  Google Scholar 

  7. Sharma A, Balda S, Apreja M, et al. COVID-19 diagnosis: current and future techniques. Int J Biol Macromol. 2021;193:1835–44.

    Article  CAS  Google Scholar 

  8. Centers for Disease Control and Prevention. Nucleic Acid Amplification Tests (NAATs). https://www.cdc.gov/coronavirus/2019-ncov/lab/naats.html. Accessed 21 Apr 2022.

  9. Centers for Disease Control and Prevention. Self-Testing At Home or Anywhere. https://www.cdc.gov/coronavirus/2019-ncov/testing/self-testing.html. Accessed 21 Apr 2022.

  10. Ministry of Health and Welfare. Republic of korea. Overview of Social distancing System. http://ncov.mohw.go.kr/en/socdisBoardView.do?brdId=19&brdGubun=191&dataGubun=191&ncvContSeq=&contSeq=&board_id=&gubun=/. Accessed 21 Apr 2022.

  11. Young BC, Eyre DW, Kendrick S, et al. Daily testing for contacts of individuals with SARS-CoV-2 infection and attendance and SARS-CoV-2 transmission in English secondary schools and colleges: an open-label, cluster-randomised trial. Lancet. 2021;398:1217–29.

    Article  CAS  Google Scholar 

  12. Centers for Disease Control and Prevention. Interim Guidelines for Collecting and Handling of Clinical Specimens for COVID-19 Testing. https://www.cdc.gov/coronavirus/2019-nCoV/lab/guidelines-clinical-specimens.html. Accessed 21 Apr 2022.

  13. Güçlü E, Koroglu M, Yürümez Y, et al Comparison of saliva and oro-nasopharyngeal swab sample in the molecular diagnosis of COVID-19. Rev Assoc Med Bras (1992). 2020;66:1116–1121.

  14. Babady NE, McMillen T, Jani K, et al. Performance of Severe Acute Respiratory Syndrome Coronavirus 2 Real-Time RT-PCR Tests on Oral Rinses and Saliva Samples. J Mol Diagn. 2021 Jan;23:3–9.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

We thank Abbott Diagnostics for providing Panbio™ COVID-19 Ag Rapid Test Device kit. Abbott Diagnostics had no role in the study’s design and conduct; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Funding

This work was supported by a grant from research fund of Seoul National University Hospital (Grant No. 2021–3148).

Author information

Author notes

  1. Sang-Min Oh

    Present address: Department of Internal Medicine, Jeonbuk National University Medical School and Hospital, 20 Geonjiro, Deokjin-gu, 54907, Jeonju, Jeollabuk-do, Republic of Korea

Authors and Affiliations

  1. Department of Internal Medicine, Seoul National University College of Medicine, 101 Daehakro, Jongno-gu, 03080, Seoul, Republic of Korea

    Sang-Min Oh, Hyeon Jae Jo, Donghwan Kim, Dohyeon Park, Young Hoon Hwang, Yunsang Choi, Chan Mi Lee, Seungjae Lee, Euijin Chang, Eunyoung Lee, Pyoeng Gyun Choe & Nam Joong Kim

  2. Department of Laboratory Medicine, Seoul National University College of Medicine, 101 Daehakro, Jongno-gu, 03080, Seoul, Republic of Korea

    Jee-Soo Lee, Taek Soo Kim & Moon-Woo Seong

  3. Division of Infectious Diseases, Seoul Metropolitan Government – Seoul National University Boramae Medical Center, 20 Boramae-ro 5-gil, Dongjak-gu, 07061, Seoul, Republic of Korea

    Eunyoung Lee

Authors
  1. Sang-Min Oh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jee-Soo Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hyeon Jae Jo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Donghwan Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dohyeon Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Young Hoon Hwang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yunsang Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Chan Mi Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Seungjae Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Euijin Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Eunyoung Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Taek Soo Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Moon-Woo Seong
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Pyoeng Gyun Choe
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Nam Joong Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Kim NJ contributed to concept of the study. Oh SM, Jo HJ, Kim D, Park D, Hwang YH, Choi Y, Lee CM, Lee S and Chang E recruited patients. Oh SM, Choi Y, Lee S examined RAT and educated patients for collecting saliva specimen. Lee JS, Kim TS and Seong MW contributed to laboratory examination of RT-PCR by nasopharyngeal swab and saliva. Choe PG and Lee E supervised recruited patients and sample collection at SNUH and SMG–SNUBMC. Oh SM analyzed the data and wrote the paper. Kim NJ supervised data analysis and revised the manuscript. All other authors critically read and approved the final manuscript.

Corresponding author

Correspondence to Nam Joong Kim.

Ethics declarations

Ethics approval and consent to participate

This study protocol was reviewed and approved by the Institutional Review Board of SNUH (Approval No. 2106-132-1230) and SMG-SNUBMC (Approval No. 30-2021-121). Before sample collection, written informed consent was obtained from each patient by the research staff.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Oh, SM., Lee, JS., Jo, H.J. et al. Clinical application of the Panbio™ COVID-19 Ag rapid test device and SSf-COVID19 kit for the detection of SARS-CoV-2 infection. BMC Res Notes 15, 357 (2022). https://0-doi-org.brum.beds.ac.uk/10.1186/s13104-022-06226-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13104-022-06226-6

Keywords

  • COVID-19
  • SARS-CoV-2
  • RT-PCR
  • Saliva
  • Antigen

BMC Research Notes

ISSN: 1756-0500

Contact us