Proficiency Testing of Viral Marker Screening in African Blood Centers — Seven African Countries, 2017
Weekly / October 25, 2019 / 68(42);947–952
Please note:. This report has been corrected.
Bakary Drammeh, DrPH1; Syria Laperche, MD, PhD2; Joan F. Hilton, DSc3; Zhanna Kaidarova, MBA4; Larisa Ozeryansky, MPH1; Anindya De, PhD1; Mireille Kalou, MD1; Irene Benech, MD1; Bharat Parekh, PhD1; Edward L. Murphy, MD3,4,5; CDC Proficiency Testing Study Group (View author affiliations)
View suggested citationSummary
What is already known about this topic?
Substantial international investments have been made in African national blood transfusion services (NBTS) following reports of deficiencies in viral marker screening at African blood center laboratories.
What is added by this report?
Standardized proficiency testing conducted in seven African countries during 2017 found that proficiency in human immunodeficiency virus testing has improved, but testing proficiency for hepatitis B virus (HBV) and hepatitis C virus (HCV) needs to be improved.
What are the implications for public health practice?
Most poor performance in hepatitis virus testing can be attributed to the use of rapid tests rather than the non-NBTS setting of the laboratories. Remediation should be focused on improving the quality of rapid tests or avoiding their use.
A 2014 report evaluating accuracy of serologic testing for transfusion-transmissible viruses at African blood center laboratories found sensitivities of 92%, 87%, and 90% for detecting infections with human immunodeficiency virus (HIV), hepatitis B virus (HBV), and hepatitis C virus (HCV), respectively (1). Following substantial investments in national blood transfusion service (NBTS) laboratories, in 2017 investigators tested proficiency at 84 blood center laboratories (29 NBTS and 55 non-NBTS) in seven African countries. A blinded panel of 25 plasma samples was shipped to each participating laboratory for testing with their usual protocols based on rapid diagnostic tests (RDTs) (2) and third and fourth generation enzyme immunoassays (EIA-3 and EIA-4). Sensitivity and specificity were estimated using separate regression models that clustered assays by laboratory and adjusted for assay type and NBTS laboratory status. Mean specificities were ≥95% for all three viruses; however, mean sensitivities were 97% for HIV-positive, 76% for HBV-positive, and 80% for HCV-positive samples. Testing sensitivities for all viruses were high when EIA-3 assays were used (≥97%). Lower sensitivities for HBV-positive samples and HCV-positive samples were associated with assay types other than EIA-3, used primarily by non-NBTS laboratories. Proficiency for HIV testing has improved following international investments, but proficiency remains suboptimal for HBV and HCV testing. In sub-Saharan African blood centers, the quality of rapid tests used for HBV and HCV screening needs to be improved or their use discouraged in favor of EIA-3 tests.
This cross-sectional study of blood transfusion laboratories was conducted in Ghana, Kenya, Malawi, Mozambique, Nigeria, Rwanda, and Tanzania during February–September 2017. A stratified sampling strategy targeting all NBTS laboratories and 10 non-NBTS laboratories per country (except Rwanda which has no non-NBTS laboratories) was used. Within each country, all non-NBTS laboratories were sorted by number of blood units tested annually, and five laboratories were chosen randomly from strata above and below the median. Assay types in use at study laboratories were RDT; EIA-3, which detects antibody or antigen; and EIA-4, which detects both antigen and antibody. Characteristics of participating NBTS and non-NBTS laboratories were compared by country, prevalence of assay types, and measures of laboratory expertise, such as annual volume of specimens tested.
Panels of 25 challenge specimens were prepared and characterized by the Institut National de la Transfusion Sanguine (Paris, France). Each panel included seven negative controls; seven specimens that contained HIV antigen and anti-HIV antibody (six HIV-1 and one HIV-2) (HIV-positive samples); six specimens containing hepatitis B surface antigen (confirmed by neutralization assay and quantified) (HBV-positive samples); and five specimens that contained HCV RNA and anti-HCV antibody (HCV-positive samples). All positive challenge specimens included viral genotypes that were specific to Africa. Plasma specimens were diluted with uninfected plasma to obtain specific antigen or antibody concentrations. The panels were confirmed to match their labels (Supplementary Table, https://stacks.cdc.gov/view/cdc/82012) at the Institut National de la Transfusion Sanguine, coded to allow for blinded testing, and sent to national coordinators who distributed them to participating laboratories while maintaining the cold chain.
Laboratories tested each challenge specimen in the panel using three assays, each designed to detect infection with HIV, HBV, or HCV, and reported findings for each assay. The primary study outcome was classification of each assay finding as correct or incorrect relative to each specimen’s true infection status; classification was done at the unblinded data analysis center. Sensitivity (correct detection of infection-positive status whether by antibody, antigen, or RNA) was estimated using approximately 25% of specimens for which the challenge virus matched the assay virus (seven HIV, six HBV, and five HCV), and specificity (correct detection of infection-negative status) was estimated using approximately 75% of specimens for which the challenge virus (or control) did not match the assay virus (18 HIV, 19 HBV, and 20 HCV).
The investigators used separate generalized estimating equation logit-binomial models to estimate mean sensitivity and specificity and 95% confidence intervals (CIs), each as a function of the three assay viruses (HIV, HBV, and HCV), clustering outcomes within laboratories. Multivariable models added NBTS status, assay type (RDT, EIA-3, or EIA-4), and all two-way interaction terms to the unadjusted model. The unadjusted model of specificity also included the identity of the challenge virus. All analyses were performed using SAS software (version 9.4; SAS Institute).
Proficiency Testing
Laboratory characteristics. Among the seven countries, the number of participating laboratories ranged from one (Rwanda) to 20 (Nigeria), and the proportion that were NBTS laboratories ranged from 9% (Malawi and Mozambique) to 100% (Rwanda) (Table 1). Five non-NBTS laboratories (two each in Tanzania and Ghana and one in Kenya) did not participate, citing lack of reagents as the reason. Of 84 participating laboratories, 70 provided 100% of findings (25 specimens × three assays per laboratory), eight provided 93%, and six (all non-NBTS) provided 46%.
Among NBTS laboratories, 90% used EIA-3 or EIA-4 assays, whereas among non-NBTS laboratories, 78%–82% used RDT assays. NBTS centers tested approximately 10 times more blood units than did non-NBTS laboratories, and higher proportions of NBTS than non-NBTS laboratories produced blood components (66% versus 35%) and received blood primarily from volunteer donors (100% versus 60%).
Sensitivity. Unadjusted mean sensitivity for detecting HIV-positivity was 97% (95% CI = 95%–98%); for detecting HBV-positivity was 76% (95% CI = 71%–81%); and for detecting HCV-positivity was 80% (95% CI = 75%–86%) (Table 2). Sensitivity exceeded 90% for HIV-positive detection in all seven countries; however, this level of sensitivity for identifying HBV-positive specimens was reached only in Kenya and Rwanda, and for HCV-positive specimens, only in Kenya, Mozambique, and Rwanda (p<0.001). At NBTS laboratories, all three assays’ sensitivities to their respective target viruses exceeded 92%; however, at non-NBTS laboratories, sensitivity to HBV-positive was 66% and to HCV-positive was 74% (p<0.001). Statistically significantly higher levels of testing sensitivity were observed in laboratories that tested more blood donations per year (p = 0.006), produced more components per year (p = 0.026), and had higher percentages of donors who were volunteers (p = 0.013). Testing sensitivity was not associated with the number of laboratory personnel.
Based on the multivariable model, adjusted sensitivities uniformly exceeded 96% when EIA-3 was used; however, the sensitivity of EIA-4 to detect HCV-positivity was <85%, and RDT assay sensitivities to detect HBV- and HCV-positivity were <71%. Sensitivity for detecting HIV-positivity was ≥95% regardless of laboratory or assay type. Sensitivity varied significantly among assay types (p = 0.011) but not among assay target viruses (p = 0.30) or between NBTS laboratory status (p = 0.81), and none of the three pairwise interaction effects was statistically significant (p≥0.25). These findings are reflected by observed sensitivity proportions (Figure) that show that EIA-3 assays performed equally well or better than others for detecting HIV-, HBV-, and HCV-positivity, regardless of NBTS status.
Specificity. Unadjusted mean testing specificity was 95% (95% CI = 93%–97%) for HIV-negative specimens, 96% (95% CI = 93%–98%) for HBV-negative specimens, and 95% (90%–98%) for HCV-negative specimens. Across all assay target viruses, mean specificity was 90%–92% in three countries (Malawi, Mozambique, and Tanzania) and ≥98% in the other four countries.
Adjusted estimates based on the multivariable model showed that the targeted assays varied in specificity by assay type (p = 0.054) and interaction with NBTS status (p = 0.058). Specificity was relatively low at non-NBTS laboratories for RDT assays targeting HCV or HIV and at NBTS laboratories for EIA-4 assays targeting HIV (Figure).
Discussion
This investigation of testing proficiency of targeted assays for HIV, HBV, and HCV found specificities to be high overall, with clinically negligible variations by NBTS status or assay type. In contrast, clinically important variation in sensitivities within and between assay targets was found. The finding that non-EIA-3 tests had lower sensitivity than did other assay types for detecting HBV- and HCV-positive specimens but not HIV-positive specimens is consistent with findings from previous studies (1–4). As noted, variation in testing proficiency for sensitivity among countries primarily reflects variation among assay types rather than between NBTS and non-NBTS laboratories.
This study found higher sensitivity for detecting HIV-positivity but lower sensitivity for detecting HBV- and HCV-positivity than is generally associated with the use of RDTs, compared with previous studies using similar methods (1,2). These results suggest that RDT assays targeting HIV perform better or have better quality assurance than do RDT assays targeting the hepatitis viruses. The poorer performance of RDT assays for detecting HBV- and HCV-positivity is most likely attributable to the quality of the assays themselves, because deficiency in performing the tests could have been signaled by lower mean accuracy at non-NBTS compared with NBTS laboratories. Of note, lower sensitivity to HCV-positivity using the EIA-4 was limited to a single reputable assay, suggesting a need to rule out poor technical performance or recording errors. After all laboratories had completed testing and the CDC International Laboratory Branch had evaluated the results, it conducted site visits at low-performing laboratories and developed recommendations for remediation.
The findings in this report are subject to at least four limitations. First, the numbers of positive-challenge specimens per assay target virus were small, which resulted in few response levels for sensitivity estimations. Second, the positive samples were diluted to approximate difficult samples, but this limits extrapolation of operational sensitivity. Third, the investigators attempted to overcome sampling bias by using a random sample of non-NBTS laboratories; however, five of these laboratories failed to participate in the study, and six others submitted incomplete data, which suggests problems with their supplies of assay kits. Finally, the unanticipated strong association of assay type with NBTS status and few NBTS laboratories per country precluded fully distinguishing the effects of assay type, NBTS status, and country.
Variation in blood center laboratory proficiency among sub-Saharan African countries has been reported previously and likely relates to both assay quality, representing a range of manufacturers, and organizational structures, resources, and training of technicians (5–7). Future studies of testing proficiency could be designed to study manufacturers in addition to assay type, with the aim of identifying products that perform poorly. Alternatively, future study protocols could provide high-accuracy assay kits targeting HIV, HBV, and HCV to better distinguish between assay quality and operator error.
To ensure that transfusion-transmitted viruses in donated blood are detected, the use of rapid diagnostic tests for HBV and HCV should be discouraged because of the general suboptimal performance of these assays. Where possible, scarce blood center resources should be allocated to enable all blood center laboratories to use EIA-based assays from selected manufacturers, improve the reliability of supply chains and implement standard quality assurance protocols for conducting the assays, and require technical staff members to participate in testing-proficiency training programs. However, quality improvements might be difficult to sustain if African national budgets are not supplemented by international funding (8).
Acknowledgments
Rémi Caparros, Daniel Hindes.
CDC Proficiency Testing Study Group
Zaituni Abdallah, Western Zone Blood Transfusion Center Lab, Tanzania; Abby Abdikadir, Wajir District, Kenya; Usman Ali Medugu Abjah, University of Maiduguri Teaching Hospital, Nigeria; Oluwafemi Adegbamigbe, Blood Transfusion Service, Federal Teaching Hospital, Ido-Ekiti, Nigeria; Victoria Adeleke, National Blood Transfusion Service Ibadan Centre, Nigeria; Lara Adeyeye, Federal Medical Centre Abeokuta, Nigeria; Janet Agba, National Blood Transfusion Service Abuja Centre, Nigeria; Stephen Ajala, National Blood Transfusion Service Kaduna Centre, Nigeria; Sheila Allotey, Southern Accra Area Blood Center, Ghana; Peter Paul Bacheyie, Tamale, Ghana; Patrick Banda, Katete Community Hospital, Malawi; Obasi Barnabas, National Blood Transfusion Service Owerri Centre, Nigeria; Oriji O. Bassey, CDC, Nigeria; Diocleciano Bila, Hospital Rural de Chokwe, Mozambique; Frank Bonsu, Kumasi South Hospital, Ghana; Remi Caparros, Institut National de la Transfusion Sanguine, Paris, France; Aglean Chelimo, Kenyatta National Hospital, Kenya; Charles Chilambula, St. Peters Community Hospital, Likoma, Malawi; Lameck Chinkango, Mlambe Hospital, Malawi; Armando Chongo, Hospital Provincial de Manica, Mozambique; Francelino Luciano Chongola, Hospital Provincial de Inhambane, Mozambique; Onyeka Paul Chuka, University of Abuja Teaching Hospital, Nigeria; Samuel Cobbson, Methodist Faith Healing Hospital, Ghana; Leonardo Desousa, CDC, Mozambique; Elliot Eli Dogbe, Komfo Anokye Teaching Hospital Central Area Blood Centre, Ghana; Augusto Domingos, Hospital Central de Maputo, Mozambique; Vanetine Ebomwonyi, National Blood Transfusion Service Benin Centre, Nigeria; Rumji Elisha, National Blood Transfusion Service Jos Centre, Nigeria; Joanisse Samuel Escova, Hospital Central da Beira, Mozambique; Esperança Fideliz, Hospital Provincial de Tete, Mozambique; Jerry Gwamna, CDC, Nigeria; Dunstan Haule, National Blood Transfusion Service, Tanzania; Daniel Hindes, Vitalant Research Institute, San Francisco, California; Tehreen Ismail, Aga Khan Hospital, Tanzania; Rui Labissone Jemusse, Hospital Distrital de Madimba, Mozambique; Alberto João, Hospital Provincial de Quelimane, Mozambique; Muluken Kaba, CDC, Malawi; Nasibu Kabolile, Tanzania People’s Defense Force Blood Transfusion Center Lab, Tanzania; Zachary Kibet, St. Mary’s Langata, Kenya; Sammy Kihara, Regional Blood Transfusion Centre Embu, Kenya; Basilius Kilowoko, St. Benedict Ndanda Hospital, Tanzania; Daniel Kimani, CDC, Kenya; Steve Kimanzi, Regional Blood Transfusion Centre Embu, Kenya; Martha Kimamo, Mater Mission Hospital, Kenya; Richard Kinyaha, Kibong’oto Hospital, Tanzania; Nick Kiptanui, Regional Blood Transfusion Centre Nakuru, Kenya; Khamisi Kithi, Regional Blood Transfusion Centre Mombasa, Kenya; Festus Koech, Regional Blood Transfusion Centre Eldoret, Kenya; Steve Kunyenga, Nsanje District Hospital, Malawi; Yusto Kyando, Ikonda Mission Hospital, Tanzania; Alexander Lawrence, Federal Medical Centre Lokoja, Nigeria; Chimwemwe Limited, Bwaila Hospital, Malawi; Jorge Lucio, Servico Nacional de Sangue, Mozambique; Simon Manu, Southern Accra Area Blood Center, Ghana; Sylvester Mattunda, CDC, Tanzania; Nassim Mbarak,, Sayyidah Fatima, Kenya; Bridon Mbaya, Malawi Blood Transfusion Service, Malawi; Alice Mbui, Kenya National Blood Transfusion Service, Kenya; Japheth Mdenyo, Bomu Hospital, Kenya; Rodgers MC Mengwa, Ekwendeni Hospital, Malawi; Chidozie Meribe, CDC, Nigeria; Thom Mfune, Malawi Blood Transfusion Service, Malawi; start highlightMichael Anthony Onojaend highlight, Benue State University Teaching Hospital Makurdi, Nigeria; Fernando José Muria, Hospital Distrital de Nacala, Mozambique; Andrew Mwamtobe, Atupele Community Hospital, Malawi; Musa Mwamzuka, Bomu Hospital, Kenya; Christina Mwangi, CDC, Rwanda; Deeps Mwenebanda, David Gordon Memorial Hospital, Malawi; Allan Mungai, Coptic Mission, Kenya; Antony Mungai, Presbyterian Church of East Africa Kikuyu Mission, Kenya; Jabir Muhsin, Amana Hospital, Tanzania; Venantia Mwajombe, Southern Highlands Zone Blood Transfusion Center Lab, Tanzania; Charles Mwiyuma, Southern Zone Blood Transfusion Center Lab, Tanzania; Emmanuel Nani, Dangme East District Hospital, Ghana; Henry Ndaki, Lake Zone Blood Transfusion Center Lab, Tanzania; Olivier Ndahiriwe, National Center for Blood Transfusion, Rwanda; Daniel Ndhlovu, Malawi Blood Transfusion Service, Malawi; Macrina Nditi, Mafinga District Hospital, Tanzania; Miguel Neves, Centro de Referência Nacional de Sangue, Mozambique; Eviness Ngwira, St. Montfort Hospital, Malawi; Bernard Nkrumah, CDC, Ghana; Peter Nzioka, Pandya Hospital, Kenya; Kingsley Odiabara, National Blood Transfusion Service Headquarters, Nigeria; Elizabeth Odthiambo, Regional Blood Transfusion Centre Kisumu, Kenya; Omo T. Ojo, Olabisi Onabanjo University Teaching Hospital Sagamu, Nigeria; McPaul Okoye, CDC, Nigeria; Mavis Okyere, National Blood Service, Ghana; Ogunkola Oluyemisi, National Blood Transfusion Service Abeokuta Centre, Nigeria; Anthony Owusu-Ansah, Mankranso Government Hospital, Ghana; John Provinseh, Tepa Government Hospital, Ghana; Thomas Rotich, Regional Blood Transfusion Centre, Eldoret, Kenya; Razak Saasi, Nkawie-Toase Government Hospital, Ghana; Simon Sabaya, Arusha Lutheran Medical Center, Tanzania; Tinache Gabriel Sabonete, Hospital Distrital de Chiure, Mozambique; Yaw Sam, Konongo-Odumasi Government Hospital, Ghana; Ibrahim Sani, Usman Dan Fodio University Teaching Hospital, Sokoto, Nigeria; Bamidele Sunday, National Blood Transfusion Service Ado-Ekiti Centre, Nigeria; Priscilla Tarimo, Northern Zone Blood Transfusion Center Lab, Tanzania; Adekoya Benson Tolulope, Ekiti State University Teaching Hospital Ado-Ekiti, Nigeria; Peter Torokaa, Dodoma Regional Hospital, Tanzania; Ndeonasia Towo, Eastern Zone Blood Transfusion Center Lab, Tanzania; Erlinda Umoru, National Blood Transfusion Service Lokoja Centre, Nigeria; Jose Victorino, Servico Nacional de Sangue, Mozambique; Kingsley Wuor, Koforidua Government Hospital, Ghana; James Yelima, National Blood Transfusion Service Maiduguri Centre, Nigeria; Samuila Yohanna, National Blood Transfusion Service Jalingo Centre, Nigeria
Corresponding author: Edward L Murphy, murphy@ucsf.edu, 415-749-6668.
1Division of Global HIV and TB, Center for Global Health, CDC; 2Département des Agents Transmissibles par le Sang, Centre National de Référence Risque Infectieux Transfusionnels, Institut National de la Transfusion Sanguine, Paris, France; 3Department of Epidemiology & Biostatistics, University of California, San Francisco; 4Vitalant Research Institute, San Francisco, California, 5Department of Laboratory Medicine, University of California, San Francisco.
All authors have completed and submitted the International Committee of Medical Journal Editors form for disclosure of potential conflicts of interest. No potential conflicts of interest were disclosed.
References
- Bloch EM, Shah A, Kaidarova Z, et al.; Anglophone Africa Transfusion Research Group. A pilot external quality assurance study of transfusion screening for HIV, HCV and HBsAG in 12 African countries. Vox Sang 2014;107:333–42. CrossRef PubMed
- Pruett CR, Vermeulen M, Zacharias P, Ingram C, Tayou Tagny C, Bloch EM. The use of rapid diagnostic tests for transfusion infectious screening in Africa: a literature review. Transfus Med Rev 2015;29:35–44. CrossRef PubMed
- Laperche S; Francophone African Group for Research in Blood Transfusion. Multinational assessment of blood-borne virus testing and transfusion safety on the African continent. Transfusion 2013;53:816–26. CrossRef PubMed
- Prugger C, Laperche S, Murphy EL, et al. Screening for transfusion transmissible infections using rapid diagnostic tests in Africa: a potential hazard to blood safety? Vox Sang 2016;110:196–8. CrossRef PubMed
- Tagny CT, Diarra A, Yahaya R, et al. Characteristics of blood donors and donated blood in sub-Saharan Francophone Africa. Transfusion 2009;49:1592–9. CrossRef PubMed
- Tagny CT, Kouao MD, Touré H, et al. Transfusion safety in francophone African countries: an analysis of strategies for the medical selection of blood donors. Transfusion 2012;52:134–43. CrossRef PubMed
- Bloch EM, Vermeulen M, Murphy E. Blood transfusion safety in Africa: a literature review of infectious disease and organizational challenges. Transfus Med Rev 2012;26:164–80. CrossRef PubMed
- Adepoju P. Blood transfusion in Kenya faces an uncertain future. Lancet 2019;394:997–8. CrossRef PubMed
FIGURE. Adjusted mean estimates of sensitivity (A) and specificity (B) for identification of positive and negative challenge specimens for human immunodeficiency virus (HIV), hepatitis B virus (HBV), and hepatitis C virus (HCV), by assay virus, assay type, and National Blood Transfusion Services (NTBS) laboratory status — seven African countries,* 2017†
Abbreviations: EIA-3 = third generation enzyme immunoassay; EIA-4 = fourth generation enzyme immunoassay; RDT = rapid diagnostic test.
* Ghana, Kenya, Malawi, Mozambique, Nigeria, Rwanda, and Tanzania.
† 95% confidence intervals indicated by error bars.
Suggested citation for this article: Drammeh B, Laperche S, Hilton JF, et al. Proficiency Testing of Viral Marker Screening in African Blood Centers — Seven African Countries, 2017. MMWR Morb Mortal Wkly Rep 2019;68:947–952. DOI: http://dx.doi.org/10.15585/mmwr.mm6842a3.
MMWR and Morbidity and Mortality Weekly Report are service marks of the U.S. Department of Health and Human Services.
Use of trade names and commercial sources is for identification only and does not imply endorsement by the U.S. Department of
Health and Human Services.
References to non-CDC sites on the Internet are
provided as a service to MMWR readers and do not constitute or imply
endorsement of these organizations or their programs by CDC or the U.S.
Department of Health and Human Services. CDC is not responsible for the content
of pages found at these sites. URL addresses listed in MMWR were current as of
the date of publication.
All HTML versions of MMWR articles are generated from final proofs through an automated process. This conversion might result in character translation or format errors in the HTML version. Users are referred to the electronic PDF version (https://www.cdc.gov/mmwr) and/or the original MMWR paper copy for printable versions of official text, figures, and tables.
Questions or messages regarding errors in formatting should be addressed to mmwrq@cdc.gov.