<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Gates Open Res</journal-id>
            <journal-title-group>
                <journal-title>Gates Open Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2572-4754</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/gatesopenres.13272.2</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>The impact of surveillance and other factors on detection of emergent and circulating vaccine derived polioviruses</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 2; peer review: 2 approved, 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes" equal-contrib="yes">
                    <name>
                        <surname>Auzenbergs</surname>
                        <given-names>Megan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1724-4485</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no" equal-contrib="yes">
                    <name>
                        <surname>Fountain</surname>
                        <given-names>Holly</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Macklin</surname>
                        <given-names>Grace</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Lyons</surname>
                        <given-names>Hil</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-0325-006X</uri>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>O'Reilly</surname>
                        <given-names>Kathleen M</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene &amp; Tropical Medicine, London, WC1E 7HT, UK</aff>
                <aff id="a2">
                    <label>2</label>Polio Eradication, World Health Organization, Geneva, Switzerland</aff>
                <aff id="a3">
                    <label>3</label>Institute for Disease Modeling, Bellevue, Washington, USA</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:megan.auzenbergs@lshtm.ac.uk">megan.auzenbergs@lshtm.ac.uk</email>
                </corresp>
                <fn fn-type="equal" id="fn1">
                    <p>* Authors contributed equally</p>
                </fn>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>5</day>
                <month>5</month>
                <year>2022</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>5</volume>
            <elocation-id>94</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>26</day>
                    <month>4</month>
                    <year>2022</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Auzenbergs M et al.</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://gatesopenresearch.org/articles/5-94/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> Circulating vaccine derived poliovirus (cVDPV) outbreaks remain a threat to polio eradication. To reduce cases of polio from cVDPV of serotype 2, the serotype 2 component of the vaccine has been removed from the global vaccine supply, but outbreaks of cVDPV2 have continued. The objective of this work is to understand the factors associated with later detection in order to improve detection of these unwanted events.</p>
                <p>
                    <bold>Methods:</bold> The number of nucleotide differences between each cVDPV outbreak and the oral polio vaccine (OPV) strain was used to approximate the time from emergence to detection. Only independent emergences were included in the analysis. Variables such as serotype, surveillance quality, and World Health Organization (WHO) region were tested in a negative binomial regression model to ascertain whether these variables were associated with higher nucleotide differences upon detection.</p>
                <p>
                    <bold>Results:</bold> In total, 74 outbreaks were analysed from 24 countries between 2004-2019. For serotype 1 (n=10), the median time from seeding until outbreak detection was 284 (95% uncertainty interval (UI) 284-2008) days, for serotype 2 (n=59), 276 (95% UI 172-765) days, and for serotype 3 (n=5), 472 (95% UI 392-603) days. Significant improvement in the time to detection was found with increasing surveillance of non-polio acute flaccid paralysis (AFP) and adequate stool collection.</p>
                <p>
                    <bold>Conclusions:</bold> cVDPVs remain a risk; all WHO regions have reported at least one VDPV outbreak since the first outbreak in 2000 and outbreak response campaigns using monovalent OPV type 2 risk seeding future outbreaks. Maintaining surveillance for poliomyelitis after local elimination is essential to quickly respond to both emergence of VDPVs and potential importations as low-quality AFP surveillance also causes outbreaks to continue undetected. Considerable variation in the time between emergence and detection of VDPVs were apparent, and other than surveillance quality and inclusion of environmental surveillance, the reasons for this remain unclear.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>polio</kwd>
                <kwd>vaccination</kwd>
                <kwd>eradication</kwd>
                <kwd>cVDPVs</kwd>
                <kwd>OPV</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>Gates Foundation</funding-source>
                    <award-id>OPP1191821</award-id>
                </award-group>
                <funding-statement>This work was supported by the Gates Foundation [OPP1191821]. </funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 1</title>
                <p>The main revisions to the manuscript include: (1) a better explanation of the genetic sequencing protocols in place for polioviruses, (2) elaboration on why the data was split by serotypes 2 vs. 1 &amp; 3, and (3) an update to the interpretation of table 2 in order&#x00a0;to highlight the importance of the relationship between type of surveillance via which the first isolate was detected (AFP vs. ES), despite the insignificant p-value. Since the article was first published, there was an importation of WPV1 into the African continent, so we have added commentary on the importance of high quality surveillance as the risk of spread and further importations of importation remain a risk to polio eradication.</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>Polio has been targeted for eradication since 1988 when countries represented within the World Health Assembly committed to eradication
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup>. Whilst the initial goal to eradicate all poliovirus by 2000 was not achieved, two of the three wild serotypes have been eliminated, most recently type 3 in 2018
                <sup>
                    <xref ref-type="bibr" rid="ref-2">2</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref-4">4</xref>
                </sup>. The main driver in this reduction of cases has been vaccination achieved through both routine and supplementary immunisation activities (SIAs), largely with the oral polio vaccine (OPV), a live attenuated vaccine. OPV is important for polio eradication, as it provides both humoral and intestinal immunity. However, the genetic instability of the attenuated virus can result in mutations that increase transmissibility and neurovirulence of infections
                <sup>
                    <xref ref-type="bibr" rid="ref-5">5</xref>,
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup>. Consequently, circulating vaccine-derived polioviruses (cVDPVs) can arise and cause paralysis in affected individuals. Prior to 2000, these outbreaks had not been reported in any countries using OPV
                <sup>
                    <xref ref-type="bibr" rid="ref-7">7</xref>
                </sup>, and recent analysis has suggested that cVDPV emergence and spread is more common in populations with low to moderate mucosal immunity against poliovirus
                <sup>
                    <xref ref-type="bibr" rid="ref-8">8</xref>,
                    <xref ref-type="bibr" rid="ref-9">9</xref>
                </sup>.</p>
            <p>Since observing this unwanted effect of OPV vaccination, along with vaccine-associated paralytic polio (VAPP) and immunodeficiency-associated VDPVs (iVDPVs), removal of OPV from use has been prioritised within the Global Polio Eradication Initiative (GPEI)
                <sup>
                    <xref ref-type="bibr" rid="ref-10">10</xref>,
                    <xref ref-type="bibr" rid="ref-11">11</xref>
                </sup>. Especially for serotype 2, the risks of OPV have begun to outweigh the benefits because OPV use can seed additional outbreaks in susceptible populations, and the continued use of OPV2 was deemed unnecessary
                <sup>
                    <xref ref-type="bibr" rid="ref-12">12</xref>
                </sup>. The Switch from trivalent OPV (tOPV) to bivalent OPV (bOPV), removing serotype 2, was accomplished globally in a two-week period at the end of April 2016
                <sup>
                    <xref ref-type="bibr" rid="ref-13">13</xref>
                </sup>. Instead of the anticipated decrease in circulating VDPVs, in the third- and fourth-years post-Switch, outbreaks and geographic spread of outbreaks have increased.</p>
            <p>The strategy for eradication described in the 2013&#x2013;2018 GPEI Strategic Plan outlines that wild poliovirus should be interrupted whilst strengthening immunization systems, including the introduction of inactivated polio vaccine (IPV)
                <sup>
                    <xref ref-type="bibr" rid="ref-10">10</xref>
                </sup>. Alongside, considerable investment has been made towards transition to a polio-free world that includes containment of all polioviruses, including minimising the risks of unintended release from laboratory facilities, and eventual removal of the OPV (known as cessation)
                <sup>
                    <xref ref-type="bibr" rid="ref-14">14</xref>
                </sup>. This transition phase is needed to ensure that the chances of poliovirus transmission in a susceptible population would be as low as manageable, and that populations would remain protected from outbreaks. The Polio Post-Certification Strategy
                <sup>
                    <xref ref-type="bibr" rid="ref-14">14</xref>
                </sup>, describes the many facets of containing polioviruses, protecting populations, cessation of the OPV and detecting and responding to a polio threat. The Switch from tOPV to bOPV provided the first trial of removing one of the serotypes from the global vaccine supply. Within the Polio Post-Certification Strategy, the pre-cessation (zero-to-one-year post-certification) and immediate post-cessation (two to five years post-certification) were regarded as the time periods where VDPVs were most likely to emerge, where the risk was thought to be highest 12&#x2013;18 months after (in the most recent example) bOPV withdrawal. The period of time until detection is based on modelling which suggests that the cumulative probability of detecting circulating poliovirus is over 99.9% by four years
                <sup>
                    <xref ref-type="bibr" rid="ref-15">15</xref>
                </sup>, but the modelling did not account for weaknesses in surveillance or include specific aspects of VDPV transmission. </p>
            <p>cVDPVs are of particular concern in areas with low to moderate OPV induced immunity, as the virus is able to emerge and maintain transmission
                <sup>
                    <xref ref-type="bibr" rid="ref-9">9</xref>,
                    <xref ref-type="bibr" rid="ref-16">16</xref>
                </sup>. In (mostly high-income) countries with no OPV vaccination, there is minimal risk of VDPV emergence because the source is largely absent, transmission risk is lower, and vaccination coverage with the IPV is usually high. However, other risk factors for cVDPVs include: continued OPV use at low rates of coverage, prior elimination of the corresponding wild poliovirus serotype, insensitive acute flaccid paralysis (AFP) surveillance, and use of monovalent OPV (mOPV) and bOPV in SIAs due to the emergent risk of the live attenuated vaccine
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>,
                    <xref ref-type="bibr" rid="ref-8">8</xref>,
                    <xref ref-type="bibr" rid="ref-17">17</xref>
                </sup>. A novel, genetically stable OPV2 that is a modified version of the existing OPV2 but better retains attenuation is currently in development and has been approved and deployed for emergency use in 2021 in order to mitigate these risk factors
                <sup>
                    <xref ref-type="bibr" rid="ref-18">18</xref>,
                    <xref ref-type="bibr" rid="ref-19">19</xref>
                </sup>.</p>
            <p>Here we provide a retrospective analysis of cVDPV outbreaks between 2004 and 2019 and estimate the time from emergence to detection using publicly available data. We explore the differences in time to detection across VDPV serotypes and examine the effect of AFP surveillance and other factors on the time to detection. The aim is to provide useful information on the time to detection of VDPV outbreaks by serotype and the factors that affect this, in order to inform future cessation planning.</p>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <p>Detection of poliomyelitis outbreaks are dependent upon global surveillance for AFP and the Global Polio Laboratory Network where clinical specimens are investigated to identify poliovirus as the causative agent. To confirm poliovirus infection, at least two stool specimens should be collected 24&#x2013;48 hours apart and within 14 days of the onset of AFP in affected individuals
                <sup>
                    <xref ref-type="bibr" rid="ref-20">20</xref>
                </sup>. All samples undergo confirmatory testing and genetic sequencing at laboratories that are part of The Global Polio Laboratory Network (GPLN) following a standardised protocol to minimise contamination and maximise sensitivity
                <sup>
                    <xref ref-type="bibr" rid="ref-21">21</xref>
                </sup>. Sequencing of the VP1 region of the viral genome is used to classify poliovirus; if the sample differs from the parental OPV strain by 1&#x2013;15% (or from 0.6% for serotype 2), the case is defined as a VDPV
                <sup>
                    <xref ref-type="bibr" rid="ref-9">9</xref>,
                    <xref ref-type="bibr" rid="ref-22">22</xref>
                </sup>. However, this definition changed in 2010 for serotype 2 only, such that prior to 2010, 10 nucleotide mutations in the VP1 region constituted a VDPV, but later on, the cut-off dropped to 6 nucleotide mutations. Therefore, we exclude type 2 outbreaks prior to 2010 (n=16) to account for this change as historic type 2 outbreaks where the isolate had &lt;10 nucleotide mutations would not have been counted as a cVDPV.</p>
            <p>By definition, cVDPV refers to VDPV isolates for which there is evidence of person-to-person transmission in the community and &#x2018;genetically linked VDPVs&#x2019; are isolated from at least two individuals who do not live in the same household, or from one individual and &#x2265;1 environmental surveillance (ES) sample reported through the comprehensive surveillance network
                <sup>
                    <xref ref-type="bibr" rid="ref-11">11</xref>
                </sup>. Within the GPEI surveillance network, cVDPV outbreaks that spread across country borders are treated as separate outbreaks (requiring a response within each country). Here we are only interested in the emergence of new cVDPV outbreaks, and exclude outbreaks as a result of international spread. For example, an emergence first detected in Jigawa State, Nigeria, which has spread to several countries in West Africa is only included once in the dataset. Where possible, the lineage code for each cVDPV2 emergence is provided (extended data Table 1
                <sup>
                    <xref ref-type="bibr" rid="ref-23">23</xref>
                </sup>). </p>
            <p>Poliomyelitis is a notifiable disease, and as part of global surveillance for poliomyelitis, the GPEI and WHO laboratories report all confirmed outbreaks through the Morbidity and Mortality Weekly Reports (MMWR). Consequently, we use these reports to compile a spreadsheet of all cVDPV outbreaks from 2000 to February 2020. Outbreaks were first identified using MMWR reports and then country and year(s) of the outbreak were searched using the search terms: &#x2018;vaccine-derived poliovirus* OR VDPV OR circulating vaccine-derived poliovirus* OR cVDPV&#x2019;. This search criteria is not a systematic review of all literature for polio outbreaks within the time period, but due to the nature of disease surveillance for poliomyelitis, this resulted in a comprehensive list of outbreaks.  The number of nucleotide sequences that are different to the Sabin 2 strain at first detection (referred to as &#x2018;VP1 divergence&#x2019;) and the dates of the first and last isolates of the outbreak were also collated through the literature search. As per exclusion criteria, we did not include outbreaks that did not meet the aforementioned cVDPV definition or were the result of international spread. The annual country-level non-polio acute flaccid paralysis (AFP) rate and percentage of adequate stool specimens collected, both indicators of surveillance quality, were extracted for each outbreak and year corresponding to the start of the outbreak. In order examine the effect of environmental sampling as a supplement to AFP surveillance, the mechanism via which the first isolate was detected (AFP or ES) was ascertained for each outbreak. Additionally, we included WHO region, Diphtheria-Pertussis-Tetanus vaccine dose 3 (DPT3) coverage (which is often used as a marker for routine immunisation coverage), and whether the outbreak was detected before/after 2016. Multiple independent emergences observed within the same country-year unit of observation were treated as multiple observations even if the associated surveillance data and outbreak response remained the same. HF was responsible for initial database creation while MA independently cross-checked the data.</p>
            <p>Variables associated with the number of nucleotide differences were explored using a negative binomial model. A negative binomial model was selected because the variance of the reported number of nucleotide differences was larger than the mean and the data was highly dispersed. The minimum number of mutations was 9 for serotypes 1 and 3, and 6 for serotype 2, and the outcome variable was shifted-left so that the minimum number was 0. Separate datasets were created for serotype 2 and serotypes 1 and 3 to account for the small sample size of types 1 and 3 outbreaks and because of the similar case to infection ratio for serotypes 1 and 3
                <sup>
                    <xref ref-type="bibr" rid="ref-24">24</xref>
                </sup>. The data set for types 1 and 3 retained a covariate for serotype. Preliminary analysis illustrated that outbreaks with nucleotide mutations &#x2265;30 (n=4) affected the fit of the model to the data (due to overdispersion that could not fully be accounted for) and were removed from the dataset as outliers. A multivariate regression model was built using stepwise removal by comparing differences in the Akaike information criteria (AIC) between candidate models and assessing the negative binomial dispersion parameter (&#x03b8;). Interactions between variables were also examined.</p>
            <p>For every VDPV outbreak, we estimate the time to detection using the following methods. Each VDPV outbreak has included with it the number of VP1 mutations associated with the first case(s), and is used to estimate the time to detection. The first VP1 mutation of the Sabin strain is assumed to be instantaneous and each subsequent mutation follows an average rate of 1.14&#x00d7;10
                <sup>-2 </sup>nucleotides per site per year
                <sup>
                    <xref ref-type="bibr" rid="ref-25">25</xref>,
                    <xref ref-type="bibr" rid="ref-26">26</xref>
                </sup>. The VP1 RNA gene consists of 906 nucleotides, so we would expect approximately 1 nucleotide change every 35 days under a constant clock model. We assume that the viral evolution rate is the same across all serotypes
                <sup>
                    <xref ref-type="bibr" rid="ref-27">27</xref>,
                    <xref ref-type="bibr" rid="ref-28">28</xref>
                </sup>. Each independent mutation was modelled using an exponential distribution and the sum of waiting times as an Erlang distribution, as done for a previous analysis of cVDPVs
                <sup>
                    <xref ref-type="bibr" rid="ref-26">26</xref>
                </sup>. By treating each VDPV detection as a random sample of the population parameter for the time to detection, we use bootstrapping of the sample estimates of time to detection to provide robust estimates for serotype 2 and serotypes 1 and 3. The empirical distribution function of the bootstrapped samples were used to calculate the probability of VDPV outbreaks being detected within one and four years. All analyses were carried out in 
                <ext-link ext-link-type="uri" xlink:href="https://www.r-project.org/">R</ext-link> version 4.0.3.</p>
            <p>This work was completed between June 2020 and April 2021 and revised following peer review in April 2022. This project received ethical approval from the London School of Hygiene &amp; Tropical Medicine (LSHTM) on 29
                <sup>th</sup> June 2020: project ID 21929.</p>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <sec>
                <title>Independent cVDPV outbreaks</title>
                <p>Review of MMWR reports identified a total of 96 outbreaks in 28 countries. However, once outliers were excluded and the change of cVDPV2 definition was accounted for and cVDPV2 outbreaks pre-2010 were removed, a total of 74 cVDPV outbreaks as a result of independent emergences were analysed from 24 countries (
                    <xref ref-type="table" rid="T1">Table 1</xref>). cVDPV type 2 was the most frequent serotype isolated, accounting for 80% of outbreaks, followed by serotypes 1 and 3, accounting for 13% and 7% of outbreaks, respectively. Of the 74 outbreaks, 18 (24%) were first detected via ES.</p>
                <table-wrap id="T1" orientation="portrait" position="anchor">
                    <label>Table 1. </label>
                    <caption>
                        <title>Summary of all circulating vaccine derived polioviruses (cVDPVs) included in the analysis split by serotype.</title>
                        <p>WHO=World Health Organization; NPAFP= non-polio acute flaccid paralysis; CI=confidence interval.</p>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="center" colspan="1" rowspan="1" valign="top">WHO
                                    <break/>Region</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Country</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Number of
                                    <break/>outbreaks</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Median
                                    <xref ref-type="other" rid="FN1">*</xref>
                                    <break/>duration days
                                    <break/>(range
                                    <xref ref-type="other" rid="FN1">**</xref>)</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Median
                                    <xref ref-type="other" rid="FN1">*</xref> nucleotide
                                    <break/>difference from
                                    <break/>Sabin strain of
                                    <break/>the first isolate
                                    <break/>(range
                                    <xref ref-type="other" rid="FN1">**</xref>)</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Mean NPAFP
                                    <break/>rate (per
                                    <break/>100,000
                                    <break/>children &lt;15)
                                    <break/>(95% CI)</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Mean %
                                    <break/>adequate stool
                                    <break/>samples
                                    <break/>(95% CI)</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="center" colspan="7" rowspan="1" valign="top">
                                    <bold>Serotype 1</bold>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MADAGASCAR</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">338</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">20</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4.2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">85.6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MOZAMBIQUE</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">112</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">27</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.7</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">87.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AMR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">DOMINICAN REPUBLIC</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">190</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">17</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">-</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">-</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">EUR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">UKRAINE</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">20</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.7</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">97.4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">SEAR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">INDONESIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">139</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">10</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.4</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">85.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">SEAR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MYANMAR</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">258 (59, 458)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">19.5 (14, 25)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.8</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">92.7</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">WPR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">CHINA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">55 (51, 59)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">11 (9, 13)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1.9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">92.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">WPR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">LAOS</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">269</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">21</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">57.1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">WPR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">PAPUA NEW GUINEA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">193</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">14</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7.9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">44.7</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="2" rowspan="1" valign="top">Global Type 1 total </td>
                                <td align="center" colspan="1" rowspan="1" valign="top">10</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">125.5 (7, 458)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">17 (9, 27)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3.2 (1.9, 4.5)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">82.7 (70.2, 95.2)</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="7" rowspan="1" valign="top">
                                    <bold>Serotype 2</bold>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">ANGOLA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">5</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">195 (39, 288)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7 (6, 10)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">5.0</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">85.1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">CENTRAL AFRICAN REPUBLIC</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">99 (0, 275)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7 (6, 10)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">9.2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">71.1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">CHAD</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">184 (97, 270)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">6 (6)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">10.2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">84.6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">DRC</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">12</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">173 (1, 473)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">8 (6, 19)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7.7</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">84.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">ETHIOPIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">94 (41, 151)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">12 (10, 18)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">90.8</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GUINEA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">475</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">12</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">96.6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MOZAMBIQUE</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">57</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3.4</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">88.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">NIGERIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">84 (0, 637)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">10 (6, 16)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">11.9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">95.4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">SOUTH SUDAN</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4.2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">94.4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">TOGO</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">78</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">13</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4.6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">70.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">ZAMBIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">71</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3.8</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">84.3</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">EMR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFGHANISTAN</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1295</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">8</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">11.0</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">92.6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">EMR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">PAKISTAN</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">9</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">58 (8, 654)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">6 (6, 9)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">17.7</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">87.1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">EMR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">SYRIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">202</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">22</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3.6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">80.4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">EMR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">YEMEN</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">179</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3.4</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">91.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">SEAR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MYANMAR</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">172</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">13</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.5</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">93.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">WPR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">CHINA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">300 (113, 487)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">10 (6, 13)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.0</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">92.3</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="2" rowspan="1" valign="top">Global Type 2 total </td>
                                <td align="center" colspan="1" rowspan="1" valign="top">59</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">105 (0, 1295)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">8 (6, 22)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">8.9 (7.3, 10.4)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">86.2 (84.2, 88.2)</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="7" rowspan="1" valign="top">
                                    <bold>Serotype 3</bold>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">ETHIOPIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">556</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">12</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">79.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">AFR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MADAGASCAR</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">32</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">13</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1.3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">89.4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">EMR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">SOMALIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">183</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">14</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4.8</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">97.7</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">EMR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">YEMEN</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">454</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">18</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4.3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">93.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">WPR</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">CAMBODIA</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">50</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">17</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.0</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">95.8</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="2" rowspan="1" valign="top">Global Type 3 total </td>
                                <td align="center" colspan="1" rowspan="1" valign="top">5</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">255</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">14 (12, 18)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3.0 (1.2, 4.8)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">91.0 (81.3, 100)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="2" rowspan="1" valign="top">Total Outbreaks</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">74</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">109 (0, 1295)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">9 (6, 27)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7.7 (6.3, 9.0)</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">86.0 (83.8, 88.2)</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <fn>
                            <p id="FN1">*Median and **range provided if more than 1 outbreak, otherwise single value provided</p>
                        </fn>
                    </table-wrap-foot>
                </table-wrap>
                <p>For serotype 1 (n=10), the median nucleotide divergence for the first isolate of the outbreak was 17 (range: 9, 27) and the mean non-polio AFP rate was 3.2 cases per 100,000 of the population under 15 years of age (95% confidence interval (CI): 1.9-4.5) (
                    <xref ref-type="table" rid="T1">Table 1</xref>). Half (50%) of type 1 outbreaks were contained or closed within 120 days. For serotype 2 (n=59), the median nucleotide divergence for the first isolate of the outbreak was 8 (range: 6, 22) and the mean non-polio AFP rate was 8.9 cases per 100,000 of the population under 15 years of age (95% CI: 7.3, 10.4). The majority of type 2 outbreaks (54%) were contained within 120 days. For serotype 3 (n=5), the median nucleotide divergence for the first isolate of the outbreak was 14 (range: 12, 18) and the mean non-polio AFP rate was 3.0 (95% CI: 1.2, 4.8) cases per 100,000 of the population under 15 years of age. In total, 40% of type 3 outbreaks were contained within 120 days.</p>
                <p>For serotype 2, a regression model of the number of nucleotide differences of the first isolate for each outbreak suggests a decrease in nucleotide difference with increasing non-polio AFP rate and percentage of adequate stool samples collected (incidence rate ratio (IRR) 0.18, 95% CI 0.06-0.49, 
                    <italic toggle="yes">p</italic>&lt;0.01 and IRR 0.91 95% CI 0.84-0.99, 
                    <italic toggle="yes">p</italic>=0.05, respectively), but no significant difference between classification (AFP or ES) (
                    <italic toggle="yes">p</italic>=0.07), 
                    <xref ref-type="table" rid="T2">Table 2</xref>. Despite the non-significant p-value and wide confidence interval that crosses 1.00, the IRR (2.15 95% CI: 0.93, 5.4) provides weak evidence that rate of nucleotide mutations of outbreaks identified via ES is greater when compared to outbreaks first identified through AFP surveillance. Interaction between non-polio AFP rate and percentage of adequate stool samples was significant for both serotype 2 and serotypes 1 and 3 (IRR 1.02 95% CI 1.01-1.04, 
                    <italic toggle="yes">p</italic>&lt;0.01 and IRR 1.01 95% CI 1.0-1.03, 
                    <italic toggle="yes">p</italic>=0.03, respectively). A regression model was attempted for the 15 outbreaks that were either type 1 or 3, but low sample size prevents meaningful interpretation (extended data Table 2
                    <sup>
                        <xref ref-type="bibr" rid="ref-23">23</xref>
                    </sup>). The mean estimates of the regression terms for serotypes 1 and 3 were similar in value to serotype 2 estimates, for example, there was no significant difference in surveillance classification for serotypes 1 and 3 (IRR 0.22, 95% CI 0.04-1.28, 
                    <italic toggle="yes">p</italic>=0.08), but the confidence intervals of the regression estimates were wide, likely due to low sample size.</p>
                <table-wrap id="T2" orientation="portrait" position="anchor">
                    <label>Table 2. </label>
                    <caption>
                        <title>Final regression model of factors associated with the number of nucleotide differences of the first isolate of vaccine derived poliovirus (VDPV) outbreaks.</title>
                        <p>Sample size and dispersion parameter (&#x03b8;) for the serotype 2 model are reported. AFP=acute flaccid paralysis; ES=environmental surveillance; IRR=incidence rate ratio; CI=confidence interval.</p>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="center" colspan="4" rowspan="1" valign="top">Serotype 2 (n = 59)
                                    <break/>&#x03b8; = 0.99</th>
                            </tr>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Variable</bold>
                                </th>
                                <th align="center" colspan="1" rowspan="1" valign="top">
                                    <bold>Factor</bold>
                                </th>
                                <th align="center" colspan="1" rowspan="1" valign="top">
                                    <bold>IRR, multivariable</bold>
                                    <break/>
                                    <bold>(95% CI)</bold>
                                </th>
                                <th align="center" colspan="1" rowspan="1" valign="top">
                                    <bold>P-value</bold>
                                </th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Intercept</bold>
                                </td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">-</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">-</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Unit increase of non-polio AFP rate (cases per 100,000</bold>
                                    <break/>
                                    <bold>children aged &lt;15 years old)</bold>
                                    <break/>Mean (95% CI): 8.9 (7.3, 10.4)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Linear term</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.18 (0.06, 0.49)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">&lt;0.01</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Percent of stool samples adequately collected</bold>
                                    <break/>Mean (95% CI): 86.2 (84.2, 88.2)
                                    <break/>&lt;80%: n = 9 (15%)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Linear term</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.91 (0.84, 0.99)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.047</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Unit increase of non-polio AFP rate * Percent of stool samples</bold>
                                    <break/>
                                    <bold>adequately collected</bold>
                                </td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Interaction term</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">1.02 (1.01, 1.04)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">&lt;0.01</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Type of surveillance via which first isolate was detected (AFP</bold>
                                    <break/>
                                    <bold>case or ES)</bold>
                                    <break/>AFP: n = 42 (71.1%)
                                    <break/>ES: n = 17 (28.8%)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">ES (vs. AFP)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">2.15 (0.93, 5.4)</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.069</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>The effects of non-polio AFP rate on nucleotide differences are shown in 
                    <xref ref-type="fig" rid="f1">Figure 1</xref>, where the negative binomial regression model for serotype 2 is used to predict counts of nucleotide differences. To illustrate the interaction between non-polio AFP rate and percentage of adequate stool samples, 
                    <xref ref-type="fig" rid="f1">Figure 1a</xref> illustrates that as both non-polio AFP rate and percentage of adequate stool increases, predicted nucleotide differences decline. Although the type of surveillance via which the first isolate was detected (AFP case or ES) was not significant in the final model and could act as a confounder, in 
                    <xref ref-type="fig" rid="f1">Figure 1b</xref>, predicted nucleotide differences decrease as non-polio AFP rate increases for both surveillance mechanisms, but to a greater extent for AFP at low rates of non-polio AFP surveillance. </p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <p>(
                            <bold>A</bold>) Predicted counts of nucleotide differences for serotype 2 based on the final negative binomial regression model vs. non-polio AFP rate (per 100,00 children &lt;15 years of age). The different colour lines correspond to varying percentages of adequate stool samples collected and the shaded regions represent a 95% confidence interval of model predictions. The different colour points also correspond to varying percentages of adequate stool samples collected, but represent data from a particular cVDPV2 outbreak. (
                            <bold>B</bold>) Predicted counts of nucleotide differences for serotype 2 based on the final negative binomial regression model vs. non-polio AFP rate (per 100,00 children &lt;15 years of age). The different colour lines correspond to the type of surveillance via which the first isolate was detected and the shaded regions represent a 95% confidence interval of model predictions. The different colour points also correspond to the type of surveillance via which the first isolate was detected, but represent data from a particular cVDPV2 outbreak. In both figures, the black dashed line represents the minimum threshold cut-off of nucleotide differences (n=6) to be considered a cVDPV2.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14920/a6bd0352-5d77-4e33-9483-356ddfc3302c_figure1.gif"/>
                </fig>
                <p>Model residuals (
                    <xref ref-type="fig" rid="f2">Figure 2a</xref>) for the serotype 2 model support an appropriate model structure as the plot illustrates homoscedasticity of the residuals. The Q-Q plot (
                    <xref ref-type="fig" rid="f2">Figure 2b</xref>) further supports the assumed theoretical distribution for the final models as most values are centred along the Q-Q line, but the extreme values illustrate deviation from the assumed normal distribution of residuals. 
                    <xref ref-type="fig" rid="f2">Figure 2c</xref> provides a visual comparison of expected vs. observed frequencies of nucleotide mutations. For serotype 2, outbreak frequencies corresponding to 6, 13, 19 and 22 nucleotide mutations are under-estimated by the model. Similar figures for serotypes 1 and 3 can be found in extended data Figure 1
                    <sup>
                        <xref ref-type="bibr" rid="ref-23">23</xref>
                    </sup>.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Serotype 2 diagnostic plots.</title>
                        <p>(
                            <bold>A</bold>) residual vs. fitted values, (
                            <bold>B</bold>) Normal Q-Q plot and (
                            <bold>C</bold>) Expected vs. observed frequencies of nucleotide mutations assuming a negative binomial distribution. 
                            <xref ref-type="fig" rid="f2">Figure 2A</xref> shows how far the fitted values vary from the residual values, the closer to the red dashed line, the better fit. 
                            <xref ref-type="fig" rid="f2">Figure 2B</xref> is used to analyse the distribution of the data. Because several points at the bottom left of the figure deviate from the Q-Q line, the data is positively skewed towards lower nucleotide mutations.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14920/a6bd0352-5d77-4e33-9483-356ddfc3302c_figure2.gif"/>
                </fig>
            </sec>
            <sec>
                <title>Estimating the time to outbreak detection</title>
                <p>The time to detection was estimated for each outbreak, including uncertainty intervals (
                    <xref ref-type="fig" rid="f3">Figure 3</xref>). Using the bootstrap method, the median time from seeding until outbreak detection for serotype 1 (n=10), was 284.3 (95% UI 284.3-2007.8) days and it was estimated that 91.5% of outbreaks would be detected within four years. The median time from seeding until outbreak detection for serotype 2 (n=59) was 276.1 (95% UI 172.3-764.8) days and 99.7% of outbreaks are estimated to be detected within four years. For serotype 3 (n=5), the median time from seeding until outbreak detection was 472.4 (95% UI 392.1-603.1) days and it was estimated that 100% of outbreaks would be detected within four years. Using the full uncertainty of the estimated time to detection, 20 of the 59 (34%) outbreaks of serotype 2 were detected under one year, whereas no serotype 1 or 3 outbreaks were detected within one year.</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Estimated time to detection of each outbreak from the reported number of nucleotide differences from the Sabin strain, by serotype and region.</title>
                        <p>Outbreaks are ordered on the x-axis by increasing time to detection, where uncertainty in the estimates are shown using 95% uncertainty intervals. Dashed lines represent one year (blue) and four years (red). Country names along the x-axis have been abbreviated using a country&#x2019;s corresponding United Nations ISO 3166-1 alpha-3 code and year of first detection.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14920/a6bd0352-5d77-4e33-9483-356ddfc3302c_figure3.gif"/>
                </fig>
            </sec>
        </sec>
        <sec sec-type="discussion">
            <title>Discussion</title>
            <p>Polio eradication has been deemed an achievable undertaking, but with timeline and budget pressures ever present, it is importance to better understand the risks associated with cessation strategies and how to better plan for unwanted events. Emerging and circulating VDPVs are one of many threats to eradication, and detecting cVDPVs early in order to respond and limit transmission in communities will be important throughout the final stages of eradication.</p>
            <p>This analysis illustrates several observations about cVDPV outbreaks. cVDPVs caused by serotype 2 have been more commonly detected than outbreaks caused by serotypes 1 and 3. This observation was apparent between 2000&#x2013;2015 when the trivalent OPV was in use, as well as in subsequent years. When children are vaccinated with the OPV, the serotype 2 strain is more competitive in the gut mucosa
                <sup>
                    <xref ref-type="bibr" rid="ref-29">29</xref>,
                    <xref ref-type="bibr" rid="ref-30">30</xref>
                </sup>, resulting in increased &#x2018;take&#x2019; by vaccinated individuals and subsequently a higher rate of secondary spread. The increased rate of spread was exacerbated post-Switch as a larger proportion of populations were not vaccinated with the serotype 2 strain due to the strategy of cessation. Additionally, a recent modelling study using inference from data on several clinical trials suggests that the order of transmissibility within equivalent populations is in the descending order of serotype 2, 1, and 3, which would further explain the observed frequency of each serotype-specific VDPV outbreak
                <sup>
                    <xref ref-type="bibr" rid="ref-31">31</xref>
                </sup>.</p>
            <p>The number of nucleotide differences at the time of detection did not significantly vary between serotypes. For serotype 1, it has between estimated that there are approximately 200 infections for every case, 2000 infections for a serotype 2 case, and 1000 infections for a serotype 3 case
                <sup>
                    <xref ref-type="bibr" rid="ref-32">32</xref>
                </sup>. Based on differences in the asymptomatic rate, one might expect nucleotide differences of type 1 and 3 to be lower than serotype 2 when first detected, which was not observed. Based on the data from reported outbreaks, detection of cVDPVs does not seem sensitive to differences in symptomatic reporting that is associated with serotype, but may be influenced by unknown differences in where serotype specific detections emerge, which in-turn are affected by surveillance efforts within these countries.</p>
            <p>In countries where ES is present, detection of emergent cVDPVs has previously been shown to be quicker than if surveillance relied on AFP alone
                <sup>
                    <xref ref-type="bibr" rid="ref-33">33</xref>
                </sup>. Here, we identified weak evidence that outbreaks detected through ES had higher nucleotide divergence, which is contradictory. However, ES is likely placed in locations with known risks of poliovirus transmission and potential challenges in AFP reporting, which may potentially bias findings. Although WHO region did not account for differences in detection time, ES is more commonly implemented across the AFR and EMR regions in comparison to other WHO regions. The total number of active ES sites across AFR, EMR and SEAR WHO regions was 620 in 2020, a 15% increase in the number of reported active ES sites in 2019
                <sup>
                    <xref ref-type="bibr" rid="ref-34">34</xref>
                </sup>, but the percentage of the population within a catchment area remains comparatively low and poorly measured. While ES remains a useful source for detecting circulating viruses, its low coverage will mean that ES can only supplement AFP surveillance to enable rapid detection of VDPVs.</p>
            <p>The relationship between non-polio AFP rate and time to detection illustrates that in order to detect VDPVs early, a country needs to maintain a high rate of non-polio AFP surveillance. Now that wild poliovirus has been eliminated from the African continent, there may be incentive to reduce the intensity of non-polio AFP surveillance in the region. However, in line with the Global Polio Eradication Initiative Strategic Plan 2019&#x2013;2023, which calls for closing gaps and strengthening global surveillance, this analysis has illustrated the importance of maintaining a high rate of non-polio AFP surveillance, especially for timely detection of cVDPVs
                <sup>
                    <xref ref-type="bibr" rid="ref-11">11</xref>
                </sup>. While higher NPAFP rates well beyond the minimal threshold for quality are more predictive of earlier cVDPV detection, this does not necessarily mean that the surveillance standard is too low. Instead, this suggests that while standards are in place, they perhaps do not accurately capture localised issues that may mitigate surveillance sensitivity. Accurate rates of clinical syndrome that are not associated with poliovirus (i.e., Guillain-Barr&#x00e9; syndrome) would need to be detected with greater sensitivity to ensure true cases of poliovirus are not missed
                <sup>
                    <xref ref-type="bibr" rid="ref-35">35</xref>
                </sup>. The most recent GPEI protocol for responding to poliovirus outbreaks describes NPAFP goals and how recommended levels of surveillance may vary across high-risk areas versus smaller areas with fewer children under 15 years of age
                <sup>
                    <xref ref-type="bibr" rid="ref-36">36</xref>
                </sup>. Therefore, as cVDPVs remain a threat, AFP surveillance must remain high in all areas with OPV use and/or suboptimal IPV coverage. Low rates of NPAFP surveillance that persist across many settings coupled with the low case to infection rate for polio means undetected transmission is possible in many areas, jeopardising the attainment of polio eradication. As the risk of importation of infection across the African continent increases following the 2021 WPV1 importation in Malawi
                <sup>
                    <xref ref-type="bibr" rid="ref-37">37</xref>
                </sup>, adopting strategies to improve surveillance are increasingly important.</p>
            <p>Adequate stool describes both the timeliness and quality of the samples (i.e., collected within 14 days of paralysis onset, 24&#x2013;48 hours apart, and arrival at the laboratory in &#x201c;good&#x201d; condition) and current WHO guidelines state that at least 80% of AFP cases should have stool collection described as adequate, which this analysis further supports
                <sup>
                    <xref ref-type="bibr" rid="ref-38">38</xref>
                </sup>. However, while the mean percentage of adequate stool specimens in this analysis exceeds 80% for all serotypes, 15% and 20% of outbreaks of serotypes 2 and serotypes 1 and 3, respectively, fall below this targeted 80%. Also, this indicator is often reported at the national level while research suggests that percentage of adequate stool specimens is not only disparate at subnational levels, but particular age groups are not well-covered by the surveillance system and some countries report inaccurate rates of adequate stool specimen collection
                <sup>
                    <xref ref-type="bibr" rid="ref-39">39</xref>
                </sup>. After accounting for factors other than WHO regions, WHO region did not remain a significant explanatory variable, suggesting region specific differences do not account for nucleotide divergences as much as surveillance quality (both non-polio AFP rate and percentage of adequate stool samples collected).</p>
            <p>Of the cVDPV2 outbreaks that were seeded post-Switch, the source of about 95% of isolates was found to be consistent with mOPV2 outbreak response campaigns
                <sup>
                    <xref ref-type="bibr" rid="ref-26">26</xref>
                </sup>. This has been due to the inherent nature of mOPV2, and likely poorly implemented campaigns, and also because children recently vaccinated with mOPV2, or their contacts, travelled outside the response zones to areas where children born after the Switch were fully susceptible to infection
                <sup>
                    <xref ref-type="bibr" rid="ref-40">40</xref>
                </sup>. The need to improve these response campaigns has been recognised with an addendum to the Polio Endgame Strategy 2019&#x2013;2023, whereby the strategy is to implement actions such as enhanced outbreak response campaigns and ensure sufficient supply of mOPV2 to diminish immunisation gaps
                <sup>
                    <xref ref-type="bibr" rid="ref-10">10</xref>
                </sup>. The novel OPV2 vaccine is expected to replace the mOPV in 2021&#x2013;2022 (subject to findings during emergency use licensure), reducing the risk of cVDPV2 emergence. As illustrated in this analysis, emergences of cVDPV2 from mOPV2 are likely to continue for up to four years after the last mOPV2 campaign, meaning that nOPV2 use in outbreak response will be required for at least this period of time.</p>
            <p>A weakness of our approach is that we assume that VDPV mutations occur at a constant and independent rate. In reality, multiple mutations may result in a reduction in nucleotide divergence (through back mutations). Consequently, our estimates may under-estimate the time to detection. Additionally, we have not used data on ambiguous (aVDPVs &#x2013; progenitors to cVDPVs) to observe the frequency of detection across WHO regions. Inclusion of this data may provide further insight on factors associated with detection, but is reliant on consistent laboratory reporting of aVDPVs across WHO regions. Additionally, this analysis was a retrospective analysis of cVDPV outbreaks where few countries have included IPV into routine immunisation, meaning that we were unable to explore any effects of IPV on VDPV detection. Furthermore, this analysis was done at the national level, where no relationship between RI coverage and time to detection was observed. We recognise that at a smaller geographical level, the relationship between RI coverage may have a stronger relationship with time to detection, highlighting a potential type 1 error and limitation to this analysis.</p>
            <p>In conclusion, this analysis of cVDPV outbreaks illustrates that surveillance for AFP&#x2014;ensuring a high non-polio AFP rate with adequate stool collection&#x2014;can result in quick detection of cVDPV outbreaks, having the potential to prevent transmission and subsequent cases in populations. In all regions, undetected circulation of poliovirus will remain an issue until the current OPV vaccines are no longer necessary. </p>
        </sec>
        <sec>
            <title>Data availability</title>
            <sec>
                <title>Underlying data</title>
                <p>Zenodo: mauzenbergs/polio_vdpv: VDPV Extended Data. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.4776357">https://doi.org/10.5281/zenodo.4776357</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-23">23</xref>
                    </sup>.</p>
                <p>This project contains the following underlying data:</p>
                <list list-type="bullet">
                    <list-item>
                        <label>- </label>
                        <p>VDPV_dat.csv</p>
                    </list-item>
                </list>
            </sec>
            <sec>
                <title>Extended data</title>
                <p>Zenodo: mauzenbergs/polio_vdpv: VDPV Extended Data. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.4776357">https://doi.org/10.5281/zenodo.4776357</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-23">23</xref>
                    </sup>.</p>
                <p>This project contains the following underlying data:</p>
                <list list-type="bullet">
                    <list-item>
                        <label>- </label>
                        <p>VDPV_Extended_Data.pdf</p>
                    </list-item>
                </list>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero "No rights reserved" data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
        <sec>
            <title>Software availability</title>
            <p>Source code available from: 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/mauzenbergs/polio_vdpv">https://github.com/mauzenbergs/polio_vdpv</ext-link>
            </p>
            <p>Archived source code at time of publication:</p>
            <p>
                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.4776357">https://doi.org/10.5281/zenodo.4776357</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-23">23</xref>
                </sup>
            </p>
            <p>License: 
                <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero "No rights reserved" data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgements</title>
            <p>We thank members of the GPEI Risk Assessment Working Group, where discussions have been helpful in developing this analysis. We also thank Stephanie Kovacs from the Centers for Disease Control and Prevention who provided valuable insight on methodology and manuscript edits. Original database creation was completed as part fulfilment of HF&#x2019;s MSc degree at the London School of Hygiene and Tropical Medicine. Scientists from the Institute for Disease Modeling at the Foundation are co-authors and were involved in the analysis of data, preparation of the manuscript, and the decision to submit for publication.</p>
        </ack>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <collab>World Health Organization</collab>:
                    <article-title>Global eradication of poliomyelitis by the year 2000.</article-title>
                    <source>

                        <italic toggle="yes">Weekly Epidemiological Record.</italic>
</source>
                    <year>1988</year>;<volume>63</volume>(<issue>22</issue>):<fpage>161</fpage>&#x2013;<lpage>2</lpage>.
                    <ext-link ext-link-type="uri" xlink:href="https://apps.who.int/iris/handle/10665/226729">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thompson</surname>
                            <given-names>KM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kalkowska</surname>
                            <given-names>DA</given-names>
                        </name>
</person-group>:
                    <article-title>Review of poliovirus modeling performed from 2000 to 2019 to support global polio eradication.</article-title>
                    <source>

                        <italic toggle="yes">Expert Rev Vaccines.</italic>
</source>
                    <year>2020</year>;<volume>19</volume>(<issue>7</issue>):<fpage>661</fpage>&#x2013;<lpage>86</lpage>.
                    <pub-id pub-id-type="pmid">32741232</pub-id>
                    <pub-id pub-id-type="doi">10.1080/14760584.2020.1791093</pub-id>
                    <pub-id pub-id-type="pmcid">7497282</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Razum</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sridhar</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jahn</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Polio: from eradication to systematic, sustained control.</article-title>
                    <source>

                        <italic toggle="yes">BMJ Glob Health.</italic>
</source>
                    <year>2019</year>;<volume>4</volume>(<issue>4</issue>):<fpage>e001633</fpage>.
                    <pub-id pub-id-type="pmid">31544903</pub-id>
                    <pub-id pub-id-type="doi">10.1136/bmjgh-2019-001633</pub-id>
                    <pub-id pub-id-type="pmcid">6730569</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <collab>World Health Organization</collab>:
                    <article-title>Africa&#x2019;s wild polio-free status to be determined in August.</article-title>
                    <year> 2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.afro.who.int/news/africas-wild-polio-free-status-be-determined-august">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Parker</surname>
                            <given-names>EP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Molodecky</surname>
                            <given-names>NA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pons-Salort</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Impact of inactivated poliovirus vaccine on mucosal immunity: implications for the polio eradication endgame.</article-title>
                    <source>

                        <italic toggle="yes">Expert Rev Vaccines.</italic>
</source>
                    <year>2015</year>;<volume>14</volume>(<issue>8</issue>):<fpage>1113</fpage>&#x2013;<lpage>23</lpage>.
                    <pub-id pub-id-type="pmid">26159938</pub-id>
                    <pub-id pub-id-type="doi">10.1586/14760584.2015.1052800</pub-id>
                    <pub-id pub-id-type="pmcid">4673562</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>O&#x2019;Reilly</surname>
                            <given-names>KM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lamoureux</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Molodecky</surname>
                            <given-names>NA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An assessment of the geographical risks of wild and vaccine-derived poliomyelitis outbreaks in Africa and Asia.</article-title>
                    <source>

                        <italic toggle="yes">BMC Infect Dis.</italic>
</source>
                    <year>2017</year>;<volume>17</volume>(<issue>1</issue>):<fpage>367</fpage>.
                    <pub-id pub-id-type="pmid">28549485</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12879-017-2443-4</pub-id>
                    <pub-id pub-id-type="pmcid">5446690</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fine</surname>
                            <given-names>PE</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Carneiro</surname>
                            <given-names>IA</given-names>
                        </name>
</person-group>:
                    <article-title>Transmissibility and persistence of oral polio vaccine viruses: implications for the global poliomyelitis eradication initiative.</article-title>
                    <source>

                        <italic toggle="yes">Am J Epidemiol.</italic>
</source>
                    <year>1999</year>;<volume>150</volume>(<issue>10</issue>):<fpage>1001</fpage>&#x2013;<lpage>21</lpage>.
                    <pub-id pub-id-type="pmid">10568615</pub-id>
                    <pub-id pub-id-type="doi">10.1093/oxfordjournals.aje.a009924</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Burns</surname>
                            <given-names>CC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Diop</surname>
                            <given-names>OM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sutter</surname>
                            <given-names>RW</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Vaccine-derived polioviruses.</article-title>
                    <source>

                        <italic toggle="yes">J Infect Dis.</italic>
</source>
                    <year>2014</year>;<volume>210 Suppl 1</volume>:<fpage>S283</fpage>&#x2013;<lpage>93</lpage>.
                    <pub-id pub-id-type="pmid">25316847</pub-id>
                    <pub-id pub-id-type="doi">10.1093/infdis/jiu295</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pons-Salort</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Burns</surname>
                            <given-names>CC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lyons</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Preventing vaccine-derived poliovirus emergence during the polio endgame.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Pathog.</italic>
</source>
                    <year>2016</year>;<volume>12</volume>(<issue>7</issue>):<fpage>e1005728</fpage>.
                    <pub-id pub-id-type="pmid">27384947</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.ppat.1005728</pub-id>
                    <pub-id pub-id-type="pmcid">4934862</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <collab>Global  Polio  Eradication  Initiative</collab>:
                    <article-title>Polio eradication and endgame: strategic  plan  2013&#x2013; 2018.</article-title>Geneva: World Health Organization,<year> 2013</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://polioeradication.org/who-we-are/strategic-plan-2013-2018/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <collab>Global Polio Eradication Initiative</collab>:
                    <article-title>Polio endgame strategy 2019-2023: eradication, integration, certification and containment.</article-title>World Health Organization,<year> 2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://polioeradication.org/wp-content/uploads/2019/06/english-polio-endgame-strategy.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thompson</surname>
                            <given-names>KM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Duintjer Tebbens</surname>
                            <given-names>RJ</given-names>
                        </name>
</person-group>:
                    <article-title>Modeling the dynamics of oral poliovirus vaccine cessation.</article-title>
                    <source>

                        <italic toggle="yes">J Infect Dis.</italic>
</source>
                    <year>2014</year>;<volume>210 Suppl 1</volume>:<fpage>S475</fpage>&#x2013;<lpage>84</lpage>.
                    <pub-id pub-id-type="pmid">25316870</pub-id>
                    <pub-id pub-id-type="doi">10.1093/infdis/jit845</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ramirez Gonzalez</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Farrell</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Menning</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Implementing the synchronized global switch from trivalent to bivalent oral polio vaccines&#x2014;lessons learned from the global perspective.</article-title>
                    <source>

                        <italic toggle="yes">J Infect Dis.</italic>
</source>
                    <year>2017</year>;<volume>216</volume>(<issue>suppl_ 1</issue>):<fpage>S183</fpage>&#x2013;<lpage>S92</lpage>.
                    <pub-id pub-id-type="pmid">28838179</pub-id>
                    <pub-id pub-id-type="doi">10.1093/infdis/jiw626</pub-id>
                    <pub-id pub-id-type="pmcid">5854099</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <collab>World Health Organization</collab>:
                    <article-title>Polio Post-Certification Strategy: a risk mitigation strategy for a polio-free world.</article-title>
                    <year> 2018</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.google.com/url?sa=t&amp;rct=j&amp;q=&amp;esrc=s&amp;source=web&amp;cd=&amp;cad=rja&amp;uact=8&amp;ved=2ahUKEwjLoOHqrbv3AhXOzDgGHW8EAkkQFnoECAwQAQ&amp;url=https://polioeradication.org/wp-content/uploads/2018/04/polio-post-certification-strategy-20180424-2.pdf&amp;usg=AOvVaw1Jx80X95ntR14ACejqvfBe">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eichner</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dietz</surname>
                            <given-names>K</given-names>
                        </name>
</person-group>:
                    <article-title>Eradication of Poliomyelitis: When Can One Be Sure That Polio Virus Transmission Has Been Terminated?</article-title>
                    <source>

                        <italic toggle="yes">Am J Epidemiol.</italic>
</source>
                    <year>1996</year>;<volume>143</volume>(<issue>8</issue>):<fpage>816</fpage>&#x2013;<lpage>22</lpage>.
                    <pub-id pub-id-type="pmid">8610692</pub-id>
                    <pub-id pub-id-type="doi">10.1093/oxfordjournals.aje.a008820</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>McCarthy</surname>
                            <given-names>KA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chabot-Couture</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Famulare</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The risk of type 2 oral polio vaccine use in post-cessation outbreak response.</article-title>
                    <source>

                        <italic toggle="yes">BMC Med.</italic>
</source>
                    <year>2017</year>;<volume>15</volume>(<issue>1</issue>):<fpage>175</fpage>.
                    <pub-id pub-id-type="pmid">28974220</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12916-017-0937-y</pub-id>
                    <pub-id pub-id-type="pmcid">5627419</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Konopka-Anstadt</surname>
                            <given-names>JL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Campagnoli</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vincent</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Development of a new oral poliovirus vaccine for the eradication end game using codon deoptimization.</article-title>
                    <source>

                        <italic toggle="yes">NPJ Vaccines.</italic>
</source>
                    <year>2020</year>;<volume>5</volume>(<issue>1</issue>):<fpage>26</fpage>.
                    <pub-id pub-id-type="pmid">33580064</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41541-020-0176-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>van Damme</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>de Coster</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bandyopadhyay</surname>
                            <given-names>AS</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The safety and immunogenicity of two novel live attenuated monovalent (serotype 2) oral poliovirus vaccines in healthy adults: a double-blind, single-centre phase 1 study.</article-title>
                    <source>

                        <italic toggle="yes">Lancet.</italic>
</source>
                    <year>2019</year>;<volume>394</volume>(<issue>10193</issue>):<fpage>148</fpage>&#x2013;<lpage>58</lpage>.
                    <pub-id pub-id-type="pmid">31174831</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S0140-6736(19)31279-6</pub-id>
                    <pub-id pub-id-type="pmcid">6626986</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kalkowska</surname>
                            <given-names>DA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pallansch</surname>
                            <given-names>MA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wilkinson</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Updated Characterization of Outbreak Response Strategies for 2019-2029: Impacts of Using a Novel Type 2 Oral Poliovirus Vaccine Strain.</article-title>
                    <source>

                        <italic toggle="yes">Risk Anal.</italic>
</source>
                    <year>2021</year>;<volume>41</volume>(<issue>2</issue>):<fpage>329</fpage>&#x2013;<lpage>348</lpage>.
                    <pub-id pub-id-type="pmid">33174263</pub-id>
                    <pub-id pub-id-type="doi">10.1111/risa.13622</pub-id>
                    <pub-id pub-id-type="pmcid">7887065</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <collab>World Health Organization</collab>:
                    <article-title>WHO&#x2013;recommended standards for surveillance of selected vaccine-preventable diseases.</article-title>Geneva: World Health Organization,<year>1999</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://apps.who.int/iris/handle/10665/64165">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <collab>Global Polio Laboratory Network</collab>:
                    <article-title>Guidance Paper 5: Reporting Vaccine Derived Polioviruses (VDPVs). </article-title>
                    <year>2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://polioeradication.org/wp-content/uploads/2020/01/GP5-VDPV-Reporting-for-SEQ-Lab-Vs1.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kew</surname>
                            <given-names>OM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sutter</surname>
                            <given-names>RW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>de Gourville</surname>
                            <given-names>EM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Vaccine-derived polioviruses and the endgame strategy for global polio eradication.</article-title>
                    <source>

                        <italic toggle="yes">Annu Rev Microbiol.</italic>
</source>
                    <year>2005</year>;<volume>59</volume>:<fpage>587</fpage>&#x2013;<lpage>635</lpage>.
                    <pub-id pub-id-type="pmid">16153180</pub-id>
                    <pub-id pub-id-type="doi">10.1146/annurev.micro.58.030603.123625</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Auzenbergs</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fountain</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Macklin</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>mauzenbergs/polio_vdpv: VDPV Extended Data.</article-title>(Version V1).
                    <source>

                        <italic toggle="yes">Zenodo.</italic>
</source>
                    <year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.5281/zenodo.4776357">http://www.doi.org/10.5281/zenodo.4776357</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Molodecky</surname>
                            <given-names>NA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jafari</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Safdar</surname>
                            <given-names>RM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Modelling the spread of serotype-2 vaccine derived-poliovirus outbreak in Pakistan and Afghanistan to inform outbreak control strategies in the context of the COVID-19 pandemic.</article-title>
                    <source>

                        <italic toggle="yes">Vaccine.</italic>
</source>
                    <year>2021</year>;<fpage>S0264-410X(21)01228-7</fpage>.
                    <pub-id pub-id-type="pmid">34629206</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.vaccine.2021.09.037</pub-id>
                    <pub-id pub-id-type="pmcid">8463303</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-25">
                <label>25</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Burns</surname>
                            <given-names>CC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shaw</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jorba</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Multiple independent emergences of type 2 vaccine-derived polioviruses during a large outbreak in northern Nigeria.</article-title>
                    <source>

                        <italic toggle="yes">J Virol.</italic>
</source>
                    <year>2013</year>;<volume>87</volume>(<issue>9</issue>):<fpage>4907</fpage>&#x2013;<lpage>22</lpage>.
                    <pub-id pub-id-type="pmid">23408630</pub-id>
                    <pub-id pub-id-type="doi">10.1128/JVI.02954-12</pub-id>
                    <pub-id pub-id-type="pmcid">3624331</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-26">
                <label>26</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Macklin</surname>
                            <given-names>GR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>O'Reilly</surname>
                            <given-names>KM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Grassly</surname>
                            <given-names>NC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Evolving epidemiology of poliovirus serotype 2 following withdrawal of the serotype 2 oral poliovirus vaccine.</article-title>
                    <source>

                        <italic toggle="yes">Science.</italic>
</source>
                    <year>2020</year>;<volume>368</volume>(<issue>6489</issue>):<fpage>401</fpage>&#x2013;<lpage>5</lpage>.
                    <pub-id pub-id-type="pmid">32193361</pub-id>
                    <pub-id pub-id-type="doi">10.1126/science.aba1238</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-27">
                <label>27</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kew</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pallansch</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Breaking the Last Chains of Poliovirus Transmission: Progress and Challenges in Global Polio Eradication.</article-title>
                    <source>

                        <italic toggle="yes">Annu Rev Virol.</italic>
</source>
                    <year>2018</year>;<volume>5</volume>(<issue>1</issue>):<fpage>427</fpage>&#x2013;<lpage>51</lpage>.
                    <pub-id pub-id-type="pmid">30001183</pub-id>
                    <pub-id pub-id-type="doi">10.1146/annurev-virology-101416-041749</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-28">
                <label>28</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jorba</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Campagnoli</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>De</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Calibration of multiple poliovirus molecular clocks covering an extended evolutionary range.</article-title>
                    <source>

                        <italic toggle="yes">J Virol.</italic>
</source>
                    <year>2008</year>;<volume>82</volume>(<issue>9</issue>):<fpage>4429</fpage>&#x2013;<lpage>40</lpage>.
                    <pub-id pub-id-type="pmid">18287242</pub-id>
                    <pub-id pub-id-type="doi">10.1128/JVI.02354-07</pub-id>
                    <pub-id pub-id-type="pmcid">2293050</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-29">
                <label>29</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Patriarca</surname>
                            <given-names>PA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wright</surname>
                            <given-names>PF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>John</surname>
                            <given-names>TJ</given-names>
                        </name>
</person-group>:
                    <article-title>Factors Affecting the Immunogenicity of Oral Poliovirus Vaccine in Developing Countries: Review.</article-title>
                    <source>

                        <italic toggle="yes">Rev Infect Dis.</italic>
</source>
                    <year>1991</year>;<volume>13</volume>(<issue>5</issue>):<fpage>926</fpage>&#x2013;<lpage>39</lpage>.
                    <pub-id pub-id-type="pmid">1660184</pub-id>
                    <pub-id pub-id-type="doi">10.1093/clinids/13.5.926</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-30">
                <label>30</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Samoilovich</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Roivainen</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Titov</surname>
                            <given-names>LP</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Serotype&#x2010;specific mucosal immune response and subsequent poliovirus replication in vaccinated children.</article-title>
                    <source>

                        <italic toggle="yes">J Med Virol.</italic>
</source>
                    <year>2003</year>;<volume>71</volume>(<issue>2</issue>):<fpage>274</fpage>&#x2013;<lpage>80</lpage>.
                    <pub-id pub-id-type="pmid">12938203</pub-id>
                    <pub-id pub-id-type="doi">10.1002/jmv.10480</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-31">
                <label>31</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Famulare</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Selinger</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>McCarthy</surname>
                            <given-names>KA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Assessing the stability of polio eradication after the withdrawal of oral polio vaccine.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Biol.</italic>
</source>
                    <year>2018</year>;<volume>16</volume>(<issue>4</issue>):<fpage>e2002468</fpage>.
                    <pub-id pub-id-type="pmid">29702638</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pbio.2002468</pub-id>
                    <pub-id pub-id-type="pmcid">5942853</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-32">
                <label>32</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nathanson</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kew</surname>
                            <given-names>OM</given-names>
                        </name>
</person-group>:
                    <article-title>From emergence to eradication: the epidemiology of poliomyelitis deconstructed.</article-title>
                    <source>

                        <italic toggle="yes">Am J Epidemiol.</italic>
</source>
                    <year>2010</year>;<volume>172</volume>(<issue>11</issue>):<fpage>1213</fpage>&#x2013;<lpage>29</lpage>.
                    <pub-id pub-id-type="pmid">20978089</pub-id>
                    <pub-id pub-id-type="doi">10.1093/aje/kwq320</pub-id>
                    <pub-id pub-id-type="pmcid">2991634</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-33">
                <label>33</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cowger</surname>
                            <given-names>TL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Burns</surname>
                            <given-names>CC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sharif</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The role of supplementary environmental surveillance to complement acute flaccid paralysis surveillance for wild poliovirus in Pakistan - 2011-2013.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2017</year>;<volume>12</volume>(<issue>7</issue>):<fpage>e0180608</fpage>.
                    <pub-id pub-id-type="pmid">28742803</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0180608</pub-id>
                    <pub-id pub-id-type="pmcid">5526532</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-34">
                <label>34</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zomahoun</surname>
                            <given-names>DJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Burman</surname>
                            <given-names>AL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Snider</surname>
                            <given-names>CJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Impact of COVID-19 Pandemic on Global Poliovirus Surveillance.</article-title>
                    <source>

                        <italic toggle="yes">MMWR Morb Mortal Wkly Rep.</italic>
</source>
                    <year>2021</year>;<volume>69</volume>(<issue>5152</issue>):<fpage>1648</fpage>&#x2013;<lpage>52</lpage>.
                    <pub-id pub-id-type="pmid">33382673</pub-id>
                    <pub-id pub-id-type="doi">10.15585/mmwr.mm695152a4</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-35">
                <label>35</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tangermann</surname>
                            <given-names>RH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lamoureux</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tallis</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The critical role of acute flaccid paralysis surveillance in the Global Polio Eradication Initiative.</article-title>
                    <source>

                        <italic toggle="yes">Int Health.</italic>
</source>
                    <year>2017</year>;<volume>9</volume>(<issue>3</issue>):<fpage>156</fpage>&#x2013;<lpage>63</lpage>.
                    <pub-id pub-id-type="pmid">28582560</pub-id>
                    <pub-id pub-id-type="doi">10.1093/inthealth/ihx016</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-36">
                <label>36</label>
                <mixed-citation publication-type="journal">
                    <collab>Global Polio Eradication Initiative</collab>:
                    <article-title>Standard operating procedures: responding to a poliovirus event or outbreak. </article-title>
                    <year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://polioeradication.org/wp-content/uploads/2022/04/Standard-Operating-Procedures-For-Responding-to-a-Poliovirus-Event-Or-Outbreak-20220417_OBR_SOP_final_pre_pub_website.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-37">
                <label>37</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>McCarthy</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Howard</surname>
                            <given-names>W</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yousif</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The show is not over&#x2013;wild-type polio in Malawi is a wake up call and an opportunity for elimination efforts.</article-title>
                    <source>

                        <italic toggle="yes">Int J Infect Dis.</italic>
</source>
                    <year>2022</year>;<volume>119</volume>:<fpage>32</fpage>&#x2013;<lpage>33</lpage>.
                    <pub-id pub-id-type="pmid">35257902</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.ijid.2022.03.004</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-38">
                <label>38</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Porter</surname>
                            <given-names>KA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Diop</surname>
                            <given-names>OM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Burns</surname>
                            <given-names>CC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Tracking progress toward polio eradication - worldwide, 2013-2014.</article-title>
                    <source>

                        <italic toggle="yes">MMWR Morb Mortal Wkly Rep.</italic>
</source>
                    <year>2015</year>;<volume>64</volume>(<issue>15</issue>):<fpage>415</fpage>&#x2013;<lpage>20</lpage>.
                    <pub-id pub-id-type="pmid">25905895</pub-id>
                    <pub-id pub-id-type="pmcid">5779548</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-39">
                <label>39</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>VanderEnde</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Voorman</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Khan</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>New analytic approaches for analyzing and presenting polio surveillance data to supplement standard performance indicators.</article-title>
                    <source>

                        <italic toggle="yes">Vaccine X.</italic>
</source>
                    <year>2020</year>;<volume>4</volume>:<fpage>100059</fpage>.
                    <pub-id pub-id-type="pmid">32215368</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.jvacx.2020.100059</pub-id>
                    <pub-id pub-id-type="pmcid">7090369</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-40">
                <label>40</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alleman</surname>
                            <given-names>MM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jorba</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Greene</surname>
                            <given-names>SA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Update on vaccine-derived poliovirus outbreaks - worldwide, July 2019-February 2020.</article-title>
                    <source>

                        <italic toggle="yes">MMWR Morb Mortal Wkly Rep.</italic>
</source>
                    <year>2020</year>;<volume>69</volume>(<issue>16</issue>):<fpage>489</fpage>&#x2013;<lpage>495</lpage>.
                    <pub-id pub-id-type="pmid">32324719</pub-id>
                    <pub-id pub-id-type="doi">10.15585/mmwr.mm6916a1</pub-id>
                    <pub-id pub-id-type="pmcid">7188410</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report32023">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14920.r32023</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Closser</surname>
                        <given-names>Svea</given-names>
                    </name>
                    <xref ref-type="aff" rid="r32023a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r32023a1">
                    <label>1</label>Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>In the past five years, I have received research funding from the Bill and Melinda Gates Foundation.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>7</day>
                <month>6</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Closser S</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport32023" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13272.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>I appreciate the authors' careful consideration of the reviewers' comments.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>I am an anthropologist who has been studying the polio eradication program for more than 15 years.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report31648">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14511.r31648</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Closser</surname>
                        <given-names>Svea</given-names>
                    </name>
                    <xref ref-type="aff" rid="r31648a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r31648a1">
                    <label>1</label>Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>In the past five years, I have received grant funding from the Bill and Melinda Gates Foundation, and have worked closely with other GPEI partner institutions including WHO and UNICEF. I confirm that this potential conflict of interest did not affect my ability to write an objective and unbiased review of the article.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>10</day>
                <month>3</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Closser S</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport31648" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13272.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This is a very clearly written and well presented paper about the critically important issue of cVDPV outbreaks, with the conclusions presented logically and reasonably. Although I am not an expert in quantitative methods, the methods used appear logical and appropriate, and the authors understand well the nature of the dataset they are working with. The information and analysis presented are informative and practically useful. The discussion is a clear and helpful review of the available information on cVDPV outbreaks, and articulates well what this paper adds.</p>
            <p> </p>
            <p> A few suggestions for further strengthening an excellent and informative paper:</p>
            <p> </p>
            <p> Some of the main practical take-aways (that ES may be less immediately useful than high quality AFP surveillance; that lower quality AFP surveillance means that outbreaks are likely to continue undetected for a significant period of time; and that mop up campaigns using mOPV2 carry risks of seeding cVDPV outbreaks) could be highlighted more in the abstract.</p>
            <p> </p>
            <p> The implications could be pulled out a bit more in the Discussion&#x2014;there could be some more courageous discussion here. Some questions that came up for me included: Given that surveillance across much of the world is not good enough to detect outbreaks on the timescale we all would like, what level of undetected transmission might we need to assume is ongoing globally, and what are the implications of this? What strategies might the authors suggest instead of mOPV2 mop ups? What is known about the extent to which nOPV, or IPV, would alleviate the cVDPV problem, and what might this paper add to discussions about prioritizing one vaccine over another?</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>I am an anthropologist who has been studying the polio eradication program for more than 15 years.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment3532-31648">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Auzenbergs</surname>
                            <given-names>Megan</given-names>
                        </name>
                        <aff>London School of Hygiene &amp; Tropical Medicine, UK</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>26</day>
                    <month>4</month>
                    <year>2022</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Thank you for your favourable critique of this manuscript. We have taken your comments into consideration and offer the following replies and changes:&#x00a0;</p>
                <p> </p>
                <p> 
                    <italic>1.&#x00a0;&#x00a0; &#x00a0;Some of the main practical take-aways (that ES may be less immediately useful than high quality AFP surveillance; that lower quality AFP surveillance means that outbreaks are likely to continue undetected for a significant period of time; and that mop up campaigns using mOPV2 carry risks of seeding cVDPV outbreaks) could be highlighted more in the abstract.</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>These are very helpful take-away points. Several changes have been made to strengthen messaging in the abstract, lines 28-31. As word count is limited for the abstract, we have tried to incorporate your feedback in the most concise, yet meaningful, way possible.&#x00a0;</p>
                        </list-item>
                    </list> </p>
                <p> 
                    <italic>2.&#x00a0;&#x00a0; &#x00a0;The implications could be pulled out a bit more in the Discussion&#x2014;there could be some more courageous discussion here. Some questions that came up for me included: Given that surveillance across much of the world is not good enough to detect outbreaks on the timescale we all would like, what level of undetected transmission might we need to assume is ongoing globally, and what are the implications of this? What strategies might the authors suggest instead of mOPV2 mop ups? What is known about the extent to which nOPV, or IPV, would alleviate the cVDPV problem, and what might this paper add to discussions about prioritizing one vaccine over another?</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Several of your points have now been incorporated into the discussion section, specifically, your points around persistent low rates of AFP surveillance and ongoing undetected transmission: 
                                <list list-type="bullet">
                                    <list-item>
                                        <p>"Low rates of non-polio AFP surveillance that persist across many settings coupled with the low case to infection rate for polio means undetected transmission is possible in many areas, jeopardising the attainment of polio eradication. As the risk of importation of infection across the African continent increases following the 2021 WPV1 importation in Malawi, adopting strategies to improve surveillance are increasingly important.&#x201d;</p>
                                    </list-item>
                                </list> </p>
                        </list-item>
                    </list>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report30931">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14511.r30931</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Orenstein</surname>
                        <given-names>Walter A.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30931a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r30931a1">
                    <label>1</label>Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>6</day>
                <month>8</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Orenstein WA</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30931" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13272.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This is an important study which provides modeling data showing earlier detection of cVDPV polio outbreaks at sites with better non-polio acute flaccid paralysis (NPAFP) reporting and adequate stool collections. This information can play a critical role in assuring if cVDPV outbreaks were occurring, they would be detected quickly, making containment easier.&#x00a0;&#x00a0;</p>
            <p> </p>
            <p> The article could benefit with some discussion of why higher NPAFP rates well beyond the minimal threshold for quality are more predictive of earlier cVDPV detection. Does this mean that the standard is too low and are there data the authors can reference regarding what would represent accurate rates of a clinical syndrome not associated with polioviruses? Also, for Table 1, can the authors clarify what the time frame is for the NPAFP rate compared to 1st detection of the outbreak?</p>
            <p> </p>
            <p> Table 2 is important in showing the relationship between various factors and detection of cVDPVs at an earlier time. The IRR is unclear. It would be helpful to add a footnote to the table describing what an IRR of 2.15 in Environmental versus versus AFP surveillance means.</p>
            <p> </p>
            <p> The relationship of AFP versus ES for early detection is, as noted by the authors, not significant (p value 0.069). But this is really borderline non-significant and this reviewer feels the authors need to be cautious in dismissing the relationship.</p>
            <p> </p>
            <p> Figure 2 A and B are difficult for this non-statistician to understand. It would be helpful if more description of the graphs for a non-statistical audience was added.</p>
            <p> </p>
            <p> In the abstract, the authors mention the first outbreak in 2001 of cVDPV1. In actuality, the outbreak started in 2000 and continued into 2001. See MMWR 50(39) 855-6, October 5, 2001.</p>
            <p> </p>
            <p> On page 3, left column, 3rd paragraph, line 11, there is a typo: "a low" should be "as low".</p>
            <p> </p>
            <p> There is another typo on page 4, left column, line 10. The authors say "systemtic". Should it be "systematic"?</p>
            <p> </p>
            <p> Also in that same paragraph, there are some asterisks. This reviewer did not see what the asterisks referred to.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>I have a career as a public health physician.&#x00a0;I was Director of the US Immunization Program at the CDC for 16 years.&#x00a0;For 3 years I was in charge of the polio efforts at the Bill &amp; Melinda Gates Foundation (2008-2011)</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment3531-30931">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Auzenbergs</surname>
                            <given-names>Megan</given-names>
                        </name>
                        <aff>London School of Hygiene &amp; Tropical Medicine, UK</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>26</day>
                    <month>4</month>
                    <year>2022</year>
                </pub-date>
            </front-stub>
            <body>
                <p>We thank the reviewer for their insightful and positive critique. We have taken your comments into consideration and offer the following responses and changes to the manuscript:</p>
                <p> </p>
                <p> 
                    <italic>1.&#x00a0;&#x00a0; &#x00a0;The article could benefit with some discussion of why higher NPAFP rates well beyond the minimal threshold for quality are more predictive of earlier cVDPV detection. Does this mean that the standard is too low and are there data the authors can reference regarding what would represent accurate rates of a clinical syndrome not associated with polioviruses?</italic>&#x00a0; 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for this useful question, this is a great point regarding the standards in place for AFP surveillance. As Tangermann et al. 2017 states: &#x201c;high rates of AFP reporting do not necessarily imply highly sensitive surveillance, because, in the absence of sufficient supervision, there may be considerable over-reporting of children as AFP cases who actually do not have AFP, while true AFP cases.&#x201d; 
                                <list list-type="bullet">
                                    <list-item>
                                        <p>This suggests that while standards are in place, they perhaps do not accurately capture localised issues that may mitigate surveillance sensitivity. Accurate rates of clinical syndrome that are not associated with poliovirus (i.e., Guillain-Barre&#x0301; syndrome) would need to be detected with greater sensitivity to ensure true poliovirus cases are not missed. A change has been made to add this important point to the discussion, lines 345-351.</p>
                                    </list-item>
                                </list> </p>
                        </list-item>
                        <list-item>
                            <p>Additionally, the most recent GPEI protocol for responding to poliovirus outbreaks describes NPAFP goals and how recommended levels of surveillance may vary across high-risk areas versus smaller areas with fewer children under 15 years of age. This is now included in the manuscript lines 355-360.</p>
                        </list-item>
                    </list> 
                    <italic>2.&#x00a0;&#x00a0; &#x00a0;Also, for Table 1, can the authors clarify what the time frame is for the NPAFP rate compared to 1st detection of the outbreak?</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>The mean NPAFP rate that is listed in Table 1 is the annual rate reported during the year of the first detection of the outbreak. This information is provided in line 136: 
                                <list list-type="bullet">
                                    <list-item>
                                        <p>&#x201c;The annual country-level non-polio acute flaccid paralysis (AFP) rate and percentage of adequate stool specimens collected, both indicators of surveillance quality, were extracted for each outbreak and year corresponding to the start of the outbreak&#x201d;.</p>
                                    </list-item>
                                </list> </p>
                        </list-item>
                    </list> 
                    <italic>3.&#x00a0;&#x00a0; &#x00a0;Table 2 is important in showing the relationship between various factors and detection of cVDPVs at an earlier time. The IRR is unclear. It would be helpful to add a footnote to the table describing what an IRR of 2.15 in Environmental versus AFP surveillance means.</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>In the amended version, a footnote has been added to table 2 further explaining the interpretation this IRR and how the IRR can be used to predict what the nucleotide changes would be of an isolated virus under specific circumstances (AFP vs. ES).</p>
                        </list-item>
                    </list> 
                    <italic>4.&#x00a0;&#x00a0; &#x00a0;The relationship of AFP versus ES for early detection is, as noted by the authors, not significant (p value 0.069). But this is really borderline non-significant and this reviewer feels the authors need to be cautious in dismissing the relationship.</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for this important point. We agree that this relationship may have been incorrectly dismissed and we now make a point to mention the IRR despite the borderline non-significant p-value. Note that we have retained the finding in the model presented for this reason, but also that the IRR is positive, which points towards ES being implemented in high-risk areas with concerns for AFP rates.&#x00a0;</p>
                        </list-item>
                        <list-item>
                            <p>We made a change in the manuscript to address your point, lines: 254-257 (or paragraph 3 of the results section).</p>
                        </list-item>
                    </list> 
                    <italic>5.&#x00a0;&#x00a0; &#x00a0;Figure 2 A and B are difficult for this non-statistician to understand. It would be helpful if more description of the graphs for a non-statistical audience was added.</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for this consideration, the caption for figure 2 A and B has now been updated with more explanation of how to best interpret the plots for a non-statistical audience.</p>
                        </list-item>
                    </list> 
                    <italic>6.&#x00a0;&#x00a0; &#x00a0;In the abstract, the authors mention the first outbreak in 2001 of cVDPV1. In actuality, the outbreak started in 2000 and continued into 2001. See MMWR 50(39) 855-6, October 5, 2001.</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>This is a correct statement. The abstract and corresponding relevant text have been corrected to align with MMWR reports.</p>
                        </list-item>
                    </list> </p>
                <p> 
                    <italic>7.&#x00a0;&#x00a0; &#x00a0;On page 3, left column, 3rd paragraph, line 11, there is a typo: "a low" should be "as low".</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for noting this, it has now been changed in the manuscript.</p>
                        </list-item>
                    </list> </p>
                <p> 
                    <italic>8.&#x00a0;&#x00a0; &#x00a0;There is another typo on page 4, left column, line 10. The authors say "systemtic". Should it be "systematic"?</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for noting this, it has now been changed in the manuscript.</p>
                        </list-item>
                    </list> </p>
                <p> 
                    <italic>9.&#x00a0;&#x00a0; &#x00a0;Also in that same paragraph, there are some asterisks. This reviewer did not see what the asterisks referred to.</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for noting this, when conducting literature searches in large databases, an asterisk is used to include variations of the same word within the search criteria. For example, &#x201c;poliovirus*&#x201d; would include all versions of the word in the search criteria, such as: &#x201c;polioviruses&#x201d;. This is standard best practice for systematic reviews, especially when words such as &#x201c;immunisation&#x201d; can be spelled differently in the English language. Such a word should be included as &#x201c;immuni*ation&#x201d; in searches to include articles that use &#x201c;immunization&#x201d; and &#x201c;immunisation&#x201d;.&#x00a0;</p>
                        </list-item>
                        <list-item>
                            <p>For this reason, no changes have been made to the manuscript text regarding search terms.</p>
                        </list-item>
                    </list>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report30747">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14511.r30747</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Maldonado</surname>
                        <given-names>Yvonne</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30747a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r30747a1">
                    <label>1</label>Department of Pediatrics, Stanford University, Stanford, CA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>7</day>
                <month>7</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Maldonado Y</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30747" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13272.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Thank you for the opportunity to read an interesting paper on the importance of ongoing surveillance for the detection of cVDPVs and the impact of surveillance methodology on the timely detection of mutated vaccine virus. The statistical analyses were sound as described for the research questions and have brought up a number of interesting points for the GPEI to consider, especially in light of the decline in reported cases of AFP in the last year. 
                <list list-type="order">
                    <list-item>
                        <p>I would have liked to see more description in the methods regarding the source of the genetic sequences used in this analysis and the measures put into place to assess the validity of these sequences. Would the authors be able to expand further in the main text?</p>
                    </list-item>
                    <list-item>
                        <p>In the third paragraph of the methods, the authors note, &#x201c;Separate datasets were created for serotype 2 and serotypes 1 and 3, and the latter retained a covariate for serotype.&#x201d; While the authors noted that a covariate for serotype exists in the shared dataset, I was wondering why different datasets were not created for each serotype?</p>
                    </list-item>
                    <list-item>
                        <p>Given the impact of vaccination on the emergence of cVDPVs, were the authors able to look at vaccination schemes or vaccination coverage as a covariate for the countries where outbreaks were detected? Or to look at vaccination coverage in these outbreaks in relation to neighboring countries where outbreaks were not detected?</p>
                    </list-item>
                    <list-item>
                        <p>Paragraph 6 in the discussion brings up a great point on the value of environmental surveillance as a tool for earlier detection of cVDPVs. I would suggest moving that higher in the discussion.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Partly</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Infectious Disease Epidemiology, Polio Epidemiology, Oral Poliovirus Vaccine Transmission, Environmental Surveillance for Oral Poliovirus Vaccine</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment3530-30747">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Auzenbergs</surname>
                            <given-names>Megan</given-names>
                        </name>
                        <aff>London School of Hygiene &amp; Tropical Medicine, UK</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>26</day>
                    <month>4</month>
                    <year>2022</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Thank you for your important comments on this analysis. We have taken your questions into consideration and offer the following responses and changes to the manuscript:</p>
                <p> </p>
                <p> 
                    <italic>1.&#x00a0;&#x00a0; &#x00a0;I would have liked to see more description in the methods regarding the source of the genetic sequences used in this analysis and the measures put into place to assess the validity of these sequences. Would the authors be able to expand further in the main text?</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>We have provided further clarification of the sequencing protocol, which is carried out by CDC, in the text (line number 103): 
                                <list list-type="bullet">
                                    <list-item>
                                        <p>&#x201c;All samples undergo confirmatory testing and genetic sequencing at laboratories that are part of the Global Polio Laboratory Network (GPLN) following a standardised protocol to minimise contamination and maximise sensitivity.&#x201d;</p>
                                    </list-item>
                                </list> </p>
                        </list-item>
                    </list> 
                    <italic>2.&#x00a0;&#x00a0; &#x00a0;In the third paragraph of the methods, the authors note, &#x201c;Separate datasets were created for serotype 2 and serotypes 1 and 3, and the latter retained a covariate for serotype.&#x201d; While the authors noted that a covariate for serotype exists in the shared dataset, I was wondering why different datasets were not created for each serotype?</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for the clarifying question. The reason was statistically motivated. The sample size for types 1 and 3 were too small to ascertain meaningful summary statistics. Further the case: infection ratio is similar for serotypes 1 and 3, whereas serotype 2 has a larger case to infection ratio.</p>
                        </list-item>
                        <list-item>
                            <p>Both of these reasons have now been added to the methods section of the manuscript, lines 153-154: 
                                <list list-type="bullet">
                                    <list-item>
                                        <p>&#x201c;Separate datasets were created for serotype 2 and serotypes 1 and 3, to account for the small sample size of types 1 and 3 outbreaks and because of the similar case to infection ratio for serotypes 1 and 3. The data set for types 1 and 3 retained a covariate for serotype.&#x201d;</p>
                                    </list-item>
                                </list> </p>
                        </list-item>
                    </list> 
                    <italic>3.&#x00a0;&#x00a0; &#x00a0;Given the impact of vaccination on the emergence of cVDPVs, were the authors able to look at vaccination schemes or vaccination coverage as a covariate for the countries where outbreaks were detected? Or to look at vaccination coverage in these outbreaks in relation to neighboring countries where outbreaks were not detected?</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Routine immunisation coverage was assessed as a potential covariate as we recognised the importance of vaccination schemes. However, the covariate for RI coverage was dropped as inclusion did not result in a model of best fit, as determined by Akaike information criterion (AIC).</p>
                        </list-item>
                        <list-item>
                            <p>A proposed mechanism by which RI may affect the time from seeding to detection of a VDPV is that in areas of lower RI coverage, there may be an increase in virus circulation, subsequent higher levels of infection and cases, and therefore decreased time to detection. &#x00a0;It is possible that RI coverage has more of an impact at a smaller geographical level than at the national level, the level at which this analysis was carried out. In this case, the analysis at the national level may not detect a relationship for RI coverage and time to detection that may exist at a smaller geographical level. We recognise this as a limitation and potential source of a type 1 error.&#x00a0;</p>
                        </list-item>
                        <list-item>
                            <p>This limitation has now been included in the discussion section about limitations, lines: 349-352.</p>
                        </list-item>
                    </list> 
                    <italic>4.&#x00a0;&#x00a0; &#x00a0;Paragraph 6 in the discussion brings up a great point on the value of environmental surveillance as a tool for earlier detection of cVDPVs. I would suggest moving that higher in the discussion.</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Thank you for this suggestion. This paragraph has now been moved up higher so it is one of the first points in the discussion, line 282 onwards.</p>
                        </list-item>
                    </list>
                </p>
            </body>
        </sub-article>
    </sub-article>
</article>
