<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Gates Open Res</journal-id>
            <journal-title-group>
                <journal-title>Gates Open Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2572-4754</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/gatesopenres.13220.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>The impact of the program for medical male circumcision on HIV in South Africa: analysis using three epidemiological models</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Korenromp</surname>
                        <given-names>Eline L.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Bershteyn</surname>
                        <given-names>Anna</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Mudimu</surname>
                        <given-names>Edina</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Weiner</surname>
                        <given-names>Renay</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Bonecwe</surname>
                        <given-names>Collen</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Loykissoonlal</surname>
                        <given-names>Dayanund</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Manuhwa</surname>
                        <given-names>Clarence</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a6">6</xref>
                    <xref ref-type="aff" rid="a7">7</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Pretorius</surname>
                        <given-names>Carel</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a8">8</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Teng</surname>
                        <given-names>Yu</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a8">8</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Stover</surname>
                        <given-names>John</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-7236-1989</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a8">8</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Johnson</surname>
                        <given-names>Leigh F.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a9">9</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Center for Modeling and Analysis, Avenir Health, Geneva, Switzerland</aff>
                <aff id="a2">
                    <label>2</label>Department of Population and Health, NYU Langone Medical Center, New York, NY, 11016, USA</aff>
                <aff id="a3">
                    <label>3</label>Department of Decision Sciences, University of South Africa (UNISA), Pretoria, 0003, South Africa</aff>
                <aff id="a4">
                    <label>4</label>Research and Training for Health and Development, Johannesburg, 2196, South Africa</aff>
                <aff id="a5">
                    <label>5</label>National Department of Health, Pretoria, South Africa</aff>
                <aff id="a6">
                    <label>6</label>FHI 360, Pretoria, 0083, South Africa</aff>
                <aff id="a7">
                    <label>7</label>Independent Consultant, Pretoria, 0083, South Africa</aff>
                <aff id="a8">
                    <label>8</label>Center for Modeling and Analysis, Avenir Health, Glastonbury, CT, 06033, USA</aff>
                <aff id="a9">
                    <label>9</label>Centre for Infectious Disease Epidemiology and Research, University of Cape Town, Cape Town, South Africa</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:Jstover@avenirhealth.org">Jstover@avenirhealth.org</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>One co-author, CM, was a consultant to the Foundation and participated in preparation of the manuscript.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>25</day>
                <month>1</month>
                <year>2021</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>5</volume>
            <elocation-id>15</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>12</day>
                    <month>1</month>
                    <year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Korenromp EL et al.</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://gatesopenresearch.org/articles/5-15/pdf"/>
            <abstract>
                <p>
                    <bold>Background</bold>: South Africa began offering medical male circumcision (MMC) in 2010. We evaluated the current and future impact of this program to see if it is effective in preventing new HIV infections.</p>
                <p>
                    <bold>Methods</bold>: The Thembisa, Goals and Epidemiological Modeling Software (EMOD) HIV transmission models were calibrated to South Africa&#x2019;s HIV epidemic, fitting to household survey data on HIV prevalence, risk behaviors, and proportions of men circumcised, and to programmatic data on intervention roll-out including program-reported MMCs over 2009&#x2013;2017. We compared the actual program accomplishments through 2017 and program targets through 2021 with a counterfactual scenario of no MMC program.</p>
                <p>
                    <bold>Results</bold>: The MMC program averted 71,000-83,000 new HIV infections from 2010 to 2017. The future benefit of the circumcision already conducted will grow to 496,000-518,000 infections (6&#x2013;7% of all new infections) by 2030. If program targets are met by 2021 the benefits will increase to 723,000&#x2013;760,000 infections averted by 2030. The cost would be $1,070-1,220 per infection averted relative to no MMC. The savings from averted treatment needs would become larger than the costs of the MMC program around 2034&#x2013;2039.</p>
                <p>In the Thembisa model, when modelling South Africa&#x2019;s 9 provinces individually, the 9-provinces-aggregate results were similar to those of the single national model. Across provinces, projected long-term impacts were largest in Free State, KwaZulu-Natal and Mpumalanga (23&#x2013;27% reduction over 2017&#x2013;2030), reflecting these provinces&#x2019; greater MMC scale-up.</p>
                <p>
                    <bold>Conclusions</bold>: MMC has already had a modest impact on HIV incidence in South Africa and can substantially impact South Africa&#x2019;s HIV epidemic in the coming years.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>HIV</kwd>
                <kwd>prevention</kwd>
                <kwd>program evaluation</kwd>
                <kwd>mathematical modeling</kwd>
                <kwd>health impact</kwd>
                <kwd>cost-effectiveness</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/501100018734">
                    <funding-source>Joint United Nations Programme on HIV/AIDS</funding-source>
                </award-group>
                <award-group id="fund-2" xlink:href="http://dx.doi.org/10.13039/100000865">
                    <funding-source>Gates Foundation</funding-source>
                    <award-id>OPP1118702</award-id>
                </award-group>
                <funding-statement>The project was funded by the Gates Foundation through a grant [OPP1118702] to Avenir Health with JS as Principal Investigator. UNAIDS supported the updating and development of the Thembisa model through a grant to LFJ. </funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec>
            <title>Abbreviations</title>
            <p>ART = antiretroviral therapy; DHS = Demographic and Health Survey; HSRC = South Africa Human Sciences Research Council; (M)MC = (medical) male circumcision; PEPFAR = US President's Emergency Plan for AIDS Relief; PLWH = people living with HIV (PLWH); VLS = viral load suppression.</p>
        </sec>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>South Africa continues to face one of the highest burdens of HIV globally, despite extensive roll-out of prevention programs since the 1990s and treatment programs since 2004
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>,
                    <xref ref-type="bibr" rid="ref-2">2</xref>
                </sup>. In 2017, more than 20% of adults (15&#x2013;49 years) were living with HIV (PLWH) in South Africa
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>
                </sup>, with 56% on ART
                <sup>
                    <xref ref-type="bibr" rid="ref-4">4</xref>
                </sup>. Average national HIV prevalence among men and women reached 16% by 2002
                <sup>
                    <xref ref-type="bibr" rid="ref-5">5</xref>
                </sup>, and has continued a slow rise to 18% by 2012
                <sup>
                    <xref ref-type="bibr" rid="ref-5">5</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref-9">9</xref>
                </sup> and 20% by 2017
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>
                </sup> - in part an effect of PLWH surviving longer on ART, but in part also reflecting ongoing new HIV infections, which are declining only at a slow rate
                <sup>
                    <xref ref-type="bibr" rid="ref-10">10</xref>
                </sup>, highlighting concerns about sustainability of treatment programs.</p>
            <p>Medical male circumcision (MMC) has been shown by three randomized control trials to reduce the transmission of HIV from females to males by about 60%
                <sup>
                    <xref ref-type="bibr" rid="ref-11">11</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref-13">13</xref>
                </sup>. It is a one-time intervention that provides life-long protection.
                <sup>
                    <xref ref-type="bibr" rid="ref-14">14</xref>
                </sup>. Recent studies have indicated that the risks of heterosexual transmission might be higher, 70&#x2013;72%
                <sup>
                    <xref ref-type="bibr" rid="ref-15">15</xref>,
                    <xref ref-type="bibr" rid="ref-16">16</xref>
                </sup>, with less protection for male-to-male transmission risk of 20%
                <sup>
                    <xref ref-type="bibr" rid="ref-16">16</xref>
                </sup>. In response, the World Health Organization (WHO) and Joint United Nations Program on HIV/AIDS (UNAIDS) suggested a target of 80% MMC coverage by 2015 among adult men (ages 15&#x2013;49 years) in 14 priority countries including South Africa
                <sup>
                    <xref ref-type="bibr" rid="ref-17">17</xref>
                </sup>.</p>
            <p>South Africa adopted MMC strategy in 2009 and began service delivery in 2010. The 2012&#x2013;2016 National Strategic Plan (NSP) targeted a cumulative 4.3 million MMCs by the end of 2016
                <sup>
                    <xref ref-type="bibr" rid="ref-18">18</xref>
                </sup>. Target setting, in terms of numbers and priority age groups, was informed by use of the projection tool Decision Makers' Program Planning Tool
                <sup>
                    <xref ref-type="bibr" rid="ref-19">19</xref>
                </sup>. Through the end of 2017, 3 459 935 MMCs had been reported. The 2017&#x2013;2022 NSP targets a cumulative 3 million MMCs to be performed between 2016 and 2021
                <sup>
                    <xref ref-type="bibr" rid="ref-20">20</xref>
                </sup>. PEPFAR, implementing MMC in 27 priority districts, aims to achieve 80% circumcision coverage in men 15&#x2013;39 years by 2022
                <sup>
                    <xref ref-type="bibr" rid="ref-21">21</xref>
                </sup>. The MMC program and its targets were underpinned by modeling studies that suggested that MMC scale-up is likely to be very cost-effective and could potentially have a large impact on South Africa&#x2019;s HIV epidemic
                <sup>
                    <xref ref-type="bibr" rid="ref-22">22</xref>,
                    <xref ref-type="bibr" rid="ref-23">23</xref>
                </sup>.</p>
            <p>As the MMC program strives to reach these 2022 targets in a context of limited resources and intervention options, it is timely to evaluate its actual health and economic impact and cost-effectiveness, based on actual program results to date. We applied three mathematical models of HIV in South Africa to examine the current and potential future impact of this program. This study was conducted jointly by three modeling groups, in cooperation with national program managers and stakeholders. We used three different models as implemented by three different modeling group to ensure that results were robust and not dependent on the specifications of a single model.</p>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <sec>
                <title>Structure of the three mathematical models</title>
                <p>
                    <bold>
                        <italic toggle="yes">Goals model.</italic>
                    </bold> Avenir Health applied the deterministic Spectrum Goals model, previously applied in South Africa
                    <sup>
                        <xref ref-type="bibr" rid="ref-24">24</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref-26">26</xref>
                    </sup> and other southern African countries (for example,
                    <sup>
                        <xref ref-type="bibr" rid="ref-27">27</xref>
                    </sup>). This compartmental, risk-structured model sits in the Spectrum platform, building on a demographic module that projects populations over time and models HIV epidemic spread between compartments of adults 15&#x2013;49 years: low-risk adults who have one heterosexual partner; medium-risk adults with two or more partners in a year, high-risk adults who are female sex workers (FSW) and their clients, and men who have sex with men (MSM). Each group is characterized by numbers of partners, acts per partner per year, condom usage rate, and age at first sexual relationship, which can all be set to change over time, either as spontaneous social trends or in response to behavioral interventions; as well as proportion married (time-constant). The probability of HIV transmission is determined by type of contact, disease stage, MC status of male (uninfected) partners, condom usage, and ART status of the infected partner. Parameters determining the probability of HIV transmission are sampled from plausible ranges (established from literature) to optimally fit the historical epidemic. Adult HIV incidence and prevalence from Goals are fed into the linked Spectrum module AIM, which translates these into outputs such as numbers of people living with HIV (including pediatric infections), new infections, AIDS deaths, the need for ART, and prevention of mother-to-child transmission, by age group including those below 15 and above 49 years.</p>
                <p>
                    <bold>
                        <italic toggle="yes">EMOD Model.</italic>
                    </bold> The Institute for Disease Modeling applied EMOD, an individual-based stochastic model with explicit age structure. EMOD
                    <bold>-</bold>HIV version 2.20 describes HIV as transmitted through age-structured heterosexual coital acts between individuals in sexual partnerships as well as vertically through mother-to-child transmission. Four types of sexual partnerships (marital, informal, transitory, and commercial) are remembered over time and formed according to specifiable partner age patterns. Infectivity of HIV+ individuals depends on infection stage (acute, latent, AIDS), ART, STI co-infection and condom usage. Susceptibility is influenced by STI co-infection, condom usage, PrEP usage and for males, by MC on a per-coital-act basis. While most of the population is serially monogamous, medium-risk individuals can have concurrent relationships and high-risk female sex workers and their male clients have frequent short-term relationships in addition to potentially concurrent longer-term relationships. HIV testing occurs voluntarily, at antenatal visits, or once symptomatic. Individuals flow through a realistic representation of the ART continuum to access treatment and may discontinue and later resume care. Model fitting using Parallel Simulations Perturbation Optimisation
                    <sup>
                        <xref ref-type="bibr" rid="ref-28">28</xref>,
                        <xref ref-type="bibr" rid="ref-29">29</xref>
                    </sup> was used to identify 250 unique parameter combinations that produce epidemic patterns consistent with historical data.</p>
                <p>The EMOD South Africa model utilizes country-specific demographics (age-specific fertility and age/sex-specific non-AIDS mortality), ART (over time and by sex), and HIV prevalence estimates (by age and sex over the available survey years).</p>
                <p>
                    <bold>
                        <italic toggle="yes">Thembisa Model.</italic>
                    </bold> The University of Cape Town applied the deterministic model Thembisa, a combined demographic and HIV model, which was developed for South Africa and which has previously been used to assess the relative impact of different HIV prevention and treatment strategies
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>,
                        <xref ref-type="bibr" rid="ref-30">30</xref>
                    </sup>. This compartmental, risk-structured and age-structured model divides the population into a number of demographic cohorts (defined by sex and individual age). Within each cohort, the population is sub-divided into further compartments, defined in terms of sexual behavior characteristics such as sexual experience, risk group (high or low risk), marital status and sexual preference (heterosexual or bisexual). The population is further stratified by HIV testing history (in the case of men) and circumcision status. HIV-positive individuals are divided into different CD4 groupings and are classified as undiagnosed, diagnosed but untreated, or treated. HIV transmission is modelled based on assumptions about coital frequencies, condom use and probabilities of HIV transmission per sex act, all of which depend on age, sex and relationship type. The model also allows for changes in condom use over time, as a result of HIV communication programmes. The model is fitted to age-specific HIV prevalence data from antenatal and household surveys, and is also calibrated to age-specific all-cause mortality data. A more detailed description of the model and the calibration procedure is provided elsewhere
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>.</p>
                <p>The rate at which men get circumcised is assumed to be composed of two parts: the &#x2018;background&#x2019; rate of male circumcision that would be expected in the absence of any efforts to promote male circumcision as an HIV prevention strategy, and the rate of male circumcision due to MMC campaigns. In modelling the former, a cumulative Weibull distribution is used to represent the age-related changes in the prevalence of male circumcision prior to 2008. It is assumed that the prevalence of male circumcision at age 
                    <italic toggle="yes">x</italic> is determined by the function</p>
                <p>
                    <disp-formula>
                        <mml:math display="block" id="M1">
                            <mml:mrow>
                                <mml:mi>p</mml:mi>
                                <mml:mo stretchy="false">(</mml:mo>
                                <mml:mi>x</mml:mi>
                                <mml:mo stretchy="false">)</mml:mo>
                                <mml:mo>=</mml:mo>
                                <mml:mi>a</mml:mi>
                                <mml:mo>+</mml:mo>
                                <mml:mrow>
                                    <mml:mo>(</mml:mo>
                                    <mml:mrow>
                                        <mml:mi>b</mml:mi>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:mi>a</mml:mi>
                                    </mml:mrow>
                                    <mml:mo>)</mml:mo>
                                </mml:mrow>
                                <mml:mrow>
                                    <mml:mo>(</mml:mo>
                                    <mml:mrow>
                                        <mml:mn>1</mml:mn>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:msup>
                                            <mml:mrow>
                                                <mml:mn>0.5</mml:mn>
                                            </mml:mrow>
                                            <mml:mrow>
                                                <mml:msup>
                                                    <mml:mrow>
                                                        <mml:mrow>
                                                            <mml:mo>(</mml:mo>
                                                            <mml:mrow>
                                                                <mml:mi>x</mml:mi>
                                                                <mml:mo>/</mml:mo>
                                                                <mml:msub>
                                                                    <mml:mi>m</mml:mi>
                                                                    <mml:mn>1</mml:mn>
                                                                </mml:msub>
                                                            </mml:mrow>
                                                            <mml:mo>)</mml:mo>
                                                        </mml:mrow>
                                                    </mml:mrow>
                                                    <mml:mi>&#x03d5;</mml:mi>
                                                </mml:msup>
                                            </mml:mrow>
                                        </mml:msup>
                                    </mml:mrow>
                                    <mml:mo>)</mml:mo>
                                </mml:mrow>
                                <mml:mo>,</mml:mo>
                            </mml:mrow>
                        </mml:math>
                    </disp-formula>
                </p>
                <p>where 
                    <italic toggle="yes">a</italic> is the proportion of males who are circumcised soon after birth, 
                    <italic toggle="yes">b</italic> is the maximum cumulative uptake of male circumcision in the absence of MMC promotion, 
                    <italic toggle="yes">m</italic>
                    <sub>1</sub> is the median age at circumcision in men who get circumcised after birth, and 
                    <italic toggle="yes">&#x03d5;</italic> is the shape parameter that determines the concentration of the distribution of circumcision ages (post-birth) around the median. Since surveys usually report the median age at circumcision for all men (including those who are circumcised at the time of birth), it is useful to parameterize the model in terms of this overall median circumcision age, 
                    <italic toggle="yes">m</italic>
                    <sub>2</sub>, noting that</p>
                <p>
                    <disp-formula>
                        <mml:math display="block" id="M2">
                            <mml:mrow>
                                <mml:msub>
                                    <mml:mi>m</mml:mi>
                                    <mml:mn>1</mml:mn>
                                </mml:msub>
                                <mml:mo>=</mml:mo>
                                <mml:msub>
                                    <mml:mi>m</mml:mi>
                                    <mml:mn>2</mml:mn>
                                </mml:msub>
                                <mml:msup>
                                    <mml:mrow>
                                        <mml:mrow>
                                            <mml:mo>(</mml:mo>
                                            <mml:mrow>
                                                <mml:mfrac>
                                                    <mml:mrow>
                                                        <mml:mi>ln</mml:mi>
                                                        <mml:mo>&#x2061;</mml:mo>
                                                        <mml:mrow>
                                                            <mml:mo>(</mml:mo>
                                                            <mml:mrow>
                                                                <mml:mi>b</mml:mi>
                                                                <mml:mo>/</mml:mo>
                                                                <mml:mrow>
                                                                    <mml:mo>(</mml:mo>
                                                                    <mml:mrow>
                                                                        <mml:mn>2</mml:mn>
                                                                        <mml:mo stretchy="false">(</mml:mo>
                                                                        <mml:mi>b</mml:mi>
                                                                        <mml:mo>&#x2212;</mml:mo>
                                                                        <mml:mi>a</mml:mi>
                                                                        <mml:mo stretchy="false">)</mml:mo>
                                                                    </mml:mrow>
                                                                    <mml:mo>)</mml:mo>
                                                                </mml:mrow>
                                                            </mml:mrow>
                                                            <mml:mo>)</mml:mo>
                                                        </mml:mrow>
                                                    </mml:mrow>
                                                    <mml:mrow>
                                                        <mml:mi>ln</mml:mi>
                                                        <mml:mo>&#x2061;</mml:mo>
                                                        <mml:mo stretchy="false">(</mml:mo>
                                                        <mml:mn>0.5</mml:mn>
                                                        <mml:mo stretchy="false">)</mml:mo>
                                                    </mml:mrow>
                                                </mml:mfrac>
                                            </mml:mrow>
                                            <mml:mo>)</mml:mo>
                                        </mml:mrow>
                                    </mml:mrow>
                                    <mml:mrow>
                                        <mml:mstyle scriptlevel="1">
                                            <mml:mfrac bevelled="true">
                                                <mml:mrow>
                                                    <mml:mo>&#x2212;</mml:mo>
                                                    <mml:mn>1</mml:mn>
                                                </mml:mrow>
                                                <mml:mi>&#x03d5;</mml:mi>
                                            </mml:mfrac>
                                        </mml:mstyle>
                                    </mml:mrow>
                                </mml:msup>
                                <mml:mspace width="3em"/>
                                <mml:mtext>for</mml:mtext>
                                <mml:mspace width="0.2em"/>
                                <mml:mfrac>
                                    <mml:mi>b</mml:mi>
                                    <mml:mn>2</mml:mn>
                                </mml:mfrac>
                                <mml:mo>&gt;</mml:mo>
                                <mml:mi>a</mml:mi>
                                <mml:mo>.</mml:mo>
                            </mml:mrow>
                        </mml:math>
                    </disp-formula>
                </p>
                <p>Parameters 
                    <italic toggle="yes">a</italic> and 
                    <italic toggle="yes">b</italic> are set at 0.105 and 0.42 respectively. The shape parameter 
                    <italic toggle="yes">&#x03d5;</italic> is set at 4.5, and the median age at circumcision 
                    <italic toggle="yes">m</italic>
                    <sub>2</sub> is set at 18, the median age at circumcision reported by Africans in the 2002 HSRC and 2003 DHS surveys
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>,
                        <xref ref-type="bibr" rid="ref-31">31</xref>
                    </sup>. Most of these parameters have been set so that the model is consistent with reported rates of male circumcision by age in national surveys
                    <sup>
                        <xref ref-type="bibr" rid="ref-31">31</xref>
                    </sup>, after correcting the self-reported data to take into account known biases in the reporting of male circumcision
                    <sup>
                        <xref ref-type="bibr" rid="ref-32">32</xref>,
                        <xref ref-type="bibr" rid="ref-33">33</xref>
                    </sup>. This adjustment for mis-reporting of male circumcision excludes men who are partially circumcised, i.e. partially circumcised men are treated as uncircumcised. The two national surveys used in the parameterization were conducted in 2002 and 2003, and thus represent the situation prior to the promotion of male circumcision as an HIV prevention strategy. 
                    <xref ref-type="fig" rid="f1">Figure 1</xref> shows the model calibration for the proportion of men circumcised at baseline (in 2002, prior to start of the MMC program).</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <p>Fraction of men who are circumcised, by age: (
                            <bold>a</bold>) in 2002 just prior to MMC campaigns; (
                            <bold>b</bold>) in 2017.  In (
                            <bold>a</bold>), Unadjusted data represent the average of the results from national surveys in 2002 and 2003
                            <sup>
                                <xref ref-type="bibr" rid="ref-8">8</xref>,
                                <xref ref-type="bibr" rid="ref-31">31</xref>
                            </sup>; Adjusted estimates are calculated on the assumption that the sensitivity and specificity of self-reported male circumcision status (relative to true status) are 96.4% and 88.4% respectively
                            <sup>
                                <xref ref-type="bibr" rid="ref-32">32</xref>,
                                <xref ref-type="bibr" rid="ref-33">33</xref>
                            </sup>.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure1.gif"/>
                </fig>
                <p>The annual probability that uncircumcised men aged 
                    <italic toggle="yes">x</italic> would get circumcised in the absence of MMC campaigns is calculated from the 
                    <italic toggle="yes">p</italic>(
                    <italic toggle="yes">x</italic>) values defined previously using the equation</p>
                <p>
                    <disp-formula>
                        <mml:math display="block" id="M3">
                            <mml:mrow>
                                <mml:mi>&#x03c8;</mml:mi>
                                <mml:mo stretchy="false">(</mml:mo>
                                <mml:mi>x</mml:mi>
                                <mml:mo stretchy="false">)</mml:mo>
                                <mml:mo>=</mml:mo>
                                <mml:mfrac>
                                    <mml:mrow>
                                        <mml:mi>p</mml:mi>
                                        <mml:mo stretchy="false">(</mml:mo>
                                        <mml:mi>x</mml:mi>
                                        <mml:mo>+</mml:mo>
                                        <mml:mn>1</mml:mn>
                                        <mml:mo stretchy="false">)</mml:mo>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:mi>p</mml:mi>
                                        <mml:mo stretchy="false">(</mml:mo>
                                        <mml:mi>x</mml:mi>
                                        <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mrow>
                                        <mml:mn>1</mml:mn>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:mi>p</mml:mi>
                                        <mml:mo stretchy="false">(</mml:mo>
                                        <mml:mi>x</mml:mi>
                                        <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                </mml:mfrac>
                                <mml:mo>.</mml:mo>
                            </mml:mrow>
                        </mml:math>
                    </disp-formula>
                </p>
                <p>Extending the model to include MMC in response to MMC promotion campaigns requires that we define the symbol 
                    <italic toggle="yes">p</italic>
                    <sup>*</sup>(
                    <italic toggle="yes">x</italic>, 
                    <italic toggle="yes">t</italic>) as the proportion of men aged 
                    <italic toggle="yes">x</italic>, at time 
                    <italic toggle="yes">t</italic>, who are circumcised. Of those men who are uncircumcised at age 
                    <italic toggle="yes">x</italic> in year 
                    <italic toggle="yes">t</italic>, the proportion who intend to get traditionally circumcised (i.e., they would want to get circumcised even in the absence of MMC promotion campaigns) is calculated as</p>
                <p>
                    <disp-formula>
                        <mml:math display="block" id="M4">
                            <mml:mrow>
                                <mml:mfrac>
                                    <mml:mrow>
                                        <mml:mi>b</mml:mi>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:mi>p</mml:mi>
                                        <mml:mo stretchy="false">(</mml:mo>
                                        <mml:mi>x</mml:mi>
                                        <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mrow>
                                        <mml:mn>1</mml:mn>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:msup>
                                            <mml:mi>p</mml:mi>
                                            <mml:mo>*</mml:mo>
                                        </mml:msup>
                                        <mml:mo stretchy="false">(</mml:mo>
                                        <mml:mi>x</mml:mi>
                                        <mml:mo>,</mml:mo>
                                        <mml:mi>t</mml:mi>
                                        <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                </mml:mfrac>
                                <mml:mspace width="0.2em"/>
                                <mml:mo>,</mml:mo>
                            </mml:mrow>
                        </mml:math>
                    </disp-formula>
                </p>
                <p>and the proportion who do not intend to get traditionally circumcised is</p>
                <p>
                    <disp-formula>
                        <mml:math display="block" id="M5">
                            <mml:mrow>
                                <mml:mfrac>
                                    <mml:mrow>
                                        <mml:mn>1</mml:mn>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:msup>
                                            <mml:mi>p</mml:mi>
                                            <mml:mo>*</mml:mo>
                                        </mml:msup>
                                        <mml:mo stretchy="false">(</mml:mo>
                                        <mml:mi>x</mml:mi>
                                        <mml:mo>,</mml:mo>
                                        <mml:mi>t</mml:mi>
                                        <mml:mo stretchy="false">)</mml:mo>
                                        <mml:mspace width="0.3em"/>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:mrow>
                                            <mml:mo>(</mml:mo>
                                            <mml:mrow>
                                                <mml:mi>b</mml:mi>
                                                <mml:mo>&#x2212;</mml:mo>
                                                <mml:mi>p</mml:mi>
                                                <mml:mo stretchy="false">(</mml:mo>
                                                <mml:mi>x</mml:mi>
                                                <mml:mo stretchy="false">)</mml:mo>
                                            </mml:mrow>
                                            <mml:mo>)</mml:mo>
                                        </mml:mrow>
                                    </mml:mrow>
                                    <mml:mrow>
                                        <mml:mn>1</mml:mn>
                                        <mml:mo>&#x2212;</mml:mo>
                                        <mml:msup>
                                            <mml:mi>p</mml:mi>
                                            <mml:mo>*</mml:mo>
                                        </mml:msup>
                                        <mml:mo stretchy="false">(</mml:mo>
                                        <mml:mi>x</mml:mi>
                                        <mml:mo>,</mml:mo>
                                        <mml:mi>t</mml:mi>
                                        <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                </mml:mfrac>
                                <mml:mspace width="0.3em"/>
                                <mml:mo>.</mml:mo>
                            </mml:mrow>
                        </mml:math>
                    </disp-formula>
                </p>
                <p>The implicit assumption is that the men who intend to get traditionally circumcised would not accept MMC, i.e. the demand for traditional MC and the demand for MMC are mutually exclusive. This is different from the assumption made in the most recent previously-published version of Thembisa (Thembisa 4.1
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>), in which it was assumed that the demand for MMC was independent of the individual&#x2019;s desire for traditional male circumcision. This change was made because the previous model produced estimates of circumcision coverage that appeared implausibly low relative to the levels reported in recent surveys (even after correcting for misreporting), and because data from the most recent HSRC household survey
                    <sup>
                        <xref ref-type="bibr" rid="ref-34">34</xref>
                    </sup> suggest there has been no reduction in the prevalence of traditional male circumcision since the start of the MMC rollout (in contrast to what would be expected if some of the men who would previously have been traditionally circumcised instead chose MMC). With the revised assumption, the model yields a slightly higher estimate of male circumcision coverage, more consistent with recent survey data.</p>
                <p>Men are assumed to undergo MMC only if they are HIV-negative, as HIV testing is conducted prior to most MMC operations
                    <sup>
                        <xref ref-type="bibr" rid="ref-35">35</xref>,
                        <xref ref-type="bibr" rid="ref-36">36</xref>
                    </sup>, and although men who are HIV-positive are not excluded from getting circumcised, there would be little incentive to undergo the procedure if they were already HIV-positive. The symbol 
                    <italic toggle="yes">&#x03b7;</italic>(
                    <italic toggle="yes">x</italic>, 
                    <italic toggle="yes">t</italic>) is defined as the probability that HIV-negative men who are aged 
                    <italic toggle="yes">x</italic>, uncircumcised at the start of year 
                    <italic toggle="yes">t</italic>, and not intending to get traditionally circumcised, get medically circumcised through MMC campaigns. This is calculated as 
                    <italic toggle="yes">&#x03b7;</italic>(
                    <italic toggle="yes">x</italic>, 
                    <italic toggle="yes">t</italic>) = 
                    <italic toggle="yes">&#x03b8;</italic>(
                    <italic toggle="yes">t</italic>) &#x00d7; 
                    <italic toggle="yes">R</italic>(
                    <italic toggle="yes">x</italic>), where 
                    <italic toggle="yes">&#x03b8;</italic>(
                    <italic toggle="yes">t</italic>) is the maximum probability in year 
                    <italic toggle="yes">t</italic> and 
                    <italic toggle="yes">R</italic>(
                    <italic toggle="yes">x</italic>) is the relative rate of MMC uptake in men aged 
                    <italic toggle="yes">x</italic>, compared to boys aged 10&#x2013;14 years. The relative rates of MMC uptake in the 15&#x2013;19, 20&#x2013;24, 25&#x2013;49 and 50+ age groups have been set to 0.59, 0.27, 0.14 and 0.012 respectively; these rates were chosen to ensure the model matched the age profile of MMC operations provided from PEPFAR-supported MMC programmes in South Africa. This results in the prevalence of male circumcision by age in 2017 shown in 
                    <xref ref-type="fig" rid="f1">Figure 1b</xref>.</p>
                <p>The 
                    <italic toggle="yes">&#x03b8;</italic>(
                    <italic toggle="yes">t</italic>) values are estimated from the reported number of MMC operations in year 
                    <italic toggle="yes">t</italic>, &#x039b;(
                    <italic toggle="yes">t</italic>). Mathematically,</p>
                <disp-formula id="e">
                    <mml:math display="block" id="M6">
                        <mml:mrow>
                            <mml:mo>&#x039b;</mml:mo>
                            <mml:mo stretchy="false">(</mml:mo>
                            <mml:mi>t</mml:mi>
                            <mml:mo stretchy="false">)</mml:mo>
                            <mml:mo>=</mml:mo>
                            <mml:mstyle displaystyle="true">
                                <mml:munder>
                                    <mml:mo>&#x2211;</mml:mo>
                                    <mml:mi>x</mml:mi>
                                </mml:munder>
                                <mml:mrow>
                                    <mml:mi>N</mml:mi>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo>,</mml:mo>
                                    <mml:mi>t</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                </mml:mrow>
                            </mml:mstyle>
                            <mml:mrow>
                                <mml:mo>(</mml:mo>
                                <mml:mrow>
                                    <mml:mn>1</mml:mn>
                                    <mml:mo>&#x2212;</mml:mo>
                                    <mml:mfrac>
                                        <mml:mrow>
                                            <mml:mi>b</mml:mi>
                                            <mml:mo>&#x2212;</mml:mo>
                                            <mml:mi>p</mml:mi>
                                            <mml:mo stretchy="false">(</mml:mo>
                                            <mml:mi>x</mml:mi>
                                            <mml:mo stretchy="false">)</mml:mo>
                                        </mml:mrow>
                                        <mml:mrow>
                                            <mml:mn>1</mml:mn>
                                            <mml:mo>&#x2212;</mml:mo>
                                            <mml:mi>p</mml:mi>
                                            <mml:mo>*</mml:mo>
                                            <mml:mo stretchy="false">(</mml:mo>
                                            <mml:mi>x</mml:mi>
                                            <mml:mo>,</mml:mo>
                                            <mml:mi>t</mml:mi>
                                            <mml:mo stretchy="false">)</mml:mo>
                                        </mml:mrow>
                                    </mml:mfrac>
                                </mml:mrow>
                                <mml:mo>)</mml:mo>
                            </mml:mrow>
                            <mml:mi>&#x03b7;</mml:mi>
                            <mml:mo stretchy="false">(</mml:mo>
                            <mml:mi>x</mml:mi>
                            <mml:mo>,</mml:mo>
                            <mml:mi>t</mml:mi>
                            <mml:mo stretchy="false">)</mml:mo>
                            <mml:mo>,</mml:mo>
                        </mml:mrow>
                    </mml:math>
                </disp-formula>
                <p>where 
                    <italic toggle="yes">N</italic>(
                    <italic toggle="yes">x</italic>, 
                    <italic toggle="yes">t</italic>) is the number of uncircumcised, HIV-negative men who are aged 
                    <italic toggle="yes">x</italic> at the start of year 
                    <italic toggle="yes">t</italic>. From the above equation, it follows that</p>
                <disp-formula id="e1">
                    <mml:math display="block" id="M7">
                        <mml:mrow>
                            <mml:mi>&#x03b8;</mml:mi>
                            <mml:mo stretchy="false">(</mml:mo>
                            <mml:mi>t</mml:mi>
                            <mml:mo stretchy="false">)</mml:mo>
                            <mml:mo>=</mml:mo>
                            <mml:mrow>
                                <mml:mrow>
                                    <mml:mo>&#x039b;</mml:mo>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>t</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                </mml:mrow>
                                <mml:mo stretchy="true">/</mml:mo>
                                <mml:mrow>
                                    <mml:mstyle displaystyle="true">
                                        <mml:munder>
                                            <mml:mo>&#x2211;</mml:mo>
                                            <mml:mi>x</mml:mi>
                                        </mml:munder>
                                        <mml:mrow>
                                            <mml:mi>N</mml:mi>
                                            <mml:mo stretchy="false">(</mml:mo>
                                            <mml:mi>x</mml:mi>
                                            <mml:mo>,</mml:mo>
                                            <mml:mi>t</mml:mi>
                                            <mml:mo stretchy="false">)</mml:mo>
                                        </mml:mrow>
                                    </mml:mstyle>
                                    <mml:mrow>
                                        <mml:mo>(</mml:mo>
                                        <mml:mrow>
                                            <mml:mn>1</mml:mn>
                                            <mml:mo>&#x2212;</mml:mo>
                                            <mml:mfrac>
                                                <mml:mrow>
                                                    <mml:mi>b</mml:mi>
                                                    <mml:mo>&#x2212;</mml:mo>
                                                    <mml:mi>p</mml:mi>
                                                    <mml:mo stretchy="false">(</mml:mo>
                                                    <mml:mi>x</mml:mi>
                                                    <mml:mo stretchy="false">)</mml:mo>
                                                </mml:mrow>
                                                <mml:mrow>
                                                    <mml:mn>1</mml:mn>
                                                    <mml:mo>&#x2212;</mml:mo>
                                                    <mml:msup>
                                                        <mml:mi>p</mml:mi>
                                                        <mml:mo>*</mml:mo>
                                                    </mml:msup>
                                                    <mml:mo stretchy="false">(</mml:mo>
                                                    <mml:mi>x</mml:mi>
                                                    <mml:mo>,</mml:mo>
                                                    <mml:mi>t</mml:mi>
                                                    <mml:mo stretchy="false">)</mml:mo>
                                                </mml:mrow>
                                            </mml:mfrac>
                                        </mml:mrow>
                                        <mml:mo>)</mml:mo>
                                    </mml:mrow>
                                    <mml:mi>R</mml:mi>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mo>.</mml:mo>
                                </mml:mrow>
                            </mml:mrow>
                        </mml:mrow>
                    </mml:math>
                </disp-formula>
                <p>Combining traditional and medical male circumcision, the net probability of male circumcision in a male aged 
                    <italic toggle="yes">x</italic> at the start of year 
                    <italic toggle="yes">t</italic> is</p>
                <disp-formula id="e2">
                    <mml:math display="block" id="math">
                        <mml:mrow>
                            <mml:mi>&#x03c8;</mml:mi>
                            <mml:mo stretchy="false">(</mml:mo>
                            <mml:mi>x</mml:mi>
                            <mml:mo>,</mml:mo>
                            <mml:mi>t</mml:mi>
                            <mml:mo stretchy="false">)</mml:mo>
                            <mml:mo>=</mml:mo>
                            <mml:mfrac>
                                <mml:mrow>
                                    <mml:mi>p</mml:mi>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo>+</mml:mo>
                                    <mml:mn>1</mml:mn>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mo>&#x2212;</mml:mo>
                                    <mml:mi>p</mml:mi>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mo>+</mml:mo>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mn>1</mml:mn>
                                    <mml:mo>&#x2212;</mml:mo>
                                    <mml:msup>
                                        <mml:mi>p</mml:mi>
                                        <mml:mo>*</mml:mo>
                                    </mml:msup>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo>,</mml:mo>
                                    <mml:mi>t</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mo>&#x2212;</mml:mo>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>b</mml:mi>
                                    <mml:mo>&#x2212;</mml:mo>
                                    <mml:mi>p</mml:mi>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mi>&#x03b8;</mml:mi>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>t</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                    <mml:mi>R</mml:mi>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                </mml:mrow>
                                <mml:mrow>
                                    <mml:mn>1</mml:mn>
                                    <mml:mo>&#x2212;</mml:mo>
                                    <mml:msup>
                                        <mml:mi>p</mml:mi>
                                        <mml:mo>*</mml:mo>
                                    </mml:msup>
                                    <mml:mo stretchy="false">(</mml:mo>
                                    <mml:mi>x</mml:mi>
                                    <mml:mo>,</mml:mo>
                                    <mml:mi>t</mml:mi>
                                    <mml:mo stretchy="false">)</mml:mo>
                                </mml:mrow>
                            </mml:mfrac>
                            <mml:mo>.</mml:mo>
                        </mml:mrow>
                    </mml:math>
                </disp-formula>
            </sec>
            <sec>
                <title>Model calibrations to South Africa&#x2019;s historical HIV epidemic</title>
                <p>Each of the three models was independently calibrated to historical data on South Africa's HIV epidemic. All three models were fitted to the national epidemic; additionally as a sensitivity analysis, the Thembisa model was fitted for each of South Africa&#x2019;s nine provinces, and alternative national estimates were obtained by aggregating across the provinces.</p>
                <p>Key modeling assumptions were standardized across all models. Fertility and mortality were set according to census data and demographic estimates (for Goals and EMOD, from the 2017 UN World Population Prospect (WPP)
                    <sup>
                        <xref ref-type="bibr" rid="ref-37">37</xref>
                    </sup>; for Thembisa from South Africa national demographic estimates
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>).</p>
                <p>Key epidemic data for model calibration were sero-prevalence estimates in adult men and women from national surveys conducted in 2002, 2005, 2008, 2012 and 2017 conducted by South Africa&#x2019;s Human Sciences Research Council (HSRC)
                    <sup>
                        <xref ref-type="bibr" rid="ref-5">5</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref-7">7</xref>,
                        <xref ref-type="bibr" rid="ref-9">9</xref>
                    </sup>, as well as time trends in prevalence from national antenatal clinic surveys
                    <sup>
                        <xref ref-type="bibr" rid="ref-38">38</xref>
                    </sup>.</p>
                <p>Historical patterns of risk behavior and condom usage, which determine historical HIV transmission in the models, were informed by data from the HSRC surveys, national Demographic and Health Surveys (DHS) in 1998
                    <sup>
                        <xref ref-type="bibr" rid="ref-39">39</xref>
                    </sup>, 2003
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup> and 2016
                    <sup>
                        <xref ref-type="bibr" rid="ref-40">40</xref>
                    </sup>, national HIV communication surveys conducted in 2009 and 2012
                    <sup>
                        <xref ref-type="bibr" rid="ref-41">41</xref>,
                        <xref ref-type="bibr" rid="ref-42">42</xref>
                    </sup>, and epidemiological, behavioral, and intervention studies in South Africa. HIV transmission probabilities and disease progression rates were fitted, within plausible ranges established by longitudinal studies in the South and East African region, to produce the best fit in terms of HIV prevalence by gender nation-wide (all models), by province (Goals and Thembisa) and by age (Thembisa and EMOD). Numbers of adult men, adult women, and (in Goals and Thembisa) children under 15 years living with HIV who were on ART over 2000&#x2013;2016 were estimated from national HIV program statistics. The resulting calibrated models are shown in 
                    <xref ref-type="fig" rid="f2">Figure 2</xref> (Goals), 
                    <xref ref-type="fig" rid="f3">Figure 3</xref>, and 
                    <xref ref-type="fig" rid="f4">Figure 4</xref> (Thembisa) and 
                    <xref ref-type="fig" rid="f5">Figure 5</xref> (EMOD).</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <p>Goals model calibration to national HSRC survey data, for (
                            <bold>a</bold>) HIV prevalence, and (
                            <bold>b</bold>) HIV incidence in men 15&#x2013;49 years. model outputs (blue lines = average across simulations; grey lines =  individual simulations) compared to data from HSRC surveys (black dots).</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure2.gif"/>
                </fig>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Thembisa model calibrations: provincial-level HIV prevalence produced by the calibrated model in the 15&#x2013;49 population (red) and pregnant women (blue) in comparison with time trends from antenatal clinic surveillance (closed circles), and prevalence data from the Human Sciences Research Council (HSRC) surveys (open circles).</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure3.gif"/>
                </fig>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>Figure 4. </label>
                    <caption>
                        <title>HIV incidence rates per annum in the 15&#x2013;49 population.</title>
                        <p>Solid line represent the average HIV incidence rate estimated by Thembisa; dashed lines represent 95% confidence intervals around the national estimates. Dots represent Human Sciences Research Council (HSRC) survey-based estimates of HIV incidence; the first 3 estimates are based on a synthetic cohort estimation approach, while the most recent 2 estimates are based on a multi-assay algorithm for detecting recent HIV infection
                            <sup>
                                <xref ref-type="bibr" rid="ref-47">47</xref>
                            </sup>.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure4.gif"/>
                </fig>
                <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                    <label>Figure 5. </label>
                    <caption>
                        <p>EMOD model calibration: (
                            <bold>a</bold>) National HIV prevalence in women and men 15&#x2013;49 years over time; (
                            <bold>b</bold>) National HIV incidence in women and men 15&#x2013;49 years over time.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure5.gif"/>
                </fig>
                <p>The effectiveness of MMC was set conservatively, as a direct reduction in female-to-male transmission probability per sex act of 60%
                    <sup>
                        <xref ref-type="bibr" rid="ref-11">11</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref-16">16</xref>
                    </sup>. All models also included onward transmission capturing the indirect effects on women as a result of reduced male prevalence and the subsequent indirect effects on men. We used a cost of US$ 132 per procedure, for surgical MMC, which was the only or predominant method used up to 2015, based on a national ingredients-based costing study in 33 public facilities including urban and rural dedicated MMC delivery points, integrated clinics, and outreach facilities
                    <sup>
                        <xref ref-type="bibr" rid="ref-43">43</xref>
                    </sup>. This covered direct and indirect cost including community mobilization and demand creation
                    <sup>
                        <xref ref-type="bibr" rid="ref-43">43</xref>
                    </sup>. The unit cost of (first-line) ART was set at US$ 342 per adult per year, including drugs, laboratory costs, and service delivery, estimated from the South Africa government&#x2019;s perspective
                    <sup>
                        <xref ref-type="bibr" rid="ref-44">44</xref>,
                        <xref ref-type="bibr" rid="ref-45">45</xref>
                    </sup>.</p>
            </sec>
            <sec>
                <title>MMC delivery and coverage, 2010&#x2013;2017</title>
                <p>The prevalence of traditional male circumcision was determined from self-reported male circumcision rates in national HIV surveys conducted prior to the start of the MMC program and surveys since 2010 were used to indicate current prevalence of circumcision from all sources. We used data from seven national surveys: South Africa&#x2019;s Human Sciences Research Council (HSRC) surveys of 2002, 2008, 2012 and 2017
                    <sup>
                        <xref ref-type="bibr" rid="ref-5">5</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref-7">7</xref>
                    </sup>, a national Demographic and Health Survey (DHS) in 2003
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup>, and the 2009 and 2012 national HIV communication surveys
                    <sup>
                        <xref ref-type="bibr" rid="ref-41">41</xref>,
                        <xref ref-type="bibr" rid="ref-42">42</xref>
                    </sup>.</p>
                <p>Data on MMCs performed between 2013 and 2017 in the public sector by district are contained in the District Health Information System (DHIS). Before this, data were collected at provincial level. Under-reporting was anticipated from MMCs conducted at community level through outreach or campaign events or mobile clinics if they were not reported to the local clinic. Another source of potential underreporting was from General Practitioners contracted by the Department of Health and not registered on the DHIS. Numbers of MMCs performed by province were taken from the national DHIS. These include MMCs performed in the public sector (Extended Data file 1, section A
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>); we added private-sector MMCs as an average of 2.2% of MMCs in any year, based on data provided by medical schemes, and added data from the PEPFAR database (Datim) for the large MMC campaign conducted in the winter of 2017&#x2013;2018, which had not been fully captured in the DHIS.</p>
                <p>The age distribution of men receiving MMC was obtained from the Datim database, since DHIS lacked age stratification. Based on Datim/PEPFAR, 43% of MMCs for the 10+ years age group were in boys 10&#x2013;14 years, 23.7% in 15&#x2013;19 years, 12.3% in men 20&#x2013;24 years, 20.1% in the 25&#x2013;49 year age group and 0.9% in men above 49 years. In the Thembisa and EMOD models, these MMCs were distributed directly to male individuals of the appropriate age. For the Goals model (without age structure), MMC numbers were translated into proportions of 15&#x2013;49-year-old men circumcised, by applying an age-structured population cohort calculation.</p>
                <p>All three models assumed (optimistically) that there is no replacement of traditional MCs by MMCs (i.e. the proportion of men who get traditionally circumcised remains constant over time). EMOD did not age-stratify the rate of traditional male circumcision; rather it assumed 42% of adult men in all age groups to be circumcised, as a way of assuming that traditional circumcision always took place prior to sexual debut. In contrast, MMCs could be conducted either before or after sexual debut. The age distribution of MMCs in EMOD and Thembisa model followed the age-stratified estimates provided by the Ministry of Health. For the 2018&#x2013;2030 scale-up, all three models applied the same age structure as in the 2009&#x2013;2017 program data.</p>
                <p>For MMC, South Africa&#x2019;s MMC policy prioritizes HIV-uninfected men. MMC candidates diagnosed with HIV at enrolment are referred for enrolment into ART, evaluated for clinical fitness for MMC, and offered MMC after enrolling into ART. Among program-recorded MMCs, 98% were in HIV-uninfected men. Thembisa and EMOD assumed that all MMCs were performed in HIV-negative men, while the Goals model assumed equal uptake of MMCs by HIV-positive and HIV-negative men (details in Extended Data File 1, section B
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>).</p>
            </sec>
            <sec>
                <title>MMC scale-up scenarios</title>
                <p>We modeled three scenarios to estimate the effects of the MMC program.</p>
                <list list-type="bullet">
                    <list-item>
                        <p>No MMC. This scenario assumes that the medical circumcision program was never implemented. The prevalence of male circumcision remains constant at the 2008 level through 2030.</p>
                    </list-item>
                    <list-item>
                        <p>MMC program stopped after 2017. This scenario includes the actual increases in circumcision coverage from 2010 to 2017 and then assumes that the program stopped, so that circumcision coverage changes after 2017 only due to the ageing of the population (see underlying data
                            <sup>
                                <xref ref-type="bibr" rid="ref-46">46</xref>
                            </sup>).</p>
                    </list-item>
                    <list-item>
                        <p>2021 program targets achieved. In this scenario, the annual MMC program targets for 2017&#x2013;2021 are met and additional circumcision are performed after 2021 in order to maintain the prevalence achieved in 2021.</p>
                    </list-item>
                </list>
                <p>For future coverage of ART and non-MMC prevention interventions, all three scenarios assume a 'status quo' setting, as described in detail for the Thembisa model
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>. For ART, we assumed a gradual ongoing increase in coverage, from 56% in 2017 to around 67% by 2021 and to around 72% by 2025, based on Thembisa projections assuming rates of ART initiation after diagnosis and rates of ART interruption in future are similar to those estimated in recent years. For condom use, we assumed no changes after 2017, and we assumed no significant roll-out of Pre-Exposure Prophylaxis. Also risk behaviours (commercial and casual sex and concurrent partnerships) were assumed to remain unchanged from the levels in 2017.</p>
                <p>The three models assumed a considerable effect of ART on reducing HIV infectivity and transmission, via viral load suppression (VLS): 75% reduced per-act transmission in Goals, between 84&#x2013;91% in Thembisa (based on 78&#x2013;86% VLS, according to program VLS monitoring data over 2005&#x2013;2015
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>), and 92% reduced per-act transmission in EMOD
                    <sup>
                        <xref ref-type="bibr" rid="ref-48">48</xref>
                    </sup>.</p>
                <p>The number of infections averted and the additional costs of the MMC program were calculated as the difference between the two scale-up scenarios and the &#x2018;No MMC&#x2019; scenario. We compared result for the historical period (2009&#x2013;2017) and the future (2017 through 2030). Ranges for our results are based on difference among the three models (see underlying data
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>).</p>
            </sec>
            <sec>
                <title>Statistical analysis</title>
                <p>The modeling analyses described here were conducted using the Goals module of the Spectrum software version 5.73, the Thembisa model version 4.1, and the EMOD HIV software version 2.20.</p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <sec>
                <title>MMC scale-up</title>
                <p>The Goals model estimated the coverage of traditional MC to have been 43% of men aged 15&#x2013;49 years in 2008. Thembisa estimated this to have been 36% and EMOD around 37% in 2008 and 38% in 2017. Both Thembisa and EMOD assume a net over-reporting of MC, i.e. that many of the men who report being circumcised are either not circumcised or only partially circumcised
                    <sup>
                        <xref ref-type="bibr" rid="ref-32">32</xref>,
                        <xref ref-type="bibr" rid="ref-33">33</xref>
                    </sup>.</p>
                <p>The output from all three models is consistent with program data and targets
                    <sup>
                        <xref ref-type="bibr" rid="ref-38">38</xref>
                    </sup> as shown in 
                    <xref ref-type="fig" rid="f6">Figure 6</xref>, e.g. 60% in 2017 (
                    <xref ref-type="fig" rid="f6">Figure 6d, e and f</xref>; details in underlying data
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>).</p>
                <fig fig-type="figure" id="f6" orientation="portrait" position="float">
                    <label>Figure 6. </label>
                    <caption>
                        <p>Modeled circumcisions: 
                            <bold>A</bold>, 
                            <bold>B</bold> and 
                            <bold>C</bold>: Number of new Medical Male Circumcisions (MMCs) occurring each year, and (
                            <bold>D</bold>, 
                            <bold>E</bold> and 
                            <bold>F</bold>) the resulting percentage of men ages 15&#x2013;49 who are circumcised, by scenario in (
                            <bold>A</bold> and 
                            <bold>D</bold>) Goals, (
                            <bold>B</bold> and 
                            <bold>E</bold>) Thembisa and (
                            <bold>C</bold> and 
                            <bold>F</bold>) EMOD model. The 2009&#x2013;2017 new MMCs are from program data
                            <sup>
                                <xref ref-type="bibr" rid="ref-49">49</xref>
                            </sup>; the 2009 baseline circumcision coverage was the modelers&#x2019; estimate based on 2002, 2008, 2012 and 2017 Human Sciences Research Council (HSRC) surveys
                            <sup>
                                <xref ref-type="bibr" rid="ref-3">3</xref>,
                                <xref ref-type="bibr" rid="ref-5">5</xref>&#x2013;
                                <xref ref-type="bibr" rid="ref-7">7</xref>
                            </sup>, 2003 DHS
                            <sup>
                                <xref ref-type="bibr" rid="ref-8">8</xref>
                            </sup>, and the 2009 and 2012 national HIV communication surveys
                            <sup>
                                <xref ref-type="bibr" rid="ref-41">41</xref>,
                                <xref ref-type="bibr" rid="ref-42">42</xref>
                            </sup>.
</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure6.gif"/>
                </fig>
                <p>In &#x2018;No MMC&#x2019; scenario, coverage in the 15&#x2013;49 year old cohort falls gradually back to the baseline level of 43% as uncircumcised 14-year-old boys age into the cohort and circumcised 49-year-old men age out (
                    <xref ref-type="fig" rid="f6">Figure 6d, e and f</xref>).</p>
                <p>If the 2021 targets are achieved and maintained, then annual number of MMCs drop sharply after 2021, once the &#x2018;catch-up&#x2019; phase is complete. During the subsequent 'maintenance' phase, circumcision prevalence is maintained by circumcising only 15 year-old boys. The proportion circumcised among men 15&#x2013;49 years continues to slightly increase (until 2027 in Thembisa, or until 2035 in Goals), as the MMCs conducted up to 2021 in boys aged under 15 years add to the cumulative coverage among 15&#x2013;49-year-old men.</p>
            </sec>
            <sec>
                <title>Impact of the MMC program, 2009&#x2013;2017</title>
                <p>Across the three models, the MMC program has averted an estimated 71,000&#x2013;83,000 HIV infections over 2009&#x2013;2017 (
                    <xref ref-type="fig" rid="f7">Figure 7</xref> and 
                    <xref ref-type="table" rid="T1">Table 1</xref>). This implies 33&#x2013;46 circumcisions or a cost of $4,400-$6,000 to avert one new infection (
                    <xref ref-type="table" rid="T1">Table 1</xref>).</p>
                <fig fig-type="figure" id="f7" orientation="portrait" position="float">
                    <label>Figure 7. </label>
                    <caption>
                        <p>Number of new HIV infections each year over 2009&#x2013;2040 by scenario, produced by the (
                            <bold>A</bold>) Goals, (
                            <bold>B</bold>) Thembisa and (
                            <bold>C</bold>) EMOD models. The scenarios shown are: the counterfactual of no Medical Male Circumcision (MMC) ever (black), the MMC program ends after 2017 (orange/red), the program targets through 2021 are met and maintained in a 'status quo' context (green). Infections are among all ages.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure7.gif"/>
                </fig>
                <table-wrap id="T1" orientation="portrait" position="anchor">
                    <label>Table 1. </label>
                    <caption>
                        <title>Projected impact, costs and savings from the MMC program in a 'status quo' background context, relative to the counterfactual scenario of no MMC program ever.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1">Scenario</th>
                                <th align="left" colspan="1" rowspan="1">Outcome</th>
                                <th align="left" colspan="1" rowspan="1">Goals model</th>
                                <th align="left" colspan="1" rowspan="1">Thembisa
                                    <break/> model
                                    <xref ref-type="other" rid="tfn1">*</xref>
                                </th>
                                <th align="left" colspan="1" rowspan="1">EMOD</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="4">Results over 2009&#x2013;;2017</td>
                                <td align="left" colspan="1" rowspan="1">Number of MMCs performed</td>
                                <td align="left" colspan="1" rowspan="1">3,175,986</td>
                                <td align="left" colspan="1" rowspan="1">2,763,444</td>
                                <td align="left" colspan="1" rowspan="1">3,233,009</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Number of HIV infections averted</td>
                                <td align="left" colspan="1" rowspan="1">73,663 (2%)</td>
                                <td align="left" colspan="1" rowspan="1">82,985 (2%)</td>
                                <td align="left" colspan="1" rowspan="1">70,731 (2%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">MMCs per infection averted</td>
                                <td align="left" colspan="1" rowspan="1">43</td>
                                <td align="left" colspan="1" rowspan="1">33</td>
                                <td align="left" colspan="1" rowspan="1">46</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Cost per infection averted</td>
                                <td align="left" colspan="1" rowspan="1">$ 5,691</td>
                                <td align="left" colspan="1" rowspan="1">$ 4,396</td>
                                <td align="left" colspan="1" rowspan="1">$ 6,034</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="4">Results 2009&#x2013;;2030;
                                    <break/>scenario Program ends
                                    <break/>after 2017</td>
                                <td align="left" colspan="1" rowspan="1">Number of MMCs performed</td>
                                <td align="left" colspan="1" rowspan="1">3,175,986</td>
                                <td align="left" colspan="1" rowspan="1">2,763,444</td>
                                <td align="left" colspan="1" rowspan="1">3,233,009</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Number of HIV infections averted</td>
                                <td align="left" colspan="1" rowspan="1">499,048 (6%)</td>
                                <td align="left" colspan="1" rowspan="1">496,837 (7%)</td>
                                <td align="left" colspan="1" rowspan="1">517,851 (6%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">MMCs per infection averted</td>
                                <td align="left" colspan="1" rowspan="1">6.6</td>
                                <td align="left" colspan="1" rowspan="1">5.6</td>
                                <td align="left" colspan="1" rowspan="1">6.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Cost per infection averted</td>
                                <td align="left" colspan="1" rowspan="1">$ 874</td>
                                <td align="left" colspan="1" rowspan="1">$ 734</td>
                                <td align="left" colspan="1" rowspan="1">$ 824</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="5">Results 2009&#x2013;;2030;
                                    <break/> scenario Program
                                    <break/> 2021 targets met and
                                    <break/> maintained</td>
                                <td align="left" colspan="1" rowspan="1">Number of MMCs performed</td>
                                <td align="left" colspan="1" rowspan="1">7,013,196</td>
                                <td align="left" colspan="1" rowspan="1">6,063,445</td>
                                <td align="left" colspan="1" rowspan="1">6,668,187</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Number of HIV infections averted</td>
                                <td align="left" colspan="1" rowspan="1">760,227 (9%)</td>
                                <td align="left" colspan="1" rowspan="1">747,441 (11%)</td>
                                <td align="left" colspan="1" rowspan="1">723,926 (8%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">MMCs per infection averted</td>
                                <td align="left" colspan="1" rowspan="1">9.2</td>
                                <td align="left" colspan="1" rowspan="1">8.1</td>
                                <td align="left" colspan="1" rowspan="1">9.2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Cost per infection averted</td>
                                <td align="left" colspan="1" rowspan="1">$1,218</td>
                                <td align="left" colspan="1" rowspan="1">$1,071</td>
                                <td align="left" colspan="1" rowspan="1">$ 1,218</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Savings in ART costs, 2018&#x2013;;2030</td>
                                <td align="left" colspan="1" rowspan="1">$ 1,159 million</td>
                                <td align="left" colspan="1" rowspan="1">$ 678 million</td>
                                <td align="left" colspan="1" rowspan="1">$ 601 million</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <fn>
                            <p>The percentages in parentheses represent the proportion of new HIV infections averted relative to the number of new HIV infections in the counterfactual scenario. Outcomes are for all ages (0&#x2013;99 years). MMC = Medical Male Circumcision</p>
                            <p id="tfn1">* Thembisa numbers in the first row relate to MMCs performed over the period from 1 April 2009 to 31 March 2017.</p>
                        </fn>
                    </table-wrap-foot>
                </table-wrap>
            </sec>
            <sec>
                <title>Long-term impact of MMC</title>
                <p>Next we evaluated the impact of actual recent, and targeted new MMCs over the longer timeframe of 2009&#x2013;2030 (
                    <xref ref-type="table" rid="T1">Table 1</xref>). The MMCs performed up to 2017 will avert 497,000&#x2013;518,000 new infections (6&#x2013;7% of all new infections) over 2009&#x2013;2030, even if no further MMCs are performed.</p>
                <p>Achieving the MMC targets by 2021, with maintenance thereafter, will avert 724,000&#x2013;760,000 infections (8&#x2013;11% of all new infections) over 2009&#x2013;2030. MMC is an efficient intervention, requiring only 8&#x2013;9 circumcisions per infection averted.</p>
                <p>Scaling-up to reach the 2021 targets and maintain that higher circumcision prevalence will prevent new infections compared to the &#x2018;No MMC&#x2019; scenario, but will also require additional expenditures.  Over 2009&#x2013;2030, the cost to avert one HIV infection with MMC will be $1,070&#x2013;1,220.</p>
                <p>Infections averted by MMC reduce the future ART treatment need and cost, by $ 602&#x2013;1,159 million over 2018&#x2013;2030 (
                    <xref ref-type="table" rid="T1">Table 1</xref>). Once the 2021 targets are achieved, the annual cost of maintaining circumcision coverage will drop by 70&#x2013;80% while the savings from treatment averted will continue to grow. A &#x2018;break-even&#x2019; point occurs when the cumulative savings from treatment averted exceed the cumulative costs of the MMC program. This occurs in 2034 in Goals, in 2036 in Thembisa model, and in 2038 in EMOD (
                    <xref ref-type="fig" rid="f8">Figure 8</xref>).</p>
                <fig fig-type="figure" id="f8" orientation="portrait" position="float">
                    <label>Figure 8. </label>
                    <caption>
                        <p>Costs of MMC and ART in the scenario in which the program targets for 2021 are achieved in a 'status quo' setting (without Fast Track), compared to the counterfactual scenario of no Medical Male Circumcisions (MMCs) ever, from (
                            <bold>A</bold>) Goals, (
                            <bold>B</bold>) Thembisa, and (
                            <bold>C</bold>) EMOD model. Shown are the cost of Medical Male Circumcision (MMC) if the program targets are met and maintained (blue bars), the cost of ART if the program targets are met and maintained (orange bars), and the cost of ART in the counterfactual scenario with no MMC ever (red lines). </p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure8.gif"/>
                </fig>
            </sec>
            <sec>
                <title>Sensitivity analyses</title>
                <p>The results of our sensitivity analyses are shown in 
                    <xref ref-type="table" rid="T2">Table 2</xref>. The main analysis did not discount future costs or infections averted. As an alternative we applied a 3% annual discount to future impacts and costs, using 2017 as the reference year. Over 2009&#x2013;2030, discounting increases the cost of MMC per infection averted from $1,070&#x2013;1,218 to $1,244&#x2013;1,400, because health impacts lag costs.</p>
                <table-wrap id="T2" orientation="portrait" position="anchor">
                    <label>Table 2. </label>
                    <caption>
                        <title>Sensitivity analyses. Impact and cost-effectiveness of South Africa&#x2019;s MMC program, under alternative assumptions for key parameters whose values are uncertain.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="2">Model variant</th>
                                <th align="center" colspan="3" rowspan="1">Infections averted</th>
                                <th align="center" colspan="3" rowspan="1">Cost
                                    <sup>
                                        <xref ref-type="other" rid="tfn2">a</xref>
                                    </sup> per infection averted</th>
                                <th align="center" colspan="3" rowspan="1">Break-even point
                                    <xref ref-type="other" rid="tfn3">*</xref>
                                </th>
                                <th align="center" colspan="3" rowspan="1">Savings from ART averted,
                                    <break/>millions of US$
                                    <xref ref-type="other" rid="tfn3">*</xref>
                                </th>
                            </tr>
                            <tr>
                                <th align="center" colspan="1" rowspan="1">Goals</th>
                                <th align="center" colspan="1" rowspan="1">Thembisa</th>
                                <th align="center" colspan="1" rowspan="1">EMOD</th>
                                <th align="center" colspan="1" rowspan="1">Goals</th>
                                <th align="center" colspan="1" rowspan="1">Thembisa</th>
                                <th align="center" colspan="1" rowspan="1">EMOD</th>
                                <th align="center" colspan="1" rowspan="1">Goals</th>
                                <th align="center" colspan="1" rowspan="1">Thembisa</th>
                                <th align="center" colspan="1" rowspan="1">EMOD</th>
                                <th align="center" colspan="1" rowspan="1">Goals</th>
                                <th align="center" colspan="1" rowspan="1">Thembisa</th>
                                <th align="center" colspan="1" rowspan="1">EMOD</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">
                                    <italic toggle="yes">Default</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">760,227</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">747,441</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">723,926</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">$ 1,218</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">$ 1,071</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">$ 1,218</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">2034</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">2036</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">2039</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">1,159</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">678</italic>
                                </td>
                                <td align="center" colspan="1" rowspan="1">
                                    <italic toggle="yes">602</italic>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">HIV infections averted and costs
                                    <break/>discounted at 3% per year after
                                    <break/>2017</td>
                                <td align="center" colspan="1" rowspan="1">610,103</td>
                                <td align="center" colspan="1" rowspan="1">609,507</td>
                                <td align="center" colspan="1" rowspan="1">528,132</td>
                                <td align="center" colspan="1" rowspan="1">$ 1,402</td>
                                <td align="center" colspan="1" rowspan="1">$ 1,244</td>
                                <td align="center" colspan="1" rowspan="1">$ 1,416</td>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Add MMC protective efficacy
                                    <break/> reducing M-to-F transmission
                                    <break/> by 46%</td>
                                <td align="center" colspan="1" rowspan="1">1,373,565</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">$ 674</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">ART and non-MMC prevention
                                    <break/> interventions scaled up 
                                    <break/>according to ambitious UNAIDS
                                    <break/> global Fast Track targets 
                                    <break/>(Extended Data File 1, section C),
                                    <break/> instead of status quo</td>
                                <td align="center" colspan="1" rowspan="1">47,638</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">105,141</td>
                                <td align="center" colspan="1" rowspan="1">$ 10,633</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">$ 4,313</td>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">Epidemics and MMC scale-up 
                                    <break/>modelled for each of 9 provinces
                                    <break/> separately, instead of as national 
                                    <break/>aggregate.</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">743,717</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1">$ 1,046</td>
                                <td align="center" colspan="1" rowspan="1">NA</td>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                                <td align="center" colspan="1" rowspan="1"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">MMC unit cost: $ 198 instead of 
                                    <break/>default $ 132</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                                <td align="center" colspan="1" rowspan="1">$ 1,827</td>
                                <td align="center" colspan="1" rowspan="1">$ 1,608</td>
                                <td align="center" colspan="1" rowspan="1">$ 1,826</td>
                                <td align="center" colspan="1" rowspan="1">2037</td>
                                <td align="center" colspan="1" rowspan="1">2039</td>
                                <td align="center" colspan="1" rowspan="1">2043</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">MMC unit cost: $ 66 instead of 
                                    <break/>default $ 132</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                                <td align="center" colspan="1" rowspan="1">$ 609</td>
                                <td align="center" colspan="1" rowspan="1">$ 536</td>
                                <td align="center" colspan="1" rowspan="1">$ 609</td>
                                <td align="center" colspan="1" rowspan="1">2029</td>
                                <td align="center" colspan="1" rowspan="1">2032</td>
                                <td align="center" colspan="1" rowspan="1">2034</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">ART unit cost: linear decline
                                    <break/> from $ 342 in 2017 to $ 293
                                    <break/> from 2026</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                                <td align="center" colspan="1" rowspan="1">2035</td>
                                <td align="center" colspan="1" rowspan="1">2037</td>
                                <td align="center" colspan="1" rowspan="1">2041</td>
                                <td align="center" colspan="1" rowspan="1">1,018</td>
                                <td align="center" colspan="1" rowspan="1">590</td>
                                <td align="center" colspan="1" rowspan="1">527</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1">ART unit cost: $ 400 over 2018&#x2013;
                                    <break/>2030, instead of default $342</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                                <td align="center" colspan="3" rowspan="1">As default</td>
                                <td align="center" colspan="1" rowspan="1">2032</td>
                                <td align="center" colspan="1" rowspan="1">2035</td>
                                <td align="center" colspan="1" rowspan="1">2038</td>
                                <td align="center" colspan="1" rowspan="1">1,356</td>
                                <td align="center" colspan="1" rowspan="1">792</td>
                                <td align="center" colspan="1" rowspan="1">704</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <fn>
                            <p>The results shown are for the scenario in which the program targets for 2021 are achieved in a 'Status quo' context, with  infections averted, cost per infection averted and savings from ART averted over 2009&#x2013;2030.</p>
                            <p id="tfn2">
                                <sup>a</sup> Cost is direct MMC program cost, not considering savings from ART averted</p>
                            <p>
                                <sup>d</sup> Default assumptions: No discounting, national aggregate models, MMC protective efficacy on female-to-male transmission 60% per sex act, no direct effect of MMC on male-to-female transmission.</p>
                            <p>NA = Not evaluated.</p>
                            <p>MMC = Medical Male Circumcision</p>
                            <p id="tfn3">* The break-even point is the year by which the cumulative savings from ART averted become larger than the cumulative MMC investment cost, indicating that MMC is cost-saving. For scenarios explored that did not alter the number of infections averted by MMC, the break-even year and the savings from antiretroviral therapy (ART) averted were selected as key outcome of the sensitivity analysis</p>
                        </fn>
                    </table-wrap-foot>
                </table-wrap>
                <p>We assumed that MMC had direct effects only on female-to-male transmission. An analysis by Hallett 
                    <italic toggle="yes">et al.</italic>
                    <sup>
                        <xref ref-type="bibr" rid="ref-39">39</xref>
                    </sup> indicated that there might be direct effects on male-to-female transmission as well. When we add a 46% protection effect against male-to-female transmission, the impact in terms of infections averted in the Goals model is 1.8-fold larger, and cost-effectiveness 1.8-fold better, than in the default results (
                    <xref ref-type="table" rid="T2">Table 2</xref>).</p>
                <p>If instead of remaining constant, the coverage of ART and other interventions continues to increase, then incidence will decline and MMC will be less cost-effective. Specifically, if coverage of other interventions reached UNAIDS Fast-Track targets for 2030
                    <sup>
                        <xref ref-type="bibr" rid="ref-50">50</xref>
                    </sup> (Extended Data File 1, section C
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>) then the number of MMCs needed to avert one infection and the cost to avert one infection are both higher (
                    <xref ref-type="table" rid="T2">Table 2</xref>). Even in this case the MMC program would avert 105,141 new infections (1.2%) in EMOD model or 45,638 (0.6%) in Goals model over 2008&#x2013;2030. In the year 2030, new infections under Fast Track would be 11% (EMOD) or 7% (Goals) higher without MMC scale-up than with MMC scale-up.</p>
                <p>The relation between the number of new infections in the No-MMC scenario and the impact and cost-effectiveness of MMC was assessed by examining correlations across individual simulations in the Thembisa and EMOD models, where all parameters were allowed to vary simultaneously within their respective uncertainty ranges (Extended Data file 1, section D
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>). There was a positive correlation between the number of HIV infections at baseline and the impact of MMC, and a negative correlation between baseline HIV infections and the cost per infection averted by MMC.</p>
                <p>According to another similar correlation analysis, the impact and cost-effectiveness of MMC were relatively insensitive to the effectiveness assumed for ART in reducing infectiousness (Pearson correlation coefficient 0.13, using the Thembisa model; Extended Data file 1, section D
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>).</p>
                <p>The main analyses assumed a constant ART unit cost of US $342 per person per year. But costs of ART are declining due to lower drug prices (particularly with the switch to dolutegravir) and differentiated service delivery. If we assume a linear decline from $342 in 2017 to $293
                    <sup>
                        <xref ref-type="bibr" rid="ref-45">45</xref>
                    </sup> by 2026, then the savings from averted ART costs due to MMC over 2018&#x2013;2030 are $527&#x2013;1,018 million, rather than the default $ 602&#x2013;1,159 million; and the break-even point would be postponed by 1 or 2 years in each model. Conversely, if we assumed a higher ART unit cost of $400 (throughout 2009&#x2013;2030) &#x2013; which could reflect the higher average unit cost if we consider patients on more expensive second-line ARVs &#x2013;  then the savings from averted ART costs due to MMC over 2018&#x2013;2030 would be $704&#x2013;1356 million, and the break-even point would be 1 or 2 years earlier across all models.</p>
                <p>Varying MMC unit cost to 50% more or less than the default cost assumption based on country data, changed the cost per infection averted by MMC linearly (
                    <xref ref-type="table" rid="T2">Table 2</xref>); the break-even point would be postponed by 3&#x2013;4 years with a 50% higher MMC unit cost, or fall 4&#x2013;5 years earlier in case of a 50% lower MMC unit cost (
                    <xref ref-type="table" rid="T2">Table 2</xref>).</p>
                <p>Finally, when MMC scale-up and impacts were modelled for each of South Africa&#x2019;s 9 provinces and the results aggregated, in the Thembisa model (
                    <xref ref-type="table" rid="T2">Table 2</xref> and 
                    <xref ref-type="fig" rid="f9">Figure 9</xref>), the aggregate national results were similar to those of the (default) national model.</p>
                <fig fig-type="figure" id="f9" orientation="portrait" position="float">
                    <label>Figure 9. </label>
                    <caption>
                        <title>Provincial differences in MMC rollout and impact on HIV incidence.</title>
                        <p>In the Thembisa provincial model for Limpopo, age-specific limits on the uptake of Medical Male Circumcision (MMC) were exceeded, with the result that the modelled number of MMC operations exceeded that reported by the program in some years (2015&#x2013;2021). EC = Eastern Cape; FS = Free State; GT = Gauteng; KZ = KwaZulu-Natal; LP = Limpopo; MP = Mpumalanga; NC = Northern Cape; NW = North West; WC = Western Cape.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14439/dac9c518-8305-4604-91ff-af6cffa48c42_figure9.gif"/>
                </fig>
            </sec>
            <sec>
                <title>Impact by province</title>
                <p>Results differed substantially by province. Over the 2016&#x2013;17 period, the Thembisa model estimated that the reduction in new HIV infections as a result of the MMC programme varied between 1% in the Western Cape province and 10% in the KwaZulu-Natal and Limpopo provinces, reflecting substantial inter-provincial differences in the extent of MMC scale-up (
                    <xref ref-type="fig" rid="f9">Figure 9b</xref>). Assuming that the distribution of MMC operations occurring in each province will remain roughly unchanged up to 2021, and assuming the male circumcision coverage in each province remains roughly stable after 2021, it is anticipated that the Western Cape and Northern Cape provinces will have the lowest rates of male circumcision in future, while the KwaZulu-Natal, Free State, Mpumalanga and Limpopo provinces will have achieved the most  substantial growth in male circumcision coverage (
                    <xref ref-type="fig" rid="f9">Figure 9a</xref>). Over the period from 2017 to 2030, the reduction in total new HIV infections due to MMC promotion is expected to vary between 6&#x2013;8% in the Eastern Cape and Western Cape provinces and 23&#x2013;27% in the Free State, KwaZulu-Natal and Mpumalanga provinces (
                    <xref ref-type="fig" rid="f9">Figure 9b</xref>).</p>
            </sec>
        </sec>
        <sec sec-type="discussion">
            <title>Discussion</title>
            <p>Our results indicate that the South African MMC program has already had an impact on reducing new HIV infections and that impact will grow substantially in the future as the full benefits of the past program are realized. Achieving the targets of the MMC strategy will increase the benefits even more. Since MMC is a one-time intervention, the cost per infection averted is low compared to most other HIV prevention interventions. Other work
                <sup>
                    <xref ref-type="bibr" rid="ref-27">27</xref>
                </sup> has suggested that MMC also has a comparatively low cost per DALY averted in comparison to key global non-HIV public health/infectious disease interventions
                <sup>
                    <xref ref-type="bibr" rid="ref-51">51</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref-54">54</xref>
                </sup>. We show that investments in MMC will be more than offset by savings in terms of reduced expenditures for future treatment. MMC remains beneficial even if other prevention targets, as specified in Fast-Track, are reached.</p>
            <p>Overall, our combined results are in line with earlier evaluations of MMC cost-effectiveness in other sub-Saharan African settings; for example, MMC&#x2019;s cost per infection averted (which ignores future savings from ART averted) was estimated at between $131 and $3,160 across three regions in Mozambique
                <sup>
                    <xref ref-type="bibr" rid="ref-27">27</xref>
                </sup> and at a median of $4,400 across 14 priority countries in eastern and southern Africa
                <sup>
                    <xref ref-type="bibr" rid="ref-55">55</xref>
                </sup>.</p>
            <p>A similar modeling study in Zimbabwe
                <sup>
                    <xref ref-type="bibr" rid="ref-47">47</xref>
                </sup> that also used the Goals and EMOD models (but not Thembisa) plus a model from Imperial College found that cost per infection averted was good but at $2,100&#x2013;3,250 per infection averted was twice as expensive as in South Africa
                <sup>
                    <xref ref-type="bibr" rid="ref-56">56</xref>
                </sup> and the potential savings were less than in South Africa. The better results in South Africa are likely due to higher incidence and higher cost per person-year of ART.</p>
            <p>Cost per infection averted was estimated to be even better in a study that modelled hypothetical MMC scale-up starting in 2006 for South Africa ($181&#x2013;551)
                <sup>
                    <xref ref-type="bibr" rid="ref-57">57</xref>
                </sup>, reflecting the higher baseline incidence over this early evaluation period.</p>
            <p>Our analysis and other modeling studies
                <sup>
                    <xref ref-type="bibr" rid="ref-19">19</xref>,
                    <xref ref-type="bibr" rid="ref-27">27</xref>,
                    <xref ref-type="bibr" rid="ref-55">55</xref>,
                    <xref ref-type="bibr" rid="ref-57">57</xref>,
                    <xref ref-type="bibr" rid="ref-58">58</xref>
                </sup> show the benefits of direct protection for men and indirect protection for women. The benefits are even larger if there is also a direct effect on male-to-female transmission. Other benefits of MMC include reductions in sexually transmitted bacterial and viral infections such as herpes simplex virus type 2, syphilis and human papillomavirus
                <sup>
                    <xref ref-type="bibr" rid="ref-59">59</xref>,
                    <xref ref-type="bibr" rid="ref-60">60</xref>
                </sup>, and associated penile and cervical cancers
                <sup>
                    <xref ref-type="bibr" rid="ref-61">61</xref>,
                    <xref ref-type="bibr" rid="ref-62">62</xref>
                </sup> in the circumcised men and their female partners , and the opportunity through pre-MMC HIV testing to link HIV-positive men into care. The external benefits not considered here furthermore include capacity building of providers including in broader HIV prevention counselling, and linkage of MMC clients to other men&#x2019;s health programs.</p>
            <sec>
                <title>Limitations</title>
                <p>The validity and precision of model-based results depend on the validity of input data and assumptions including model structures. The similarities in our results across the models indicates that these results are robust across different model structures (Extended Data file, section B
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>). However, certain variations in results across the three models indicates some real remaining uncertainty, stemming from both ambiguities with input data and model-related uncertainties.</p>
                <p>One uncertainty remains the current level of HIV incidence, which drives absolute numbers of infections averted. The 2012 HSRC survey measured HIV incidence among adults (ages 15&#x2013;49), using a multi-assay algorithm that included Limiting-Antigen Avidity Enzyme Immune Assay, at 1.21 (0.97&#x2013;1.45) and 2.28 (1.84&#x2013;2.74) per 100 male and female person-years, respectively
                    <sup>
                        <xref ref-type="bibr" rid="ref-6">6</xref>
                    </sup>. All three models predicted somewhat lower incidence rates for 2012: 1.2 in men and 1.8 in women in Goals, 1.00 and 1.7 in both Thembisa and EMOD. Earlier models also did not generally estimate incidence rates as high as the 2012 HSRC observation
                    <sup>
                        <xref ref-type="bibr" rid="ref-25">25</xref>
                    </sup>. Possibly the 2012 survey over-estimated incidence, by assuming a zero false-recent rate
                    <sup>
                        <xref ref-type="bibr" rid="ref-47">47</xref>
                    </sup>. If our models used incidence that is too high, they would over-estimate the impact and cost-effectiveness. Nevertheless, to refine models and MMC impact projections in future, the fitting to incidence measurements, including from the 2017 national survey
                    <sup>
                        <xref ref-type="bibr" rid="ref-3">3</xref>
                    </sup> whose incidence estimates was not yet used for the current modelling, may merit reconsideration.</p>
                <p>Men might adopt riskier behaviors after circumcision; such behavioral risk compensation would lead to overestimation of MMC impact. Studies in KwaZulu-Natal
                    <sup>
                        <xref ref-type="bibr" rid="ref-63">63</xref>,
                        <xref ref-type="bibr" rid="ref-64">64</xref>
                    </sup> and Orange Farm
                    <sup>
                        <xref ref-type="bibr" rid="ref-65">65</xref>
                    </sup> in South Africa, similar to studies in Zimbabwe
                    <sup>
                        <xref ref-type="bibr" rid="ref-66">66</xref>
                    </sup>, Kenya
                    <sup>
                        <xref ref-type="bibr" rid="ref-67">67</xref>
                    </sup> and Uganda
                    <sup>
                        <xref ref-type="bibr" rid="ref-68">68</xref>
                    </sup>, found no evidence for changed risk behaviours after MMC. However, surveys in Cape Town found perceptions or expectations of MMC-related risk compensation in both men and women
                    <sup>
                        <xref ref-type="bibr" rid="ref-69">69</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref-71">71</xref>
                    </sup>. A further source of impact overestimation could be elevated risk during wound healing. There is limited published  evidence for or against this in South Africa; however a study in uMgungundlovu in Kwa-Zulu Natal found that 29% of adolescent boys resumed sex during the six week healing period
                    <sup>
                        <xref ref-type="bibr" rid="ref-72">72</xref>
                    </sup>.</p>
            </sec>
            <sec>
                <title>Programmatic implications</title>
                <p>To monitor progress towards targets and ascertain MMC coverage by district, it is important that all data are captured in the DHIS. Particular attention is needed to ensure that the MMC numbers conducted at community level and by General Practitioners contracted by provinces are captured. To this end, training in the National Department of Health Standard Operating Procedure for MMC data flow process is required for all partners performing MMCs regardless of the location
                    <sup>
                        <xref ref-type="bibr" rid="ref-73">73</xref>
                    </sup>.</p>
                <p>These results illustrate that transitioning from MMC scale-up into a &#x2018;maintenance phase&#x2019; at which coverage would stay constant at the target achieved implies a substantial reduction in annual MMC numbers after the target year. However, in countries like South Africa with very high HIV incidence the program target should probably rather be to increase MC coverage to higher than 80%.</p>
                <p>It is concerning that in some provinces (most notably the Western Cape), there has been limited adoption of MMC. This may be related to cultural resistance to MMC among the Xhosa
                    <sup>
                        <xref ref-type="bibr" rid="ref-74">74</xref>
                    </sup>, one of the major ethnic groups in the Western Cape and Eastern Cape provinces. Alternatively, this may be a reflection of a lack of clear policy or resources. Action is required to address the low rates of MMC uptake in some provinces.</p>
                <p>In conclusion, this analysis shows that the MMC program in South Africa has already had impact, and its health and economic benefits will grow significantly in the future. An investment in MMC programs now will provide substantial benefits in the long-term.</p>
            </sec>
        </sec>
        <sec>
            <title>Data availability</title>
            <sec>
                <title>Models</title>
                <p>All three models are freely available. Goals is part of the Spectrum modeling program and can be downloaded at: 
                    <ext-link ext-link-type="uri" xlink:href="https://www.avenirhealth.org/software-spectrum.php">https://www.avenirhealth.org/software-spectrum.php</ext-link>. The Thembisa model is available for download at: 
                    <ext-link ext-link-type="uri" xlink:href="https://www.thembisa.org/downloads">https://www.thembisa.org/downloads</ext-link>. The EMOD software can be downloaded from: 
                    <ext-link ext-link-type="uri" xlink:href="https://www.idmod.org/docs/hiv/install-overview.html">https://www.idmod.org/docs/hiv/install-overview.html</ext-link>
                </p>
            </sec>
            <sec>
                <title>Underlying data</title>
                <p>DRYAD: The impact of the program for medical male circumcision on HIV in South Africa: analysis using three epidemiological models. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5061/dryad.b8gtht7bp">https://doi.org/10.5061/dryad.b8gtht7bp</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>
                </p>
                <p>This project contains the following underlying data:</p>
                <list list-type="bullet">
                    <list-item>
                        <p>ExtendedDataFile2 Goals model detail results_06Dec2020.xlsx (Excel file with results from the Goals model including scenario descriptions, new infection, HIV prevalence, population size, people living with HIV (PLHIV), number of circumcisions (VMMC) and number of people on antiretroviral therapy (ART))</p>
                    </list-item>
                    <list-item>
                        <p>ExtendedDataFile2 Thembisa model detail results 06Dec2020.xlsx (Excel file with results from the Goals model including scenario descriptions, new infection, HIV prevalence, population size, people living with HIV (PLHIV), number of circumcisions (VMMC) and number of people on antiretroviral therapy (ART))</p>
                    </list-item>
                    <list-item>
                        <p>ExtendedDataFile2 EMOD model detail results 06Dec2020.xlsx (Excel file with results from the Goals model including scenario descriptions, new infection, HIV prevalence, population size, people living with HIV (PLHIV), number of circumcisions (VMMC) and number of people on antiretroviral therapy (ART))</p>
                    </list-item>
                </list>
            </sec>
            <sec>
                <title>Extended data</title>
                <p>DRYAD: The impact of the program for medical male circumcision on HIV in South Africa: analysis using three epidemiological models. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5061/dryad.b8gtht7bp">https://doi.org/10.5061/dryad.b8gtht7bp</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-46">46</xref>
                    </sup>
                </p>
                <p>This project contains the following extended data:</p>
                <list list-type="bullet">
                    <list-item>
                        <label>- </label>
                        <p> Extended_Data_File1_28Dec2020_ek.docx (Document with additional figures and tables)</p>
                    </list-item>
                </list>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero "No rights reserved" data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
    </body>
    <back>
        <sec>
            <title>Author information</title>
            <p>Clarence Manuhwa was an Independent Consultant whilst working on this article, but is currently affiliated with FHI 360.</p>
        </sec>
        <ack>
            <title>Acknowledgements</title>
            <p>We thank Maaya Sundaram (Bill &amp; Melinda Gates Foundation) and Peter Stegman (Avenir Health) for helpful advice. The views expressed in this paper are those of the authors and do not necessarily represent the position of South Africa&#x2019;s Department of Health, CHAI, Avenir Health, University of Cape Town, the Institute for Disease Modeling, the Bill &amp; Melinda Gates Foundation, or other affiliated organizations.</p>
        </ack>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Myer</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mathews</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Little</surname>
                            <given-names>F</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The fate of free male condoms distributed to the public in South Africa.</article-title>
                    <source>

                        <italic toggle="yes">AIDS.</italic>
</source>
                    <year>2001</year>;<volume>15</volume>(<issue>6</issue>):<fpage>789</fpage>&#x2013;<lpage>93</lpage>.
                    <pub-id pub-id-type="pmid">11371694</pub-id>
                    <pub-id pub-id-type="doi">10.1097/00002030-200104130-00015</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Boulle</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bock</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Osler</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Antiretroviral therapy and early mortality in South Africa.</article-title>
                    <source>

                        <italic toggle="yes">Bull World Health Organ.</italic>
</source>
                    <year>2008</year>;<volume>86</volume>(<issue>9</issue>):<fpage>678</fpage>&#x2013;<lpage>87</lpage>.
                    <pub-id pub-id-type="pmid">18797643</pub-id>
                    <pub-id pub-id-type="doi">10.2471/blt.07.045294</pub-id>
                    <pub-id pub-id-type="pmcid">2649489</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <collab>South Africa Human Sciences Research Council</collab>:
                    <article-title>The fifth South African national HIV prevalence, incidence, behaviour and communication surveys, 2017 (SABSSM V1): HIV impact assessment summary report.</article-title>Cape Town: South Africa Human Sciences Research Council,<year>2018</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://serve.mg.co.za/content/documents/2018/07/17/7M1RBtUShKFJbN3NL1Wr_HSRC_HIV_Survey_Summary_2018.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dorrington</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>Thembisa, version 4.1: a mathematical model of HIV transmission and epidemic spread in South Africa</article-title>.<year>2018</year>.</mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <collab>South Africa Human Sciences Research Council</collab>:
                    <article-title>South African national HIV Prevalence, Incidence, behavioural risks and mass media household survey 2002.</article-title>Cape Town: South Africa Human Sciences Research Council,<year>2003</year>.</mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shisana</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rehle</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Simbayi</surname>
                            <given-names>LC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>South African National HIV Prevalence, Incidence and Behaviour Survey, 2012.</article-title>Cape Town: South Africa Human Sciences Research Council,<year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.knowledgehub.org.za/system/files/elibdownloads/2019-07/HIV-prevalenceincidencebehaviour-survey-SABSSM-IV.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shisana</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rehle</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Simbayi</surname>
                            <given-names>LC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>South African National HIV Prevalence, Incidence, Behaviour and Communication Survey, 2008: A Turning Tide Among Teenagers?</article-title>Cape Town: South Africa Human Sciences Research Council,<year>2009</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://datause.ucsf.edu/sites/datause.ucsf.edu/files/South%20African%20National%20HIV%20Prevalence%2C%20Incidence%20and%20Behaviour%20Survey%2C%202008.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <collab>Department of Health South Africa, South Africa Medical Research Council, ORC Macro</collab>:
                    <article-title>South Africa Demographic and Health Survey 2003.</article-title>Pretoria: ICF International,<year>2007</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.samrc.ac.za/sites/default/files/files/2017-07-03/sadhs2003coverpg.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shisana</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rehle</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Simbayi</surname>
                            <given-names>LC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>South African National HIV Prevalence, Incidence, Behaviour and Communication Survey, 2005.</article-title>Cape Town: South Africa Human Sciences Research Council,<year>2008</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.hst.org.za/publications/NonHST%20Publications/HIV_HouseholdSurvey2005.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>LF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dorrington</surname>
                            <given-names>RE</given-names>
                        </name>
</person-group>:
                    <article-title>Thembisa version 4.1: A model for evaluating the impact of HIV/AIDS in South Africa.</article-title>Cape Town: University of Cape Town,<year>2018</year>.</mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Auvert</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Taljaard</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lagarde</surname>
                            <given-names>E</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 trial.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Med.</italic>
</source>
                    <year>2005</year>;<volume>2</volume>(<issue>11</issue>):<fpage>e298</fpage>.
                    <pub-id pub-id-type="pmid">16231970</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pmed.0020298</pub-id>
                    <pub-id pub-id-type="pmcid">1262556</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gray</surname>
                            <given-names>RH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kigozi</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Serwadda</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial.</article-title>
                    <source>

                        <italic toggle="yes">Lancet.</italic>
</source>
                    <year>2007</year>;<volume>369</volume>(<issue>9562</issue>):<fpage>657</fpage>&#x2013;<lpage>66</lpage>.
                    <pub-id pub-id-type="pmid">17321311</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S0140-6736(07)60313-4</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bailey</surname>
                            <given-names>RC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Moses</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Parker</surname>
                            <given-names>CB</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial.</article-title>
                    <source>

                        <italic toggle="yes">Lancet.</italic>
</source>
                    <year>2007</year>;<volume>369</volume>(<issue>9562</issue>):<fpage>643</fpage>&#x2013;<lpage>56</lpage>.
                    <pub-id pub-id-type="pmid">17321310</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S0140-6736(07)60312-2</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mehta</surname>
                            <given-names>SD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Moses</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Agot</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The long-term efficacy of medical male circumcision against HIV acquisition.</article-title>
                    <source>

                        <italic toggle="yes">AIDS.</italic>
</source>
                    <year>2013</year>;<volume>27</volume>(<issue>18</issue>):<fpage>2899</fpage>&#x2013;<lpage>907</lpage>.
                    <pub-id pub-id-type="pmid">23835501</pub-id>
                    <pub-id pub-id-type="doi">10.1097/01.aids.0000432444.30308.2d</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lei</surname>
                            <given-names>JH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>LR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wei</surname>
                            <given-names>Q</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Circumcision Status and Risk of HIV Acquisition during Heterosexual Intercourse for Both Males and Females: A Meta-Analysis.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2015</year>;<volume>10</volume>(<issue>5</issue>):<fpage>e0125436</fpage>.
                    <pub-id pub-id-type="pmid">25942703</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0125436</pub-id>
                    <pub-id pub-id-type="pmcid">4420461</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sharma</surname>
                            <given-names>SC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Raison</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Khan</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Male circumcision for the prevention of human immunodeficiency virus (HIV) acquisition: a meta-analysis.</article-title>
                    <source>

                        <italic toggle="yes">BJU Int.</italic>
</source>
                    <year>2018</year>;<volume>121</volume>(<issue>4</issue>):<fpage>515</fpage>&#x2013;<lpage>26</lpage>.
                    <pub-id pub-id-type="pmid">29232046</pub-id>
                    <pub-id pub-id-type="doi">10.1111/bju.14102</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <collab>World Health Organization</collab>:
                    <article-title>Joint strategic action framework to accelerate the scale-up of voluntary medical male circumcision for HIV prevention in Eastern and Southern Africa -- 2012-2016.</article-title>Geneva:<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.who.int/hiv/pub/strategic_action2012_2016/en/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <collab>South African National AIDS Council</collab>:
                    <article-title>National Strategic Plan for HIV, STIs and TB, 2012 - 2016.</article-title>Pretoria:<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.gov.za/sites/default/files/gcis_document/201409/hivaidsplan0.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kripke</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chen</surname>
                            <given-names>PA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vazzano</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Cost and Impact of Voluntary Medical Male Circumcision in South Africa: Focusing the Program on Specific Age Groups and Provinces.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2016</year>;<volume>11</volume>(<issue>7</issue>):<fpage>e0157071</fpage>.
                    <pub-id pub-id-type="pmid">27409079</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0157071</pub-id>
                    <pub-id pub-id-type="pmcid">4943592</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <collab>South African National AIDS Council</collab>:
                    <article-title>National Strategic Plan for HIV, TB and STIs 2017 - 2022.</article-title>Pretoria:<year>2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.nsp.sanac.org.za/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <collab>PEPFAR South Africans and Americans in partnership to fight HIV/AIDS</collab>:
                    <article-title> South Africa  Country Operational Plan 2017 (COP17) Strategic Direction Summary (SDS). </article-title>
                    <year>2017</year>. (final approved COP17 draft).
                    <ext-link ext-link-type="uri" xlink:href="https://za.usembassy.gov/wp-content/uploads/sites/19/2017/03/SA-PEPFAR-COP-2017-Strategic-Directions-Summary-final-draft-16-March-2017-Public-Version.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Williams</surname>
                            <given-names>BG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lloyd-Smith</surname>
                            <given-names>JO</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gouws</surname>
                            <given-names>E</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The potential impact of male circumcision on HIV in Sub-Saharan Africa.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Med.</italic>
</source>
                    <year>2006</year>;<volume>3</volume>(<issue>7</issue>):<fpage>1032</fpage>&#x2013;<lpage>40</lpage>.
                    <pub-id pub-id-type="pmid">16822094</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pmed.0030262</pub-id>
                    <pub-id pub-id-type="pmcid">1489185</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Verguet</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Efficient and equitable HIV prevention: A case study of male circumcision in South Africa.</article-title>
                    <source>

                        <italic toggle="yes">Cost Eff Resour Alloc.</italic>
</source>
                    <year>2013</year>;<volume>11</volume>(<issue>1</issue>):<fpage>1</fpage>.
                    <pub-id pub-id-type="pmid">23289923</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1478-7547-11-1</pub-id>
                    <pub-id pub-id-type="pmcid">3561239</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pretorius</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Stover</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bollinger</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Evaluating the cost-effectiveness of pre-exposure prophylaxis (PrEP) and its impact on HIV-1 transmission in South Africa.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2010</year>;<volume>5</volume>(<issue>11</issue>):<fpage>e13646</fpage>.
                    <pub-id pub-id-type="pmid">21079767</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0013646</pub-id>
                    <pub-id pub-id-type="pmcid">2974638</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-25">
                <label>25</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eaton</surname>
                            <given-names>JW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bacaer</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bershteyn</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Assessment of epidemic projections using recent HIV survey data in South Africa: a validation analysis of ten mathematical models of HIV epidemiology in the antiretroviral therapy era.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Glob Health.</italic>
</source>
                    <year>2015</year>;<volume>3</volume>(<issue>10</issue>):<fpage>e598</fpage>&#x2013;<lpage>608</lpage>.
                    <pub-id pub-id-type="pmid">26385301</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S2214-109X(15)00080-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-26">
                <label>26</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Heaton</surname>
                            <given-names>LM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bouey</surname>
                            <given-names>PD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fu</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Estimating the impact of the US President's Emergency Plan for AIDS Relief on HIV treatment and prevention programmes in Africa.</article-title>
                    <source>

                        <italic toggle="yes">Sex Transm Infect.</italic>
</source>
                    <year>2015</year>;<volume>91</volume>(<issue>8</issue>):<fpage>615</fpage>&#x2013;<lpage>20</lpage>.
                    <pub-id pub-id-type="pmid">26056389</pub-id>
                    <pub-id pub-id-type="doi">10.1136/sextrans-2014-051991</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-27">
                <label>27</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Korenromp</surname>
                            <given-names>EL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gobet</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fazito</surname>
                            <given-names>E</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Impact and Cost of the HIV/AIDS National Strategic Plan for Mozambique, 2015-2019--Projections with the Spectrum/Goals Model.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2015</year>;<volume>10</volume>(<issue>11</issue>):<fpage>e0142908</fpage>.
                    <pub-id pub-id-type="pmid">26565696</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0142908</pub-id>
                    <pub-id pub-id-type="pmcid">4643916</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-28">
                <label>28</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alaeddini</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Klein</surname>
                            <given-names>DJ</given-names>
                        </name>
</person-group>:
                    <article-title>Parallel simultaneous perturbation optimization</article-title>.<year>2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://arxiv.org/abs/1704.00223">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-29">
                <label>29</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alaeddini</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Klein</surname>
                            <given-names>DJ</given-names>
                        </name>
</person-group>:
                    <article-title>Application of a Second-order Stochastic Optimization Algorithm for Fitting Stochastic Epidemiological Models</article-title>. Seattle: Institute for Disease Modelling.<year>2017</year>.
                    <pub-id pub-id-type="doi">10.1109/WSC.2017.8247951</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-30">
                <label>30</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>LF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chiu</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Myer</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Prospects for HIV control in South Africa: a model-based analysis.</article-title>
                    <source>

                        <italic toggle="yes">Glob Health Action.</italic>
</source>
                    <year>2016</year>;<volume>9</volume>:<fpage>30314</fpage>.
                    <pub-id pub-id-type="pmid">27282146</pub-id>
                    <pub-id pub-id-type="doi">10.3402/gha.v9.30314</pub-id>
                    <pub-id pub-id-type="pmcid">4901512</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-31">
                <label>31</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Connolly</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Simbayi</surname>
                            <given-names>LC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shanmugam</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Male circumcision and its relationship to HIV infection in South Africa: results of a national survey in 2002.</article-title>
                    <source>

                        <italic toggle="yes">S Afr Med J.</italic>
</source>
                    <year>2008</year>;<volume>98</volume>(<issue>10</issue>):<fpage>789</fpage>&#x2013;<lpage>94</lpage>.
                    <pub-id pub-id-type="pmid">19115756</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-32">
                <label>32</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lissouba</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Taljaard</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rech</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Adult male circumcision as an intervention against HIV: an operational study of uptake in a South African community (ANRS 12126).</article-title>
                    <source>

                        <italic toggle="yes">BMC Infect Dis.</italic>
</source>
                    <year>2011</year>;<volume>11</volume>:<fpage>253</fpage>.
                    <pub-id pub-id-type="pmid">21943076</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1471-2334-11-253</pub-id>
                    <pub-id pub-id-type="pmcid">3192707</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-33">
                <label>33</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thomas</surname>
                            <given-names>AG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tran</surname>
                            <given-names>BR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cranston</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Voluntary medical male circumcision: a cross-sectional study comparing circumcision self-report and physical examination findings in Lesotho.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2011</year>;<volume>6</volume>(<issue>11</issue>):<fpage>e27561</fpage>.
                    <pub-id pub-id-type="pmid">22140449</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0027561</pub-id>
                    <pub-id pub-id-type="pmcid">3226626</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-34">
                <label>34</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Simbayi</surname>
                            <given-names>LC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zuma</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zungu</surname>
                            <given-names>N</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>South African National HIV Prevalence, Incidence, Behaviour and Communication Survey, 2017</article-title>.<year>2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.hsrcpress.ac.za/books/south-african-national-hiv-prevalence-incidence-behaviour-and-communication-survey-2017">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-35">
                <label>35</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kikaya</surname>
                            <given-names>V</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Skolnik</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Garcia</surname>
                            <given-names>MC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Voluntary medical male circumcision programs can address low HIV testing and counseling usage and ART enrollment among young men: lessons from Lesotho.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2014</year>;<volume>9</volume>(<issue>5</issue>):<fpage>e83614</fpage>.
                    <pub-id pub-id-type="pmid">24801714</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0083614</pub-id>
                    <pub-id pub-id-type="pmcid">4011866</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-36">
                <label>36</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Phili</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Abdool Karim</surname>
                            <given-names>Q</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tlou</surname>
                            <given-names>Bl</given-names>
                        </name>
</person-group>:
                    <article-title>Experiences in the implementation of provider-initiated counselling and testing and linkage to HIV services at urban public sector health facilities in KwaZulu-Natal.</article-title>
                    <source>

                        <italic toggle="yes">S Afr J Infect Dis.</italic>
</source>
                    <year>2015</year>;<volume>30</volume>(<issue>3</issue>):<fpage>77</fpage>&#x2013;<lpage>81</lpage>.
                    <pub-id pub-id-type="doi">10.1080/23120053.2015.1074433</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-37">
                <label>37</label>
                <mixed-citation publication-type="journal">
                    <article-title>World Population Prospects 2017 [Internet]</article-title>.<year>2017</year>[cited 16 November 2017].
                    <ext-link ext-link-type="uri" xlink:href="http://esa.un.org/unpd/wpp/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-38">
                <label>38</label>
                <mixed-citation publication-type="journal">
                    <collab>South Africa National Department of Health</collab>:
                    <article-title>2015 National Antenatal Sentinel HIV &amp; Syphilis Survey Report</article-title>. Pretoria:<year>2017</year>.</mixed-citation>
            </ref>
            <ref id="ref-39">
                <label>39</label>
                <mixed-citation publication-type="journal">
                    <collab>Department of Health South Africa</collab>:
                    <article-title>Demographic and Health Survey 1998: Full Report</article-title>. Pretoria:<year>1999</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.dhsprogram.com/pubs/pdf/FR131/FR131.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-40">
                <label>40</label>
                <mixed-citation publication-type="journal">
                    <collab>Department of Health, </collab>
                    <collab>Statistics South Africa, </collab>
                    <collab>South African Medical Research Council, </collab>
                    <collab>ICF</collab>:
                    <article-title>South Africa Demographic and Health Survey 2016: Key Indicator Report</article-title>. Pretoria,<year>2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://dhsprogram.com/pubs/pdf/FR337/FR337.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-41">
                <label>41</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kincaid</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Laurence</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Second National HIV Communication Survey 2009</article-title>. Pretoria: Johns Hopkins Health and Education in South Africa.<year>2010</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.ccisa.org.za/sites/default/files/pdfs/03_National_Communication_Survey.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-42">
                <label>42</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kincaid</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Figueroa</surname>
                            <given-names>ME</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Third National HIV Communication Survey, 2012</article-title>. Pretoria: Johns Hopkins Health and Education in South Africa.<year>2013</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.ccisa.org.za/sites/default/files/hiv_survey.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-43">
                <label>43</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tchuenche</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Palmer</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hate</surname>
                            <given-names>V</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Correction: The Cost of Voluntary Medical Male Circumcision in South Africa.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2017</year>;<volume>12</volume>(<issue>1</issue>):<fpage>e0169710</fpage>.
                    <pub-id pub-id-type="pmid">28046088</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0169710</pub-id>
                    <pub-id pub-id-type="pmcid">5207431</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-44">
                <label>44</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Venter</surname>
                            <given-names>WF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kaiser</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pillay</surname>
                            <given-names>Y</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Cutting the cost of South African antiretroviral therapy using newer, safer drugs.</article-title>
                    <source>

                        <italic toggle="yes">S Afr Med J.</italic>
</source>
                    <year>2017</year>;<volume>107</volume>(<issue>1</issue>):<fpage>28</fpage>&#x2013;<lpage>30</lpage>.
                    <pub-id pub-id-type="pmid">28112085</pub-id>
                    <pub-id pub-id-type="doi">10.7196/SAMJ.2016.v107.i1.12058</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-45">
                <label>45</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Masuku</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Meyer-Rath</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jamieson</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The impact of dolutegravir in first-line adult ART on HIV transmission and cost of HIV in South Africa</article-title>. International AIDS Economic Network; 2018 20 July; Amsterdam.</mixed-citation>
            </ref>
            <ref id="ref-46">
                <label>46</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Stover</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>The impact of the program for medical male circumcision on HIV in South Africa: analysis using three epidemiological models, Dryad</article-title>.<year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.5061/dryad.b8gtht7bp">http://www.doi.org/10.5061/dryad.b8gtht7bp</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-47">
                <label>47</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rehle</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hallett</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A Comparison of South African National HIV Incidence Estimates: A Critical Appraisal of Different Methods.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2015</year>;<volume>10</volume>(<issue>7</issue>):<fpage>e0133255</fpage>.
                    <pub-id pub-id-type="pmid">26230949</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0133255</pub-id>
                    <pub-id pub-id-type="pmcid">4521952</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-48">
                <label>48</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Donnell</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baeten</surname>
                            <given-names>JM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kiarie</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Heterosexual HIV-1 transmission after initiation of antiretroviral therapy: a prospective cohort analysis.</article-title>
                    <source>

                        <italic toggle="yes">Lancet.</italic>
</source>
                    <year>2010</year>;<volume>375</volume>(<issue>9731</issue>):<fpage>2092</fpage>&#x2013;<lpage>8</lpage>.
                    <pub-id pub-id-type="pmid">20537376</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S0140-6736(10)60705-2</pub-id>
                    <pub-id pub-id-type="pmcid">2922041</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-49">
                <label>49</label>
                <mixed-citation publication-type="journal">
                    <collab>South Africa Department of Health Health Information Systems Program: </collab>
                    <article-title>Medical Male Circumcision data from District Health Information System, South Africa.</article-title>Pretoria:<year>2018</year>.</mixed-citation>
            </ref>
            <ref id="ref-50">
                <label>50</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Stover</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bollinger</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Izazola</surname>
                            <given-names>JA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>What Is Required to End the AIDS Epidemic as a Public Health Threat by 2030? The Cost and Impact of the Fast-Track Approach.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2016</year>;<volume>11</volume>(<issue>5</issue>):<fpage>e0154893</fpage>.
                    <pub-id pub-id-type="pmid">27159260</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0154893</pub-id>
                    <pub-id pub-id-type="pmcid">4861332</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-51">
                <label>51</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gal&#x00e1;rraga</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Colchero</surname>
                            <given-names>MA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wamai</surname>
                            <given-names>RG</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>HIV prevention cost-effectiveness: a systematic review.</article-title>
                    <source>

                        <italic toggle="yes">BMC Public Health.</italic>
</source>
                    <year>2009</year>;<volume>9 Suppl 1</volume>(<issue>Suppl 1</issue>):<fpage>S5</fpage>.
                    <pub-id pub-id-type="pmid">19922689</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1471-2458-9-S1-S5</pub-id>
                    <pub-id pub-id-type="pmcid">2779507</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-52">
                <label>52</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Behrman</surname>
                            <given-names>JR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kohler</surname>
                            <given-names>HP</given-names>
                        </name>
</person-group>:
                    <article-title>Sexual transmission of HIV</article-title>. Assessment paper. Copenhagen: Copenhagen Consensus Center &amp; Rush Foundation;<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.copenhagenconsensus.com/sites/default/files/behrman_kohler.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-53">
                <label>53</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lomborg</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>Global Problems, Smart Solutions: Costs and Benefits</article-title>. 1st ed. Copenhagen Consensus Center, editor. Cambridge: Cambridge University Press;<year>2013</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://assets.cambridge.org/97811070/39599/frontmatter/9781107039599_frontmatter.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-54">
                <label>54</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Horton</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gelband</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jamison</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Ranking 93 health interventions for low- and middle-income countries by cost-effectiveness.</article-title>
                    <source>

                        <italic toggle="yes"> PLoS One.</italic>
</source>
                    <year>2017</year>;<volume>12</volume>(<issue>8</issue>): e0182951.
                    <pub-id pub-id-type="pmid">28797115</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0182951</pub-id>
                    <pub-id pub-id-type="pmcid">5552255</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-55">
                <label>55</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kripke</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Njeuhmeli</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Samuelson</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Assessing Progress, Impact, and Next Steps in Rolling Out Voluntary Medical Male Circumcision for HIV Prevention in 14 Priority Countries in Eastern and Southern Africa through 2014.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2016</year>;<volume>11</volume>(<issue>7</issue>): e0158767.
                    <pub-id pub-id-type="pmid">27441648</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0158767</pub-id>
                    <pub-id pub-id-type="pmcid">4955652</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-56">
                <label>56</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>McGillen</surname>
                            <given-names>JB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Stover</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Klein</surname>
                            <given-names>DJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The emerging health impact of voluntary medical male circumcision in Zimbabwe: an evaluation using three epidemiological models.</article-title>
                    <source>

                        <italic toggle="yes"> PLoS One.</italic>
</source>
                    <year>2018</year>;<volume>13</volume>(<issue>7</issue>): e0199453.
                    <pub-id pub-id-type="pmid">30020940</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0199453</pub-id>
                    <pub-id pub-id-type="pmcid">6051576</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-57">
                <label>57</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kahn</surname>
                            <given-names>JG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Marseille</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Auvert</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>Cost-effectiveness of male circumcision for HIV prevention in a South African setting.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Med.</italic>
</source>
                    <year>2006</year>;<volume>3</volume>(<issue>12</issue>): e517.
                    <pub-id pub-id-type="pmid">17194197</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pmed.0030517</pub-id>
                    <pub-id pub-id-type="pmcid">1716193</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-58">
                <label>58</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Auvert</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Marseille</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Korenromp</surname>
                            <given-names>EL</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Estimating the resources needed and savings anticipated from roll-out of adult male circumcision in Sub-Saharan Africa.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2008</year>;<volume>3</volume>(<issue>8</issue>): e2679.
                    <pub-id pub-id-type="pmid">18682725</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0002679</pub-id>
                    <pub-id pub-id-type="pmcid">2475667</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-59">
                <label>59</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tobian</surname>
                            <given-names>AAR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Serwadda</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Quinn</surname>
                            <given-names>TC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Male circumcision for the prevention of HSV-2 and HPV infections and syphilis.</article-title>
                    <source>

                        <italic toggle="yes">N Engl J Med.</italic>
</source>
                    <year>2009</year>;<volume>360</volume>(<issue>13</issue>):<fpage>1298</fpage>&#x2013;<lpage>309</lpage>.
                    <pub-id pub-id-type="pmid">19321868</pub-id>
                    <pub-id pub-id-type="doi">10.1056/NEJMoa0802556</pub-id>
                    <pub-id pub-id-type="pmcid">2676895</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-60">
                <label>60</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pintye</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baeten</surname>
                            <given-names>JM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Manhart</surname>
                            <given-names>LE</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Association between male circumcision and incidence of syphilis in men and women: a prospective study in HIV-1 serodiscordant heterosexual African couples.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Glob Health.</italic>
</source>
                    <year>2014</year>;<volume>2</volume>(<issue>11</issue>): e664&#x2013;71.
                    <pub-id pub-id-type="pmid">25442691</pub-id>
                    <pub-id pub-id-type="doi"> 10.1016/S2214-109X(14)70315-8</pub-id>
                    <pub-id pub-id-type="pmcid">4271270</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-61">
                <label>61</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Morris</surname>
                            <given-names>BJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hankins</surname>
                            <given-names>CA</given-names>
                        </name>
</person-group>:
                    <article-title>Effect of male circumcision on risk of sexually transmitted infections and cervical cancer in women.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Glob Health.</italic>
</source>
                    <year>2017</year>;<volume>5</volume>(<issue>11</issue>): e1054&#x2013;e5.
                    <pub-id pub-id-type="pmid">29025620</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S2214-109X(17)30386-8</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-62">
                <label>62</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Friedman</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Khoury</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Petersiel</surname>
                            <given-names>N</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Pros and cons of circumcision: an evidence-based overview.</article-title>
                    <source>

                        <italic toggle="yes">Clin Microbiol Infect.</italic>
</source>
                    <year>2016</year>;<volume>22</volume>(<issue>9</issue>):<fpage>768</fpage>&#x2013;<lpage>774</lpage>.
                    <pub-id pub-id-type="pmid">27497811</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.cmi.2016.07.030</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-63">
                <label>63</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Govender</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>George</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Beckett</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Risk Compensation Following Medical Male Circumcision: Results from a 1-Year Prospective Cohort Study of Young School-Going Men in KwaZulu-Natal, South Africa.</article-title>
                    <source>

                        <italic toggle="yes">Int J Behav Med.</italic>
</source>
                    <year>2018</year>;<volume>25</volume>(<issue>1</issue>):<fpage>123</fpage>&#x2013;<lpage>130</lpage>.
                    <pub-id pub-id-type="pmid">28688094</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s12529-017-9673-0</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-64">
                <label>64</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ortblad</surname>
                            <given-names>KF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Harling</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chimbindi</surname>
                            <given-names>N</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Does Incident Circumcision Lead to Risk Compensation? Evidence From a Population Cohort in KwaZulu-Natal, South Africa.</article-title>
                    <source>

                        <italic toggle="yes">J Acquir Immune Defic Syndr.</italic>
</source>
                    <year>2019</year>;<volume>80</volume>(<issue>3</issue>):<fpage>269</fpage>&#x2013;<lpage>275</lpage>.
                    <pub-id pub-id-type="pmid">30531298</pub-id>
                    <pub-id pub-id-type="doi">10.1097/QAI.0000000000001912</pub-id>
                    <pub-id pub-id-type="pmcid">6375765</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-65">
                <label>65</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Auvert</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Taljaard</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rech</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Association of the ANRS-12126 male circumcision project with HIV levels among men in a South African township: evaluation of effectiveness using cross-sectional surveys.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Med.</italic>
</source>
                    <year>2013</year>;<volume>10</volume>(<issue>9</issue>): e1001509.
                    <pub-id pub-id-type="pmid">24019763</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pmed.1001509</pub-id>
                    <pub-id pub-id-type="pmcid">3760784</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-66">
                <label>66</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tshimanga</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Tracking risk compensation over time in a national VMMC roll-out in Zimbabwe: Risk behavior at baseline and 36-month Bulawayo follow-up report.</article-title>Harare: Zimbabwe Community Health Intervention REsearch Project (Zichire), University of Zimbabwe, dept. of Community Medicine, funded by: United Populations Fund (Zimbabwe) for the Ministry of Health and Child Care, Zimbabwe.<year>2017</year>.</mixed-citation>
            </ref>
            <ref id="ref-67">
                <label>67</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Westercamp</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Agot</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jaoko</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Risk compensation following male circumcision: results from a two-year prospective cohort study of recently circumcised and uncircumcised men in Nyanza Province, Kenya.</article-title>
                    <source>

                        <italic toggle="yes">AIDS Behav.</italic>
</source>
                    <year>2014</year>;<volume>18</volume>(<issue>9</issue>):<fpage>1764</fpage>&#x2013;<lpage>75</lpage>.
                    <pub-id pub-id-type="pmid">25047688</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s10461-014-0846-4</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-68">
                <label>68</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kabwama</surname>
                            <given-names>SN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ssewanyana</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Berg-Beckhoff</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <article-title>The Association Between Male Circumcision and Condom Use Behavior - a Meta-Analysis.</article-title>
                    <source>

                        <italic toggle="yes">Mater Sociomed.</italic>
</source>
                    <year>2018</year>;<volume>30</volume>(<issue>1</issue>):<fpage>62</fpage>&#x2013;<lpage>66</lpage>.
                    <pub-id pub-id-type="pmid">29670480</pub-id>
                    <pub-id pub-id-type="doi">10.5455/msm.2018.30.62-66</pub-id>
                    <pub-id pub-id-type="pmcid">5857052</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-69">
                <label>69</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eaton</surname>
                            <given-names>LA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cain</surname>
                            <given-names>DN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Agrawal</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The influence of male circumcision for HIV prevention on sexual behaviour among traditionally circumcised men in Cape Town, South Africa.</article-title>
                    <source>

                        <italic toggle="yes">Int J STD AIDS.</italic>
</source>
                    <year>2011</year>;<volume>22</volume>(<issue>11</issue>):<fpage>674</fpage>&#x2013;<lpage>9</lpage>.
                    <pub-id pub-id-type="pmid">22096055</pub-id>
                    <pub-id pub-id-type="doi">10.1258/ijsa.2011.011006</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-70">
                <label>70</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Maughan-Brown</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Venkataramani</surname>
                            <given-names>AS</given-names>
                        </name>
</person-group>:
                    <article-title>Learning that circumcision is protective against HIV: risk compensation among men and women in Cape Town, South Africa.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2012</year>;<volume>7</volume>(<issue>7</issue>):<fpage>e40753</fpage>.
                    <pub-id pub-id-type="pmid">22829883</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0040753</pub-id>
                    <pub-id pub-id-type="pmcid">3400649</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-71">
                <label>71</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kalichman</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mathews</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kalichman</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Male circumcision for HIV prevention: Awareness, risk compensation, and risk perceptions among South African women.</article-title>
                    <source>

                        <italic toggle="yes">Glob Public Health.</italic>
</source>
                    <year>2018</year>;<volume>13</volume>(<issue>11</issue>):<fpage>1682</fpage>&#x2013;<lpage>1690</lpage>.
                    <pub-id pub-id-type="pmid">29368579</pub-id>
                    <pub-id pub-id-type="doi">10.1080/17441692.2018.1427277</pub-id>
                    <pub-id pub-id-type="pmcid">6396304</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-72">
                <label>72</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>George</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Govender</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Beckett</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Early Resumption of Sex following Voluntary Medical Male Circumcision amongst School-Going Males.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2016</year>;<volume>11</volume>(<issue>12</issue>):<fpage>e0168091</fpage>.
                    <pub-id pub-id-type="pmid">27930720</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0168091</pub-id>
                    <pub-id pub-id-type="pmcid">5145213</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-73">
                <label>73</label>
                <mixed-citation publication-type="journal">
                    <collab>South Africa Department of Health: </collab>
                    <article-title>District Health Management Information System, Standard  Operating Procedure for Medical Male Circumcision Data Flow Process, National Level.</article-title>Pretoria:<year>2016</year>.</mixed-citation>
            </ref>
            <ref id="ref-74">
                <label>74</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mark</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Middelkoop</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Black</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Low acceptability of medical male circumcision as an HIV/AIDS prevention intervention within a South African community that practises traditional circumcision.</article-title>
                    <source>

                        <italic toggle="yes">S Afr Med J.</italic>
</source>
                    <year>2012</year>;<volume>102</volume>(<issue>6</issue>):<fpage>571</fpage>&#x2013;<lpage>3</lpage>.
                    <pub-id pub-id-type="pmid">22668967</pub-id>
                    <pub-id pub-id-type="doi">10.7196/samj.5477</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report30364">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14439.r30364</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Garenne</surname>
                        <given-names>Michel</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30364a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-6073-7803</uri>
                </contrib>
                <contrib contrib-type="author">
                    <name>
                        <surname>Matthews</surname>
                        <given-names>Alan</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30364a2">2</xref>
                    <role>Co-referee</role>
                </contrib>
                <aff id="r30364a1">
                    <label>1</label>MRC/Wits Rural Public Health and Health Transitions Research Unit, School of Public Health, University of the Witwatersrand, Johannesburg, South Africa</aff>
                <aff id="r30364a2">
                    <label>2</label>School of Chemistry and Physics, University of KwaZulu-Natal, Durban, South Africa</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>11</day>
                <month>2</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Garenne M and Matthews A</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30364" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13220.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>I read with interest the paper by Eline Korenromp and colleagues on the possible impact of male circumcision on HIV in South Africa.</p>
            <p> I have no specific comment with respect to the study, to the model, to the writing and presentation of results. It is all well done. However, I think that the conclusions are misleading, since they do not match demographic evidence. The&#x00a0; authors claim to have demonstrated an impact, but they have only simulated a potential impact with their model. Current demographic evidence shows rather the opposite: the VMMC had no visible effect on HIV in South Africa (as is the case in Zambia).</p>
            <p> </p>
            <p> Therefore, I have prepared, with my South African colleague Alan Matthews, a comment, that we would like to attach 
                <ext-link ext-link-type="uri" xlink:href="https://s3-eu-west-1.amazonaws.com/gatesopenresearch/linked/197367.Impact_of_VMMC_on_HIV_prevalence_%28Gates_Open_Research_13220_Stover_et_al.%29_-_Comment_by_reviewers_Michel_Garenne_and_Alan_Matthews_%282021%29.pdf">here</ext-link>.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Health demography</p>
            <p>We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment3413-30364">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Stover</surname>
                            <given-names>John</given-names>
                        </name>
                        <aff>Avenir Health, USA</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>16</day>
                    <month>2</month>
                    <year>2021</year>
                </pub-date>
            </front-stub>
            <body>
                <p>
                    <bold>Response to the comment of Garenne and Matthews,</bold>
                </p>
                <p>
                    <bold> by Korenromp-EL, Bershteyn-A, Stover JS et al., </bold>
                </p>
                <p> 
                    <bold>
                        <italic>16 February 2021</italic>
                    </bold>
                </p>
                <p> </p>
                <p> The review by Michel Garenne and Alan Matthews questions the conclusions of our paper about the impact of voluntary medical male circumcision on new HIV infections in South Africa. Their main point is that a large decline incidence has not been observed and our modeling estimated only modest reductions in new infections to date due to VMMC, so the program has failed to be effective.</p>
                <p> </p>
                <p> The main point of our study was actually to show that, although the impact on new infections has been small to date, the impact will grow much larger in the future, even if no new circumcisions were to take place. Most of the VMMCs conducted in South Africa have been for young boys who are not yet sexually active. Male incidence in South Africa peaks between the ages of 25-40 years. The full impact of circumcisions already conducted will come over the next 10 to 25 years. We estimated that the VMMCs conducted from 2009 to 2017 averted 71,000 &#x2013; 83,000 new infections by 2017, but that by 2030 that figure will grow by 6.5 times to 487,000 &#x2013; 518,000.</p>
                <p> </p>
                <p> HIV is very different from polio and measles in this respect, since children are vaccinated for those diseases at the age when they are most vulnerable, whereas VMMC generally occurs well before the ages of highest risk, hence we would not expect to VMMC to have as significant a short-term impact as polio or measles vaccination. With the long duration of HIV infectiousness (compared to polio and measles) it also takes longer to achieve reductions in HIV incidence because the secondary infections averted take longer to accumulate.</p>
                <p> </p>
                <p> Our models did not assume selection bias among VMMC recipients, since most are young and not yet sexually active, so their future risk behavior is unknown. Furthermore, we did not model risk compensation because, as we point out in the paper, studies in KwaZulu Natal, Orange Farm, and Zimbabwe, Kenya and Uganda found no evidence of risk compensation among those accessing VMMC.</p>
                <p> </p>
                <p> Our results may under-estimate the impact of VMMC since we did not consider the effect of VMMC on other STIs, the possible direct effects of VMMC on male-to-female transmission, and, as Nico Nagelkerke points out in his comment on this paper, our assumption of 60% effectiveness of VMMC, based on the trials&#x2019; intention-to-treat analysis [1], is actually conservative as it may be as high as 76%.</p>
                <p> </p>
                <p> We used modeling for this study because HIV incidence reductions due to VMMC are not directly measured and cannot be inferred from trends in prevalence, since HIV prevalence is also affected by changes in antiretroviral treatment coverage. In fact, UNAIDS estimates that prevalence in South Africa has risen slightly from 18.2% (16.2-20.0) in 2010 to 19% (16.1-209) in 2019 but that incidence declined over the same period from 0.95% (0.89-1.03) to 0.4% (0.36-0.44).[2] Population-level HIV incidence trends in rural KwaZulu-Natal also show a greater HIV incidence decline in men than in women, consistent with the expected impact of VMMC programs in this setting [3]. A previous modelling study has also shown that much of the inter-provincial variation in HIV prevalence in South Africa can be attributed to differences in the prevalence of male circumcision prior to the rollout of VMMC programs [4].</p>
                <p> </p>
                <p> [1] Weiss HA, Halperin D, Bailey RC, Hayes RJ, Schmid G, Hankins CA. Male circumcision for HIV prevention: from evidence to action? 
                    <italic>AIDS</italic> 2008; 
                    <bold>22:</bold>567-574.</p>
                <p> [2] UNAIDS Data 2020, 
                    <ext-link ext-link-type="uri" xlink:href="https://www.unaids.org/en/resources/documents/2020/unaids-data">https://www.unaids.org/en/resources/documents/2020/unaids-data</ext-link>
                </p>
                <p> [3] Vandormael A, Akullian A, Siedner M, de Oliveira T, Barnighausen T, Tanser F. Declines in HIV incidence among men and women in a South African population-based cohort. 
                    <italic>Nat Commun</italic> 2019; 
                    <bold>10:</bold>5482.</p>
                <p> [4] Johnson LF, Dorrington RE, Moolla H. HIV epidemic drivers in South Africa: a model-based evaluation of factors accounting for inter-provincial differences in HIV prevalence and incidence trends. 
                    <italic>South Afr J HIV Med</italic> 2017; 
                    <bold>18:</bold>a695.</p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report30288">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14439.r30288</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Williams</surname>
                        <given-names>Brian G.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30288a1">1</xref>
                    <xref ref-type="aff" rid="r30288a2">2</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-3174-4876</uri>
                </contrib>
                <aff id="r30288a1">
                    <label>1</label>Retired Visiting Research Fellow, Stellenbosch, South Africa</aff>
                <aff id="r30288a2">
                    <label>2</label>South African Centre for Epidemiological Modelling and Analysis (SACEMA), Stellenbosch University, Stellenbosch, South Africa</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>11</day>
                <month>2</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Williams BG</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30288" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13220.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This is an interesting and important analysis of the impact of medical male circumcision (MMC) on the epidemic of HIV in South Africa. South Africa has had a severe epidemic of HIV. Traditional male circumcision (TMC) is common in South Africa but carries attendant risks of mutilation or death so the availability and effectiveness of&#x00a0;MMC is of particular relevance and importance. With a thorough review of the relevant literature and the application of three different models based on all the available data the authors are able to show that MMC has already averted about one hundred thousand HIV infections and is likely to avert four to five times as many in the next ten&#x00a0;years. The authors show that the cost of this programme is not insignificant, at about US$1,000 per infection averted, but this is considerably less than the cost of life-long treatment for HIV of an infected person. The study design is excellent and the work is technically sound with sufficient detail provided to allow replication.&#x00a0;Retrospective studies of this kind are seldom published but remain very important to confirm earlier predications and to provide support for programme managers.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Physics, Chemistry, Mathematics, Epidemiology, Public Health, HIV, TB.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
</article>
