<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Gates Open Res</journal-id>
            <journal-title-group>
                <journal-title>Gates Open Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2572-4754</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/gatesopenres.13168.2</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Study Protocol</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Rejoice architecture meets social norms to accelerate vaccination in Nepal: Protocol for a mixed-method quasi-experimental study</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 2; peer review: 1 approved, 2 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Paul</surname>
                        <given-names>Alicia</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-2845-7654</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Upreti</surname>
                        <given-names>Kamana</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Nepal</surname>
                        <given-names>Shraddha</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Lohani</surname>
                        <given-names>Jeevan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Adhikari</surname>
                        <given-names>Kriti</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Rimal</surname>
                        <given-names>Rajiv</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1413-9305</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Health, Behavior and Society, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205, USA</aff>
                <aff id="a2">
                    <label>2</label>Nepal Evaluation and Assessment Team, Kathmandu, 44600, Nepal</aff>
                <aff id="a3">
                    <label>3</label>Nepal Health Research Council, Kathmandu, 44600, Nepal</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:apaul17@jhu.edu">apaul17@jhu.edu</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>22</day>
                <month>9</month>
                <year>2021</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2020</year>
            </pub-date>
            <volume>4</volume>
            <elocation-id>121</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>15</day>
                    <month>9</month>
                    <year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Paul A et al.</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://gatesopenresearch.org/articles/4-121/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> Each year, 600,000 children under 5 years old die from vaccine-preventable diseases globally. Immunization is an effective way to prevent many diseases, saving two to three million lives per year. The Nepal National Government recommends vaccinations for all children for 11 diseases by 15 months of age. However, only 78% of children between 1-2 years of age have received all recommended vaccines and only 43% receive them at the age-appropriate times for which they are scheduled.</p>
                <p>
                    <bold>Objectives:</bold> This protocol describes the development of an intervention &#x2013; called &#x201c;Rejoice Architecture&#x201d; &#x2013; that is informed by three theoretical perspectives: choice architecture, the broken windows theory, and the theory of normative social behavior. We also describe a mixed-methods approach to develop the intervention, which will improve the physical and social environments of health facilities in Makwanpur, Nepal. We hypothesize this intervention will improve immunization behaviors and intentions among mothers of children younger than 2 years, pregnant women, and prospective mothers.</p>
                <p>
                    <bold>Methods:</bold> We describe the qualitative formative assessment to understand existing attitudes, norms, and behaviors among caregivers, healthcare workers, and government representatives. The formative assessment will include in-depth interviews, key informant interviews, and focus group discussions. We also describe the overall quasi-experimental study design, used to assess intervention impact.</p>
                <p>
                    <bold>Impact:</bold> This study will contribute to the social and behavioral change communication intervention research by offering a novel strategy for increasing immunization. This study will also illustrate to policymakers the value of structural change for health service delivery.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>social norms</kwd>
                <kwd>choice architecture</kwd>
                <kwd>broken windows theory</kwd>
                <kwd>immunization</kwd>
                <kwd>study protocol</kwd>
                <kwd>mixed-methods</kwd>
                <kwd>quasi-experiment</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/100000865">
                    <funding-source>Gates Foundation</funding-source>
                    <award-id>OPP1212270</award-id>
                </award-group>
                <funding-statement>This work was supported by The Gates Foundation through its Challenge Grant mechanism [Grant number OPP 1212270] to the Johns Hopkins University (Rajiv N. Rimal, Principal Investigator).  </funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 1</title>
                <p>The new version of this manuscript includes several revisions based on the feedback from peer reviewers. These revisions are summarized below: - Specified and clarified some areas of confusion in the introduction section, including reports of global immunization data and the summary of the Nepal National Immunization Programme - Added a footnote to address the controversial use of Broken Windows Theory in United States policing - Elaborated on the defining features of the study setting and justification for selection as the study area - Clarification and justification of the study design, including non-random selection of wards and health facilities, 1-km sampling radius, and assignment of in-depth interviews versus focus group discussions - Justification of sampling mothers 18 years and older - Clarification of contradicting vaccination rates in quantitative sampling - Elaboration of consent process by research activity and identification of materials provided to participants - Elaboration of the intervention design and planned activities in the control and treatment facilities - Elaboration on the audio recording process - Added a new section on Data Management describing the process the study team followed to safely collect, store, and share audio files, transcripts, and field notes - Cited the original creator of Figure 1 (adapted from original) - Added a new version of Figure 2 which depicts the timeline of activities - Included the IRB approval numbers - Updated the corresponding author's email address</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>	Communicable diseases constitute a global health threat, with low- and middle-income countries experiencing the greatest burden (
                <xref ref-type="bibr" rid="ref-38">The World Medical Association, 2020</xref>). Each year, 1.5 million people die from vaccine-preventable diseases, 600,000 of whom are children under the age of 5 (
                <xref ref-type="bibr" rid="ref-10">Gavi, 2020</xref>). Immunization is an effective way to prevent disease and save lives, with two to three million lives saved by vaccines every year (
                <xref ref-type="bibr" rid="ref-40">World Health Organization, 2019</xref>). Individuals benefit from immunization through illness prevention, reduced healthcare costs, and greater productivity for themselves and their caregivers (
                <xref ref-type="bibr" rid="ref-10">Gavi, 2020</xref>; 
                <xref ref-type="bibr" rid="ref-23">Njau &amp; Cairns, 2016</xref>; 
                <xref ref-type="bibr" rid="ref-26">Ozawa 
                    <italic toggle="yes">et al.,</italic> 2012</xref>). Children, who are often at greater risk of morbidity and mortality from communicable disease, experience greater cognitive ability, physical strength, and school performance when they receive vaccines (
                <xref ref-type="bibr" rid="ref-10">Gavi, 2020</xref>; 
                <xref ref-type="bibr" rid="ref-21">Nandi &amp; Shet, 2020</xref>). Immunizations also contribute to improved community health through herd immunity and greater economic stability from long-term cost savings (
                <xref ref-type="bibr" rid="ref-9">Fox 
                    <italic toggle="yes">et al.,</italic> 1971</xref>; 
                <xref ref-type="bibr" rid="ref-10">Gavi, 2020</xref>; 
                <xref ref-type="bibr" rid="ref-27">Ozawa 
                    <italic toggle="yes">et al.,</italic> 2012</xref>; 
                <xref ref-type="bibr" rid="ref-26">Ozawa 
                    <italic toggle="yes">et al.,</italic> 2017</xref>). </p>
            <p>Currently, nearly 20 million children worldwide younger than one year old have not received the minimum basic vaccines they need to live long, healthy lives; 77% of which represent children living in Gavi-supported countries (
                <xref ref-type="bibr" rid="ref-10">Gavi, 2020</xref>). Furthermore, only 17% of children under 1 have received the full dosage recommended by the World Health Organization (
                <xref ref-type="bibr" rid="ref-10">Gavi, 2020</xref>). This coverage gap is present in Nepal, where only 78% of children between 1&#x2013;2 years have received all recommended vaccines (
                <xref ref-type="bibr" rid="ref-20">Ministry of Health Nepal 
                    <italic toggle="yes">et al.,</italic> 2017</xref>). It is important to note, though, that while the majority of children receive their vaccines by the age of 2, only 43% receive them at the age-appropriate times for which they are scheduled (
                <xref ref-type="bibr" rid="ref-20">Ministry of Health Nepal 
                    <italic toggle="yes">et al.,</italic> 2017</xref>). Moreover, immunization coverage is highly variable in Nepal, with rates ranging from 65% in some provinces to 93% in others (
                <xref ref-type="bibr" rid="ref-20">Ministry of Health Nepal 
                    <italic toggle="yes">et al.,</italic> 2017</xref>). Coverage is dependent on the specific vaccine as well, ranging from 73% for the first dose of the Pneumococcal vaccine to 98% for the Bacille Calmette Guerin (BCG) vaccine (
                <xref ref-type="bibr" rid="ref-20">Ministry of Health Nepal 
                    <italic toggle="yes">et al.,</italic> 2017</xref>). These data demonstrate a critical need to ensure consistent and comprehensive coverage of immunization, including in Nepal.</p>
            <sec>
                <title>National Immunization Programme</title>
                <p>Since its inception in 1979, Nepal&#x2019;s National Immunization Programme (NIP) has been one of the government&#x2019;s highest priorities, aiming to &#x201c;reduce child mortality, morbidity and disability associated with vaccine preventable disease&#x201d; (
                    <xref ref-type="bibr" rid="ref-18">Ministry of Health Nepal, 2017</xref>, n.p.).  The program, which originally offered only BCG and Diphtheria Pertussis Tetanus (DPT) vaccines in three districts, expanded in 1988 to cover all 75 districts in the country and also provide oral polio and measles vaccines (
                    <xref ref-type="bibr" rid="ref-7">Department of Health Services, 2018</xref>). As of 2020, seven vaccines which protect against 11 vaccine-preventable diseases (Diphtheria, Hepatitis B, Hemophilus Influenza B, Japanese Encephalitis, Measles, Pertussis, Polio, Pneumococcal Disease, Rotavirus, Rubella, Tetanus, and Tuberculosis) are offered (
                    <xref ref-type="bibr" rid="ref-17">Ministry of Health and Population Nepal, 2020</xref>).</p>
                <p>Immunization services are primarily delivered through government networks, such as health facilities, outreach clinics, and mobile clinics, but an upward trend of delivery by private institutions is being observed in urban areas (
                    <xref ref-type="bibr" rid="ref-4">Child Health Division, 2011</xref>). Vaccines and related logistics are provided free of cost to all health facilities, both public and private, by the government (
                    <xref ref-type="bibr" rid="ref-4">Child Health Division, 2011</xref>; 
                    <xref ref-type="bibr" rid="ref-7">Department of Health Services, 2018</xref>). Many health facilities elect to administer vaccines on one pre-specified day per month, called &#x201c;Immunization Day.&#x201d; This system helps providers track vaccine uptake in their communities by reaching all children in need of vaccines on the same day, and it also helps parents remember to bring their child for their next immunization.</p>
                <p>The NIP played a major role in meeting the fourth target of the Millennium Development Goals to reduce the number of under-five deaths to less than 40 per 1,000 live births (
                    <xref ref-type="bibr" rid="ref-17">Ministry of Health and Population Nepal, 2020</xref>; 
                    <xref ref-type="bibr" rid="ref-22">National Planning Commission, 2017</xref>). The country achieved a number of successes, including being declared polio free in 2014, maintaining elimination status of maternal and neonatal tetanus since 2005, controlling rubella and cognitive rubella syndrome in 2018, and progressing towards the elimination of measles (
                    <xref ref-type="bibr" rid="ref-7">Department of Health Services, 2018</xref>; 
                    <xref ref-type="bibr" rid="ref-17">Ministry of Health and Population Nepal, 2020</xref>). More recently, various innovative measures have been taken to declare full immunization in the country. One such initiative, entitled &#x201c;Reaching Every Child,&#x201d; was implemented in 2012 and has seen success by providing greater ownership to local political bodies. In total, 56 of 77 districts have declared full immunization; however, 14 districts continue to show dropout rates greater than 10% and 26 districts, including the capital city Kathmandu, have coverage below 80% (
                    <xref ref-type="bibr" rid="ref-7">Department of Health Services, 2018</xref>).</p>
            </sec>
            <sec>
                <title>Facilitators and barriers of immunization</title>
                <p>Studies in Nepal show that institutional delivery is a prominent facilitator of vaccine uptake (
                    <xref ref-type="bibr" rid="ref-1">Acharya 
                        <italic toggle="yes">et al.,</italic> 2019</xref>; 
                    <xref ref-type="bibr" rid="ref-34">Shrestha 
                        <italic toggle="yes">et al.,</italic> 2016</xref>). 
                    <xref ref-type="bibr" rid="ref-34">Shrestha 
                        <italic toggle="yes">et al.</italic> (2016)</xref> offer one potential reason for this, stating that the first vaccine (BCG) is often administered immediately after birth, which is more likely to be readily available in a health facility setting than at home. Furthermore, in institutions, new mothers are surrounded by numerous healthcare staff who can share their recommendations for future vaccines (
                    <xref ref-type="bibr" rid="ref-34">Shrestha 
                        <italic toggle="yes">et al.,</italic> 2016</xref>).</p>
                <p>Multiple studies in Asia and Africa have found a positive association between parental knowledge of immunization and vaccine uptake (
                    <xref ref-type="bibr" rid="ref-24">Odusanya 
                        <italic toggle="yes">et al.,</italic> 2008</xref>; 
                    <xref ref-type="bibr" rid="ref-25">Owino 
                        <italic toggle="yes">et al.,</italic> 2009</xref>; 
                    <xref ref-type="bibr" rid="ref-29">Perry 
                        <italic toggle="yes">et al.,</italic> 2020</xref>). This can refer to knowledge about the purpose of vaccines, appropriate ages to receive specific vaccines, age at which a child should complete the vaccines, and symptoms of vaccines, among other topics (
                    <xref ref-type="bibr" rid="ref-24">Odusanya 
                        <italic toggle="yes">et al.,</italic> 2008</xref>). Some studies show that even in areas of low literacy, parental knowledge is a significant determinant of full immunization (
                    <xref ref-type="bibr" rid="ref-16">Matsumura 
                        <italic toggle="yes">et al.,</italic> 2005</xref>; 
                    <xref ref-type="bibr" rid="ref-24">Odusanya 
                        <italic toggle="yes">et al.,</italic> 2008</xref>). An important aspect of parental knowledge is awareness of the vaccine schedule, which is also strongly correlated with immunization coverage (
                    <xref ref-type="bibr" rid="ref-25">Owino 
                        <italic toggle="yes">et al.,</italic> 2009</xref>; 
                    <xref ref-type="bibr" rid="ref-34">Shrestha 
                        <italic toggle="yes">et al.,</italic> 2016</xref>). In Nepal, full immunization requires seven separate visits over 15 months; it is essential that parents know and remember this schedule in order to bring their children to the facility at the appropriate time (
                    <xref ref-type="bibr" rid="ref-1">Acharya 
                        <italic toggle="yes">et al.,</italic> 2019</xref>).</p>
                <p>For countries like Nepal that rely on immunization cards to track children&#x2019;s vaccine records, immunization card retention is a major facilitator of uptake (
                    <xref ref-type="bibr" rid="ref-1">Acharya 
                        <italic toggle="yes">et al.,</italic> 2019</xref>; 
                    <xref ref-type="bibr" rid="ref-29">Perry 
                        <italic toggle="yes">et al.,</italic> 2020</xref>). 
                    <xref ref-type="bibr" rid="ref-29">Perry 
                        <italic toggle="yes">et al.</italic> (2020)</xref> found that in Bangladesh where, like Nepal, immunization cards are required to receive vaccines, parents are met with anger, shouting, and in some cases a fee when they lose or forget their card. Improving immunization card retention has serious implications for encouraging immunization in Nepal, where the retention rate for immunization cards is only 52% (
                    <xref ref-type="bibr" rid="ref-1">Acharya 
                        <italic toggle="yes">et al.,</italic> 2019</xref>).</p>
                <p>Barriers to vaccine uptake exist at the individual and health system levels. Several studies suggest an association between parents&#x2019; negative attitudes toward immunization and vaccine incompletion. Two studies in Nepal point to a fear among parents associated with vaccinating their children, particularly in instances when the child is perceived as being &#x201c;too ill&#x201d; to be administered a vaccine (
                    <xref ref-type="bibr" rid="ref-2">Basel &amp; Shrestha, 2012</xref>; 
                    <xref ref-type="bibr" rid="ref-34">Shrestha 
                        <italic toggle="yes">et al.,</italic> 2016</xref>). Across various countries in Asia and Africa, the most common concern among parents is the potential for side effects and the appropriate response, the fear of which has caused parents to refuse vaccines for their child (
                    <xref ref-type="bibr" rid="ref-8">Favin 
                        <italic toggle="yes">et al.,</italic> 2012</xref>; 
                    <xref ref-type="bibr" rid="ref-25">Owino 
                        <italic toggle="yes">et al.,</italic> 2009</xref>; 
                    <xref ref-type="bibr" rid="ref-29">Perry 
                        <italic toggle="yes">et al.,</italic> 2020</xref>). To compound the issue, negative attitudes may also be strengthened by competing priorities (
                    <xref ref-type="bibr" rid="ref-8">Favin 
                        <italic toggle="yes">et al.,</italic> 2012</xref>; 
                    <xref ref-type="bibr" rid="ref-34">Shrestha 
                        <italic toggle="yes">et al.,</italic> 2016</xref>; 
                    <xref ref-type="bibr" rid="ref-37">Vonasek 
                        <italic toggle="yes">et al.,</italic> 2016</xref>). Because immunization can sometimes require long distance travel, followed by long wait times, parents in these circumstances must weigh the benefits of vaccines against the costs of foregoing responsibilities like working, caring for other children, or completing household chores (
                    <xref ref-type="bibr" rid="ref-8">Favin 
                        <italic toggle="yes">et al.,</italic> 2012</xref>).</p>
                <p>A systematic review of incomplete vaccinations in low- and middle-income countries found that a significant factor for under-vaccination could be explained by health system issues, such as access to services, inadequate health worker knowledge, and vaccine shortage (
                    <xref ref-type="bibr" rid="ref-30">Rainey 
                        <italic toggle="yes">et al.,</italic> 2011</xref>). These findings were further established by 
                    <xref ref-type="bibr" rid="ref-8">Favin 
                        <italic toggle="yes">et al.</italic> (2012)</xref>, who found in their review frequent instances of unreliable services (e.g., appointment cancelations, absent providers, lack of supplies) and disrespectful staff (e.g., screaming at mothers, discouraging vaccination). What is less known, and what this project will seek to understand, is the influence of health facilities&#x2019; physical infrastructure on vaccine uptake and the underlying conceptual mechanisms that explain this relationship with facility-level factors.</p>
            </sec>
            <sec>
                <title>Conceptual framework</title>
                <p>This project is informed by ideas from three theoretical frameworks: choice architecture, the broken windows theory,
                    <sup>
                        <xref ref-type="other" rid="FN1">1</xref>
                    </sup> and the theory of normative social behavior. Choice architecture (
                    <xref ref-type="bibr" rid="ref-35">Thaler &amp; Sunstein, 2008</xref>) is based on the idea that human behavior, to some extent, is driven by expediency in decision-making &#x2013; that people do not want to expend a lot of effort thinking critically about the pros and cons of decisions they need to make. If the decision-making environment is configured in a certain way to promote a particular decision, many will opt for that decision (
                    <xref ref-type="bibr" rid="ref-36">Thaler 
                        <italic toggle="yes">et al.,</italic> 2014</xref>). In explaining this theory, the authors write &#x201c;For reasons of laziness, fear, and distraction, many people will take whatever option requires the least effort, or the path of least resistance&#x201d; (p. 430). At its most basic level, choice architecture involves two components &#x2013; options available to the decision-maker, including the number of options from which to make a decision, and the manner in which the options are framed (
                    <xref ref-type="bibr" rid="ref-14">Johnson 
                        <italic toggle="yes">et al.,</italic> 2012</xref>). </p>
                <p>The overall idea here is that people&#x2019;s behaviors can be changed by configuring the environment so that the default choice is in line with the desired behavior. Thus, structurally, if the stairs in a building are the first point of access and taking the elevator requires walking to the back of the building, people are more likely to take the stairs. Applied to the vaccination context, choice architecture principles could be used to immunize an institutionally delivered child by default, but allowing parents to opt out if they so choose (as opposed to making the immunization be the opt-in choice).</p>
                <p>While choice architecture focuses on optimal structuring of the environment, the broken windows theory (
                    <xref ref-type="bibr" rid="ref-39">Wilson &amp; Kelling, 1982</xref>) asserts that the condition of disrepair in the environment (e.g., preponderance of broken windows) signals to people that social order is in decay. This further communicates to people that they will not be punished if they, too, engage in behaviors that, literally and metaphorically, break more windows. Hence, the state of broken windows in a community further perpetuates social disorder. In this project, we ask if the reverse is also true in an immunization context: if the physical and social environment in which vaccination is being delivered is improved &#x2013; from a state of disrepair and disrespect to a state of rejuvenation and respect &#x2013; will more caregivers come for vaccinations?</p>
                <p>One of the mechanisms underlying the broken windows theory is normative influence, the idea that people&#x2019;s behaviors are driven by their beliefs about what others are doing (called descriptive norms) and pressures they experience to conform (injunctive norms; 
                    <xref ref-type="bibr" rid="ref-5">Cialdini 
                        <italic toggle="yes">et al.,</italic> 1990</xref>). When people perceive that an environment is in disrepair, they also perceive that others do not care and, by extension, that it would be acceptable for they themselves not to care. In this way, broken windows influence social norms, which in turn affect behavioral choices. The relationship between normative beliefs and behaviors is addressed by the theory of normative social behavior (
                    <xref ref-type="bibr" rid="ref-32">Rimal &amp; Real, 2005</xref>), which posits that social norms affect behaviors not only directly, but also indirectly when other factors are present. For example, social normative influences are heightened when people have high self-efficacy (
                    <xref ref-type="bibr" rid="ref-11">Jain &amp; Humienny, 2020</xref>; 
                    <xref ref-type="bibr" rid="ref-12">Jang 
                        <italic toggle="yes">et al.,</italic> 2013</xref>; 
                    <xref ref-type="bibr" rid="ref-70">Johnson, 2011</xref>) to enact the behavior and when they perceive that the behavior confers many benefits (
                    <xref ref-type="bibr" rid="ref-15">Lapinski 
                        <italic toggle="yes">et al.,</italic> 2014</xref>; 
                    <xref ref-type="bibr" rid="ref-31">Rimal, 2008</xref>).</p>
            </sec>
            <sec>
                <title>Objectives</title>
                <p>This protocol seeks to meet three key objectives: </p>
                <list list-type="bullet">
                    <list-item>
                        <label>1. </label>
                        <p>Describe the process by which the formative assessment will be conducted to understand existing attitudes, norms, and behaviors relating to immunization.</p>
                    </list-item>
                    <list-item>
                        <label>2. </label>
                        <p>Describe how the results of the formative assessment will be translated to improve the intervention design.</p>
                    </list-item>
                    <list-item>
                        <label>3. </label>
                        <p>Describe the methodology that will be used to evaluate the impact of the intervention on immunization behavior and intentions.</p>
                    </list-item>
                </list>
            </sec>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <sec>
                <title>Study setting</title>
                <p>The study is being conducted in three Palikas (equivalent to a municipality) of the Makwanpur District of Nepal: Thaha Municipality, Kailash Rural Municipality and Bakaiya Rural Municipality (see 
                    <xref ref-type="fig" rid="f1">Figure 1</xref>). Makwanpur District is one of 77 districts in Nepal with a population of 420,477 (
                    <xref ref-type="bibr" rid="ref-51">Central Bureau of Statistics, 2014</xref>). Makwanpur District was selected as the study area for this project for a number of reasons, including its immunization rate, geographic location, and demographic diversity. As of 2017, the rate of immunization coverage of children under one year in Makwanpur  is 76.7%, comparable to Nepal's overall immunization rate of 73.1% (
                    <xref ref-type="bibr" rid="ref-19">Ministry of Health Nepal Department of Health Services, 2018</xref>).  Additionally, Makwanpur has a geographical range which reflects the three regions of Nepal with an altitude of 2,488 meters in the northern parts and 166 meters in the southern parts. The three selected municipalities were chosen to represent Nepal&#x2019;s three regions of the mountains (Thaha Municipality), hills (Bakaiya Rural Municipality) and terai (lowlands; Kailash Rural Municipality). Additionally, Makwanpur is 76.7%, comparable to Nepal&#x2019;s overall immunization rate of 73.1% (
                    <xref ref-type="bibr" rid="ref-19">Ministry of Health Nepal Department of Health Services, 2018</xref>). Furthermore, Makwanpur is accessible from Kathmandu, the capital of Nepal, and is large in size (approximately 2,426 km2 or 1.6% of the total land area of Nepal; 
                    <xref ref-type="bibr" rid="ref-51">Central Bureau of Statistics, 2014</xref>). These geographical features make Makwanpur an ideal candidate setting to maximize feasibility and minimize contamination. Makwanpur also represents much of Nepal&#x2019;s diverse population, including 78 ethnic groups with various cultures and languages spoken (
                    <xref ref-type="bibr" rid="ref-50">Central Bureau of Statistics, 2005</xref>).</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>Geographical location of study.</title>
                        <p>Note: This figure was adapted from the original image (
                            <xref ref-type="bibr" rid="ref-53">NordNordWest, 2019</xref>). This image is free to use under the creator&#x2019;s licensing conditions. Licensing agreement available at 
                            <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by-sa/3.0/de/legalcode">https://creativecommons.org/licenses/by-sa/3.0/de/legalcode</ext-link>. </p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14643/b10832ab-baf4-4f5e-b2b8-b41f546257f3_figure1.gif"/>
                </fig>
                <p>In each of the three Palikas, we selected one ward (the administrative unit below a Palika) as a treatment site, and chose a clinic in the ward based on our desire to maximize geographic diversity across the three Palikas. Treatment facilities were selected purposively based on relative need for immunization and service delivery support and willingness to collaborate, as the intervention design and implementation would require the input and participation of local stakeholders. We considered other designs (including a cluster randomized study) but decided against it for two reasons. First, it would be hard to justify a random sample when the number of units (in this case Palikas) is only six. Second, we were constrained by resources to expand to more than three intervention Palikas. Given these constraints, it was deemed more useful to choose sites based on specific criteria. For example, for each ward in the treatment arm, we selected another ward and clinic as a control site in that Palika, matched on population characteristics including ethnicity, age distribution, gender ratio, and population size with the treatment ward. Each control facility is located in a separate geographic vicinity from the treatment facility in its Palika to minimize contamination.</p>
            </sec>
            <sec>
                <title>Study team</title>
                <p>This research is a partnership between Johns Hopkins University (JHU) and Nepal Evaluation and Assessment Team (NEAT), a nongovernment organization in Kathmandu, Nepal. The research team includes university-based researchers with expertise in social norms, social and behavioral change communication interventions, and mixed-methods research in global health contexts.</p>
            </sec>
            <sec>
                <title>Research design and intervention</title>
                <p>This study is composed of three phases: 1) qualitative formative assessment, 2) intervention implementation, and 3) quantitative impact assessment (see 
                    <xref ref-type="fig" rid="f2">Figure 2</xref>). Mixed methods approaches can be useful for producing a more comprehensive picture of the issue at hand and building on initial findings (
                    <xref ref-type="bibr" rid="ref-6">Denscombe, 2008</xref>). For this study, the formative assessment will be used to understand individual and group perspectives of immunization practices in their communities and opinions about their local health facilities. The findings from this assessment will be used to build on the Rejoice Architecture intervention plan, which will include improvements to the treatment health facilities through three basic components: 1) physical environment and infrastructure, 2) social environment and communication with health staff, and 3) systems management and scheduling. Specific intervention activities in the first component may include painting walls, providing furniture, adding greenery, constructing a covered outdoor waiting area, and displaying educational and entertaining videos on a television screen. For the second component, we may design a client-provider communication checklist and facilitate a workshop on interpersonal communication with clients and caregivers. For the third component, the intervention may involve implementing an appointment reminder system for caregivers and refining the health facility&#x2019;s patient scheduling system. Activities will be refined, expanded upon, or added based on priorities identified in the formative assessment. Health facilities in the control group will receive no intervention components and will provide care as usual. Following the formative assessment, a clustered quasi-experimental survey design will be utilized to determine overall impact of the intervention by comparing outcomes between health facilities which received the intervention and those which did not.</p>
                <p>In the event of delays due to COVID-19, the study team will prioritize the health and safety of the communities, health facility staff, and study team. The research team will maintain constant communication with Palika leaders via e-mail and video conferencing to assess the local impact of COVID-19 on each community, stay up-to-date on local safety guidelines, and determine when it is safe to resume research activities. If necessary, the research team will request a project extension to ensure all phases of the study are complete when it is safe to do so. When the study team may resume activities, they will follow safety procedures outlined by JHU, Makwanpur District, and each Palika.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Research study workflow and timeline.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14643/b10832ab-baf4-4f5e-b2b8-b41f546257f3_figure2.gif"/>
                </fig>
            </sec>
        </sec>
        <sec>
            <title>Qualitative methods</title>
            <p>The formative assessment will be used to understand the attitudes of and behaviors toward immunization within each community and show how mothers, other community members, and community leaders perceive the environment of their local health facilities. This assessment will also aid us in identifying mothers&#x2019; priorities for making the health facilities&#x2019; environments more welcoming to patients and caregivers.</p>
            <sec>
                <title>Study design</title>
                <p>We plan to collect qualitative data from five of the six study sites, excluding one control site, as the study team anticipates saturation in the data. Data will be collected primarily from treatment sites to ensure the needs of the treatment sites are identified for the intervention design. Qualitative data will include approximately 10 in-depth interviews, 13 key informant interviews, and eight focus group discussions. Interviews will be used to explore and identify individuals&#x2019; views, experiences, and motivations related to providing or seeking immunization services from both supply and demand sides. In comparison, focus group discussions will be used to understand the collective attitudes, beliefs, and behaviors of our target population, mothers of young children, to establish community norms and generate ideas to refine the intervention. Refer to 
                    <xref ref-type="table" rid="T1">Table 1</xref> for our target breakdown of qualitative data by treatment and control sites. It is important to note that due to travel restrictions to prevent spread of COVID-19, actual numbers may vary.</p>
                <table-wrap id="T1" orientation="portrait" position="anchor">
                    <label>Table 1. </label>
                    <caption>
                        <title>Breakdown of qualitative data collection by treatment and control facilities.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="bottom">Participant</th>
                                <th align="center" colspan="1" rowspan="1" valign="bottom">Session Type</th>
                                <th align="center" colspan="1" rowspan="1" valign="top"># Sessions
                                    <break/>(Control)</th>
                                <th align="center" colspan="1" rowspan="1" valign="top"># Sessions
                                    <break/>(Treatment)</th>
                                <th align="center" colspan="1" rowspan="1" valign="bottom">Total</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Mothers</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">FGD</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">6</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">8</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Fathers</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">IDI</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Grandmothers</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">IDI</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Health worker </td>
                                <td align="center" colspan="1" rowspan="1" valign="top">KII</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Government representative</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">KII</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">FCHV </td>
                                <td align="center" colspan="1" rowspan="1" valign="top">KII</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>Furthermore, we will match the interviewer and interviewee by gender when possible to strengthen rapport and help the participant feel more at ease. Researchers will conduct all assessments in Nepali, the local language, and collect audio recordings, permitting consent.</p>
            </sec>
            <sec sec-type="subjects">
                <title>Participants</title>
                <p>We will conduct in-depth interviews with fathers and grandmothers of children under the age of 2. We will conduct key informant interviews with Female Community Health Volunteers (FCHVs); health workers, with priority given to workers in a leadership role (i.e. Health In-Charge, Immunization Program Manager, etc.); and representatives of the local government (i.e. Ward Chair, chair of the Health Facility Operation Management Committee, etc.). Focus group discussions will consist of mothers of children under 2 years of age. All participants will be at least 18 years or older and live within the catchment area (measured by a one-kilometer radius) of a study health facility or work for, oversee, or volunteer at a study health facility. We recognize that there are mothers younger than 18 years old in this region. Given that marriage of a girl who is below the age of 18 is considered child marriage in Nepal (
                    <xref ref-type="bibr" rid="ref-52">Nepal Law Commission, 2011</xref>), including mothers younger than 18 in the study would require another layer of confidentiality and protection that the study team was unprepared to provide, which is why we limited the sample to those older than 18. This, of course, reduces our study generalizability.</p>
            </sec>
            <sec>
                <title>Sampling</title>
                <p>FCHVs will provide assistance in identifying eligible participants for the interviews. They maintain an updated list of community members served by their health facilities, including families with newborn children and record of the child&#x2019;s immunization status. Using these lists, FCHVs will identify homes with potential participants for us to contact and recruit. For two of the eight focus groups, we will only recruit individuals from marginalized communities based on their caste to broaden our scope and gain a more comprehensive image of the community and their array of experiences. Each discussion group will consist of five to nine participants. For In-depth interviews, potential participants will be excluded if any member of their family has participated in one of our interviews or focus groups. Participants of the key informant interviews will be identified through discussions with community leadership.</p>
            </sec>
            <sec>
                <title>Instruments</title>
                <p>We have prepared the qualitative instruments using influence from the theory of normative social behavior (
                    <xref ref-type="bibr" rid="ref-32">Rimal &amp; Real, 2005</xref>) and choice architecture (
                    <xref ref-type="bibr" rid="ref-36">Thaler 
                        <italic toggle="yes">et al.,</italic> 2014</xref>). Interview and focus group instruments also include concepts from the literature on facilitators and barriers of immunization (
                    <xref ref-type="bibr" rid="ref-1">Acharya 
                        <italic toggle="yes">et al.,</italic> 2019</xref>; 
                    <xref ref-type="bibr" rid="ref-34">Shrestha 
                        <italic toggle="yes">et al.,</italic> 2016</xref>) and adapted survey questions regarding clinic infrastructure from the Rapid Assessment Tool (
                    <xref ref-type="bibr" rid="ref-33">Scholz 
                        <italic toggle="yes">et al.,</italic> 2015</xref>) and the Site Assessment for Maternal and Newborn Health Programs (
                    <xref ref-type="bibr" rid="ref-13">JHPIEGO, 2004</xref>). The instruments were adapted for local use based on feedback from the Nepali team on cultural considerations including language, phrasing, and use of probes. The tools will undergo pre-testing and will be revised to ensure smooth flow of questions, avoid confusing technical terms and jargon, and assure appropriate phrasing to avoid misunderstanding or offense.</p>
                <p>Topics covered in each interview and focus group will vary based on the instrument in use as well as flow of the conversation. All qualitative instruments include questions regarding facilitators, barriers, and social norms of immunization. The focus group guide will also cover the physical and social characteristics that mothers desire in an ideal health facility, a description of their current health facility, and typical communication between caregivers and health care providers. The in-depth interview guide will cover the family&#x2019;s personal experiences with vaccination, family involvement in child health and decision-making, and aspirations for the child&#x2019;s education and career. The key informant interview guide will include items regarding immunization coverage in the ward, typical communication between caregivers and health care providers, a physical description of the local health facility, opinions of their workload, and feasibility of the proposed intervention.</p>
                <p>Each of these instruments will aim to reveal the facilitators of and barriers to immunization uptake across various socioecological levels. For instance, the in-depth interviews with fathers and grandmothers will address the household-level factors while the focus group discussions with mothers will get at the interpersonal and community levels. Additionally, the key-informant interviews will address the systems level variables at play.</p>
                <p>Interview guides are available as 
                    <italic toggle="yes">Extended data</italic> (
                    <xref ref-type="bibr" rid="ref-28">Paul, 2020</xref>).</p>
            </sec>
        </sec>
        <sec>
            <title>Quantitative methods</title>
            <p>Whereas the qualitative component of the research helps inform the intervention design and the quantitative instrument, the quantitative component&#x2019;s primary use is in tabulating the impact of the intervention in as rigorous a manner as possible.</p>
            <sec>
                <title>Study design</title>
                <p>We will use a clustered quasi-experimental design with panel data to measure the impact of the intervention on immunization behaviors, intent to vaccinate, and uptake of other health services. Participants from each of the six study sites will complete a baseline survey preceding intervention implementation and an end-line survey approximately eight months later. Data collectors will read questions aloud to participants and then record responses on a handheld tablet. Surveys are available as 
                    <italic toggle="yes">Extended data</italic> (
                    <xref ref-type="bibr" rid="ref-28">Paul, 2020</xref>).</p>
                <p>In addition, the physical conditions of the health facilities and immunization centers will be assessed using checklists at baseline. These checklists will be used to corroborate subjective reports from interviews, focus group discussions, and surveys and assist with identifying needed resources to include in the intervention design. Our data collectors will visit each health facility and the surrounding immunization centers on the designated &#x201c;Immunization Day&#x201d; to complete the checklists.</p>
            </sec>
            <sec sec-type="subjects">
                <title>Participants</title>
                <p>Eligible participants include mothers of children younger than two years, pregnant women, and prospective mothers. Prospective mothers are defined as women of reproductive age (18&#x2013;30 years) who are not currently pregnant and do not have a child two years or younger, but express interest in having a child in the future. All participants must be 18 years or older and live within a one-kilometer radius of the health facility being studied. Potential participants will be excluded if they or a member of their family participated in any of the qualitative assessments.</p>
            </sec>
            <sec>
                <title>Sampling</title>
                <p>Like the qualitative methods, FCHVs from each ward will assist in identifying women in the community who fit the eligibility requirements. With their list of names and locations, data collectors will randomly select houses for recruitment. The target sample size is 
                    <italic toggle="yes">n</italic> = 950 (treatment = 475, control = 475) with an anticipated attrition rate of 20%. This was determined by assuming an increase in vaccination rates from 83% (2019 estimate) to 93% (envisioned), an alpha level of 0.05 and power of 80%, and data collection from 6 clusters. To estimate the vaccination rate in Makwanpur in 2019, we assumed an increase of approximately 6% from 2017, when the data were last reported, based on antigen coverage trends from 2014 to 2017 (
                    <xref ref-type="bibr" rid="ref-19">Ministry of Health Nepal Department of Health Services, 2018</xref>). We estimate an intraclass correlation of 0.01, making the required sample size 380 in the treatment and 380 in the control groups. However, because this is a panel design, we envision an attrition rate of 20%, which brings our sample size at baseline to 950. We will sample four cohorts of women with children younger than one year, women with children between 1&#x2013;2 years, women who are pregnant at baseline, and prospective mothers. We anticipate greatest availability of women in the first two cohorts, and the least availability of pregnant women, which we expect will create variation in our sample sizes between cohorts. For the complete anticipated sampling breakdown, see 
                    <xref ref-type="table" rid="T2">Table 2</xref>.</p>
                <table-wrap id="T2" orientation="portrait" position="anchor">
                    <label>Table 2. </label>
                    <caption>
                        <title>Breakdown of quantitative data collection by treatment and control facilities.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Participant</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Control</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Treatment</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Total</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Women with children &lt;1 year</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">150</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">150</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">300</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Women with children 1&#x2013;2 years</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">150</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">150</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">300</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Pregnant women</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">50</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">50</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">100</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Prospective mothers</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">125</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">125</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">250</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Total</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">475</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">475</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">950</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Instruments</title>
                <p>Baseline and end-line surveys will measure primary outcomes of immunization behavior and intent to immunize future children. A secondary outcome of general service utilization will also be measured. To assess influencing variables, surveys will measure vaccine knowledge, vaccine attitudes and beliefs, self-efficacy, information sources, and perceived social norms regarding immunization. To understand participants&#x2019; experiences and perceptions of their health facilities, surveys will measure quality of communication with providers, past experiences with pregnancy and delivery, and perceptions of their facility&#x2019;s physical environment. Lastly, the surveys will measure concepts relating to the individual, including their demographics, common methods of communication, interspousal relationships (if married), and mental health. End-line surveys will include all items from the baseline surveys plus an additional section to measure exposure to the intervention.</p>
                <p>Surveys will vary slightly depending on the participant&#x2019;s classification. For instance, mothers of children younger than 2 will receive a survey which includes questions about their immunization behaviors. Conversely, pregnant women and prospective mothers will receive a similar survey that, instead, includes questions about their intentions to immunize their future children and, for some items, requests they answer as if they currently have a child younger than 2. All other survey items will be identical for participants, regardless of their classification.</p>
                <p>The Health Facility Checklist will measure the quality of the interior physical environment, exterior physical environment, consultation room, storage and supplies, and accessibility of health facilities. Immunization centers are significantly smaller than health facilities and are only used once per month to provide vaccines. Therefore, the Immunization Center Checklist has been modified to measure the same concepts with only the relevant items. Both checklists use items adapted from the Rapid Assessment Tool (
                    <xref ref-type="bibr" rid="ref-33">Scholz 
                        <italic toggle="yes">et al.,</italic> 2015</xref>) and the Site Assessment for Inpatient Postpartum Care (
                    <xref ref-type="bibr" rid="ref-13">JHPIEGO, 2004</xref>).</p>
            </sec>
            <sec>
                <title>Outcomes</title>
                <p>
                    <bold>
                        <italic toggle="yes">Immunization behavior and intent.</italic>
                    </bold> Items measuring immunization behavior and intent are adapted from the Nepal Woman Questionnaire from the 2016 Demographic and Health Survey (DHS) and reflect either the degree to which participants have followed the National Immunization Schedule of Nepal (for mothers) or their intent to follow the schedule in the future (for pregnant women and prospective mothers; 
                    <xref ref-type="bibr" rid="ref-17">Ministry of Health and Population, 2020</xref>; 
                    <xref ref-type="bibr" rid="ref-20">Ministry of Health Nepal 
                        <italic toggle="yes">et al.,</italic> 2017</xref>).</p>
                <p>
                    <bold>
                        <italic toggle="yes">General service use.</italic>
                    </bold> Items measuring health service utilization will address how often the participant has visited their health facility in the last three months for common health issues including family planning, pregnancy checkups, Tuberculosis treatment, diarrhea treatment, pneumonia treatment, and child sick visits.</p>
            </sec>
        </sec>
        <sec>
            <title>Data collection</title>
            <sec>
                <title>Training</title>
                <p>An in-person training will be held in Kathmandu, Nepal for all data collectors to prepare for the qualitative and baseline assessments.  The Principal Investigator will conduct the training alongside research staff from the data collection agency.  The training will be held for five days with an objective to prepare the researchers for qualitative and quantitative data collection. Training topics will include key concepts of the study like child health and immunization, techniques for probing in interviews and facilitating focus group discussions, and ethical research conduct. </p>
                <p>Following researcher training, we will pretest all instruments and research methods in one ward in Makwanpur that is not part of the actual study. During pretesting, supervisors will observe and provide feedback on research techniques.</p>
            </sec>
            <sec>
                <title>Instrument development</title>
                <p>All instruments were designed through an iterative process in which team members from the U.S. and Nepal collaborated to provide feedback and make revisions. Each instrument underwent multiple rounds of revisions until all team members concluded the items appropriately reflected the study&#x2019;s objectives, well-developed theory and literature, and cultural context. Each instrument was translated from English to Nepali by a team member to ensure that questions would be understandable to participants without compromising construct validity.</p>
                <p>All instruments will undergo a final round of revisions during the pre-testing phase during which time we will assess the instruments for flow, cultural appropriateness, and use of technical terms and jargon. Data collectors will provide feedback from their experiences which will be incorporated into final revisions for the instruments.</p>
            </sec>
            <sec>
                <title>Consent process</title>
                <p>Prior to collection of any data, participants will be read aloud and provided an information sheet detailing the purpose of the study, expected duration of participation, types of questions they may be asked, and their options to decline to participate or quit at any time. For interview and survey participants, consent will be obtained immediately following recruitment at the individual&#x2019;s home or place of work in a private space. Data collection will then immediately follow. For focus group discussions, written consent will be obtained individually at the location of data collection. When each participant arrives at the pre-determined location (shared during recruitment), the facilitator will pull them aside to a private spot, review the information and consent form, and obtain consent. The focus group discussion will not begin until individual consent has been provided by all in attendance. Consent will be received with a written signature. All participants will receive an un-signed copy of the information and consent form. Informed consent materials are available as 
                    <italic toggle="yes">Extended data</italic> (
                    <xref ref-type="bibr" rid="ref-28">Paul, 2020</xref>).</p>
            </sec>
        </sec>
        <sec>
            <title>Data analysis</title>
            <sec>
                <title>Qualitative</title>
                <p>As data are being collected, researchers will use an audio recording device and will document  field notes using a handheld tablet to capture the overall picture of the interview or focus group. In their field notes, hey will note their perceptions of the participant&#x2019;s attitude and willingness to engage, as well as the surroundings, interruptions, or other notable characteristics of the session. Following data collection, team members will transcribe the audio recordings and translate them from Nepali to English. Researchers will omit any personally identifiable information shared in interviews and focus groups in the transcripts.</p>
                <p>Following 
                    <xref ref-type="bibr" rid="ref-3">Braun &amp; Clarke&#x2019;s (2006)</xref> guidelines, we will adopt an iterative, thematic analysis approach to analyze the in-depth interviews, key informant interviews, and focus group discussions to uncover prominent themes.  This approach will allow us to thematize both the supply-side (e.g., clinic environments, providers&#x2019; communication patterns) and demand-side (e.g., attitudes, physical access, etc.) facilitators and barriers of immunization behaviors (
                    <xref ref-type="bibr" rid="ref-3">Braun &amp; Clarke, 2006</xref>).</p>
                <p>Researchers with experience in qualitative analysis will independently read through transcripts to gain familiarity with the data and develop an initial codebook. The team will then code transcripts independently, using QSR International's NVivo software, meeting regularly to revise the codebook as themes emerge. Codes will be added both deductively, based on our research question, and inductively as new trends appear. Team members will each be paired with another teammate, rotating on a weekly schedule, to compare codes, discuss discrepancies, and reach consensus. All transcripts will be coded by at least two team members. We will determine prominent themes by comparing codes across the in-depth interviews, key informant interviews, and focus group discussions; running word queries; and creating visual conceptual maps to link patterns.</p>
            </sec>
            <sec>
                <title>Quantitative</title>
                <p>The primary objective of the quantitative analysis is to determine whether the Rejoice Architecture intervention results in greater vaccination uptake (or intentions for vaccination) among mothers (or prospective mothers) in the treatment, compared to the control, arm. Hierarchical linear regressions (HLM) will be used to test the primary hypothesis that vaccination rates (number of newborns vaccinated divided by total live births within a catchment area) in the treatment group will be significantly greater (goal is 10 percent) than that in the control group. This analysis will take into account the clustered nature of data within each of the six catchment areas (three in treatment and three in control areas).</p>
            </sec>
        </sec>
        <sec>
            <title>Data management </title>
            <p>Qualitative interviews and focus group discussions will be recorded on audio recording devices and field notes will be documented on a handheld tablet. Survey responses will also be recorded on a handheld tablet. Audio recording devices and handheld tablets will be stored securely in a locked cabinet or room, accessible only by NEAT researchers, until the data can be uploaded to a computer. Audio recordings, field notes, and survey responses will be uploaded to password protected, encrypted laptops owned by NEAT and shared with the study team using a secure JHU SharePoint account with a built-in encrypted backup solution. Transcription and translation of audio recordings will be completed on NEAT computers and shared with the study team through SharePoint. The original audio recordings will then be destroyed.  </p>
            <sec>
                <title>Limitations</title>
                <p>This study may be limited in several ways. For instance, the study sites were selected purposively and are in one of 77 districts in Nepal; therefore, generalizability could be limited. Findings may also be limited to rural settings among certain ethnic groups in Makwanpur and may vary among other geographic or ethnic contexts.</p>
                <p>Considering the current COVID-19 pandemic, intervention implementation may be delayed, and data will likely reflect the pandemic&#x2019;s effects on facility closures, attitudes toward help-seeking, and health-related behaviors. However, both treatment and control facilities will be exposed to the virus and Nepal&#x2019;s national response, and so no significant differences due to COVID-19 are expected between groups.</p>
            </sec>
            <sec>
                <title>Contribution to the field</title>
                <p>Currently in phase 2 of the study, we have collected baseline data and modified the Rejoice Architecture intervention design, and will implement the intervention when COVID-19 travel restrictions are lifted. We expect this project will make incremental, though important contributions to the global efforts in increasing immunization and reducing child mortality. The iterative and multi-phase procedure will allow for constant adaptation of the intervention, driven by a deepened understanding of individual and contextual factors that will be achieved through community-based participation at every phase. This theory-driven approach will offer a novel connection between community-level theory and individual behavior, bridged by changes in social norms. More specifically, this study will test the pathway between physical infrastructure, mothers&#x2019; behavior and child immunization, and will therefore provide direction for future research aiming to address immunization uptake and other service use in LMICs.</p>
            </sec>
            <sec>
                <title>Ethics and dissemination</title>
                <p>The Institutional Review Boards with Johns Hopkins University (no. 9951) and the Nepal Health Research Council (no. 860/2019) approved this study. All participants will provide written consent before data collection. Findings from this study will be disseminated in participating Palikas and wards in Makwanpur, at international research conferences, and through peer-reviewed journals.</p>
            </sec>
        </sec>
        <sec>
            <title>Data availability</title>
            <sec>
                <title>Underlying data</title>
                <p>No underlying data are associated with this article.</p>
            </sec>
            <sec>
                <title>Extended data</title>
                <p>Open Science Framework: Rejoice Architecture Meets Social Norms to Accelerate Vaccination in Nepal: Protocol for a Mixed-Method Quasi-Experimental Study. 

                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.17605/OSF.IO/JYBK4">https://doi.org/10.17605/OSF.IO/JYBK4</ext-link> (
                    <xref ref-type="bibr" rid="ref-28">Paul, 2020</xref>).</p>
                <p>This project contains the following extended data:</p>
                <list list-type="bullet">
                    <list-item>
                        <p>Interview and focus group guides</p>
                    </list-item>
                    <list-item>
                        <p>Baseline survey instruments</p>
                    </list-item>
                    <list-item>
                        <p>Consent forms</p>
                    </list-item>
                </list>
                <p>Extended data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero "No rights reserved" data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
    </body>
    <back>
        <fn-group>
            <fn id="FN1">
                <p>
                    <sup>1</sup> In the context of this theory, concerns have been raised about its application to policing policies in some parts of the United States. While this demonstrates the misuse of the theory, the theory&#x2019;s core ideas are nevertheless sound &#x2013; that a state of neighborhood disrepair communicates broader neglect (see 
                    <xref ref-type="bibr" rid="ref-54">Vedantam 
                        <italic toggle="yes">et al.</italic>, 2016</xref>). The use of this theory for vaccine promotion in Nepal, to our knowledge, has not been done previously. </p>
            </fn>
        </fn-group>
        <ref-list>
            <ref id="ref-1">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Acharya</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lacoul</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bietsch</surname>
                            <given-names>K</given-names>
                        </name>
</person-group>:
                    <article-title>Factors Affecting Vaccination Coverage and Retention of Vaccination Cards in Nepal</article-title>. DHS Further Analysis Reports No. 121. Rockville, Maryland, USA: ICF.<year>2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://dhsprogram.com/pubs/pdf/FA121/FA121.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Basel</surname>
                            <given-names>PL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shrestha</surname>
                            <given-names>IB</given-names>
                        </name>
</person-group>:
                    <article-title>Factors associated with dropout between Bacille Calmette Guerin (BCG) and measles vaccination in a village development committee of a district.</article-title>
                    <source>

                        <italic toggle="yes">J Nepal Health Res Counc.</italic>
</source>
                    <year>2012</year>;<volume>10</volume>(<issue>21</issue>):<fpage>147</fpage>&#x2013;<lpage>151</lpage>.
                    <pub-id pub-id-type="pmid">23034378</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Braun</surname>
                            <given-names>V</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Clarke</surname>
                            <given-names>V</given-names>
                        </name>
</person-group>:
                    <article-title>Using thematic analysis in psychology.</article-title>
                    <source>

                        <italic toggle="yes">Qual Res Psychol.</italic>
</source>
                    <year>2006</year>;<volume>3</volume>(<issue>2</issue>):<fpage>77</fpage>&#x2013;<lpage>101</lpage>.
                    <pub-id pub-id-type="doi">10.1191/1478088706qp063oa</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-50">
                <mixed-citation publication-type="journal">
                    <collab>Central Bureau of Statistics</collab>:
                    <article-title>District profile of Makwanpur district.</article-title>Government of Nepal National Planning Commission.<year>2005</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://cbs.gov.np/wp-content/upLoads/2019/03/District_Profile_Of_Makawanpur-2074.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-51">
                <mixed-citation publication-type="journal">
                    <collab>Central Bureau of Statistics</collab>:
                    <article-title>National population and housing census 2011: General and social characteristics tables.</article-title>Government of Nepal National Planning Commission Secretariat.<year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://cbs.gov.np/wp-content/upLoads/2018/12/Volume05Part01.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <mixed-citation publication-type="journal">
                    <collab>Child Health Division</collab>:
                    <article-title>National immunization program: Reaching every child, Comprehensive multi-year plan 2068-2072</article-title>. Government of Nepal.<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://dohs.gov.np/wp-content/uploads/chd/Immunization/cMYP_2012_2016_May_2011.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cialdini</surname>
                            <given-names>RB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Reno</surname>
                            <given-names>RR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kallgren</surname>
                            <given-names>CA</given-names>
                        </name>
</person-group>:
                    <article-title>A focus theory of normative conduct: Recycling the concept of norms to reduce littering in public places.</article-title>
                    <source>

                        <italic toggle="yes">J Pers Soc Psychol.</italic>
</source>
                    <year>1990</year>;<volume>58</volume>(<issue>6</issue>):<fpage>1015</fpage>&#x2013;<lpage>1026</lpage>.
                    <pub-id pub-id-type="doi">10.1037/0022-3514.58.6.1015</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Denscombe</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Communities of practice: A research paradigm for the mixed methods approach.</article-title>
                    <source>

                        <italic toggle="yes">J Mix Method Res.</italic>
</source>
                    <year>2008</year>;<volume>2</volume>(<issue>3</issue>):<fpage>270</fpage>&#x2013;<lpage>283</lpage>.
                    <pub-id pub-id-type="doi">10.1177/1558689808316807</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <mixed-citation publication-type="journal">
                    <collab>Department of Health Services</collab>:
                    <article-title>Annual report 2074-75</article-title>. Government of Nepal.<year>2018</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://dohs.gov.np/wp-content/uploads/2019/07/DoHS-Annual-Report-FY-2074-75-date-22-Ashad-2076-for-web-1.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Favin</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Steinglass</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fields</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Why children are not vaccinated: A review of the grey literature.</article-title>
                    <source>

                        <italic toggle="yes">Int Health.</italic>
</source>
                    <year>2012</year>;<volume>4</volume>(<issue>4</issue>):<fpage>229</fpage>&#x2013;<lpage>238</lpage>.
                    <pub-id pub-id-type="pmid">24029668</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.inhe.2012.07.004</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fox</surname>
                            <given-names>JP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Elveback</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Scott</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Herd immunity: basic concept and relevance to public health immunization practices.</article-title>
                    <source>

                        <italic toggle="yes">Am J Epidemiol.</italic>
</source>
                    <year>1971</year>;<volume>94</volume>(<issue>3</issue>):<fpage>179</fpage>&#x2013;<lpage>189</lpage>.
                    <pub-id pub-id-type="pmid">5093648</pub-id>
                    <pub-id pub-id-type="doi">10.1093/oxfordjournals.aje.a121310</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <mixed-citation publication-type="journal">
                    <collab>Gavi</collab>:
                    <article-title>Facts and figures: Statistics measuring our impact on global immunization</article-title>.<year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.gavi.org/programmes-impact/our-impact/facts-and-figures">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jain</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Humienny</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>Normative influences on the role of prescription medicine misuse among college students in the United States.</article-title>
                    <source>

                        <italic toggle="yes">Health Commun.</italic>
</source>
                    <year>2020</year>;<volume>35</volume>(<issue>3</issue>):<fpage>331</fpage>&#x2013;<lpage>340</lpage>.
                    <pub-id pub-id-type="pmid">30628463</pub-id>
                    <pub-id pub-id-type="doi">10.1080/10410236.2018.1563029</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jang</surname>
                            <given-names>SA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rimal</surname>
                            <given-names>RN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cho</surname>
                            <given-names>N</given-names>
                        </name>
</person-group>:
                    <article-title>Normative influences and alcohol consumption: The role of drinking refusal self-efficacy.</article-title>
                    <source>

                        <italic toggle="yes">Health Commun.</italic>
</source>
                    <year>2013</year>;<volume>28</volume>(<issue>5</issue>):<fpage>443</fpage>&#x2013;<lpage>451</lpage>.
                    <pub-id pub-id-type="pmid">22809467</pub-id>
                    <pub-id pub-id-type="doi">10.1080/10410236.2012.691455</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <mixed-citation publication-type="journal">
                    <collab>JHPIEGO</collab>:
                    <article-title>Site assessment tool for inpatient postpartum care basic information. Part A: Equipment and supplies</article-title>. In A. Blouse, P. Gomez, &amp; B. Kinzie (Eds.),
                    <italic toggle="yes">Site assessment and strengthening for maternal and newborn health programs.</italic>JHPIEGO.<year>2004</year>;<fpage>1</fpage>&#x2013;<lpage>6</lpage>.</mixed-citation>
            </ref>
            <ref id="ref-70">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>KF</given-names>
                        </name>
</person-group>:
                    <article-title>The influence of school connectedness and academic self efficacy on self-reported norm related pro-social behavior.</article-title>Doctoral dissertation. Pennsylvania State University.<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://pdfs.semanticscholar.org/abd5/19670806107e1a0d370076067b60c07de5e9.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shu</surname>
                            <given-names>SB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dellaert</surname>
                            <given-names>BGC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Beyond nudges: Tools of a choice architecture.</article-title>
                    <source>

                        <italic toggle="yes">Market Lett.</italic>
</source>
                    <year>2012</year>;<volume>23</volume>:<fpage>487</fpage>&#x2013;<lpage>504</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s11002-012-9186-1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lapinski</surname>
                            <given-names>MK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Anderson</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shugart</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Social influence in child care centers: A test of the theory of normative social behavior.</article-title>
                    <source>

                        <italic toggle="yes">Health Commun.</italic>
</source>
                    <year>2014</year>;<volume>29</volume>(<issue>3</issue>):<fpage>219</fpage>&#x2013;<lpage>232</lpage>.
                    <pub-id pub-id-type="pmid">23682754</pub-id>
                    <pub-id pub-id-type="doi">10.1080/10410236.2012.738322</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Matsumura</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nakayama</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Okamoto</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Measles vaccine coverage and factors related to uncompleted vaccination among 18-month-old and 36-month-old children in Kyoto, Japan.</article-title>
                    <source>

                        <italic toggle="yes">BMC Public Health.</italic>
</source>
                    <year>2005</year>;<volume>5</volume>(<issue>1</issue>):<fpage>59</fpage>.
                    <pub-id pub-id-type="pmid">15935101</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1471-2458-5-59</pub-id>
                    <pub-id pub-id-type="pmcid">1177963</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-17">
                <mixed-citation publication-type="journal">
                    <collab>Ministry of Health and Population Nepal</collab>:
                    <article-title>National immunization programme</article-title>. Government of Nepal.<year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.mohp.gov.np/eng/program/child-health-services/nip">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <mixed-citation publication-type="journal">
                    <collab>Ministry of Health Nepal</collab>:
                    <article-title>Nepal Health Sector Strategy Implementation Plan 2016-2021</article-title>. Government of Nepal.<year>2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://nepalphysio.org.np/wp-content/uploads/2017/04/NHSS_implementation_plan_2016_2021.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <mixed-citation publication-type="journal">
                    <collab>Ministry of Health Nepal Department of Health Services</collab>:
                    <article-title>Annual Report 2016-17</article-title>.<year>2018</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://dohs.gov.np/wp-content/uploads/2018/04/Annual_Report_2073-74.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <mixed-citation publication-type="journal">
                    <collab>Ministry of Health Nepal, New ERA, &amp; ICF</collab>:
                    <article-title>Nepal Demographic and Health Survey 2016</article-title>.<year>2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.dhsprogram.com/pubs/pdf/fr336/fr336.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-21">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nandi</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shet</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Why vaccines matter: Understanding the broader health, economic, and child development benefits of routine vaccination.</article-title>
                    <source>

                        <italic toggle="yes">Hum Vaccin Immunother.</italic>
</source>
                    <year>2020</year>;<fpage>1</fpage>&#x2013;<lpage>5</lpage>.
                    <pub-id pub-id-type="pmid">31977283</pub-id>
                    <pub-id pub-id-type="doi">10.1080/21645515.2019.1708669</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-22">
                <mixed-citation publication-type="journal">
                    <collab>National Planning Commission</collab>:
                    <article-title> Nepal&#x2019;s sustainable development goals, baseline report.</article-title>Government of Nepal.<year> 2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.npc.gov.np/images/category/SDGs_Baseline_Report_final_29_June-1(1).pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-52">
                <mixed-citation publication-type="journal">
                    <collab>Nepal Law Commission</collab>:
                    <article-title>Nepal marriage bill 2011</article-title>. Government of Nepal.<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.lawcommission.gov.np/en/wp-content/uploads/2018/09/nepal-marriage-bill-2011-b-s.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-23">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Njau</surname>
                            <given-names>JD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cairns</surname>
                            <given-names>LK</given-names>
                        </name>
</person-group>:
                    <article-title>A literature review on the economic benefits of vaccines in low and middle income countries: Evaluating progress in the era of &#x2018;
                        <italic toggle="yes">a decade of vaccines</italic>&#x2019; initiative.</article-title>
                    <source>

                        <italic toggle="yes">Vaccine Reports.</italic>
</source>
                    <year>2016</year>;<volume>6</volume>:<fpage>62</fpage>&#x2013;<lpage>76. Scopus</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.vacrep.2016.11.002</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-53">
                <mixed-citation publication-type="journal">
                    <collab>NordNordWest</collab>:
                    <article-title>Makwanpur District in Nepal 2015</article-title>.<year>2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://commons.wikimedia.org/wiki/File:Makwanpur_District_in_Nepal_2015.svg">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-24">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Odusanya</surname>
                            <given-names>OO</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Alufohai</surname>
                            <given-names>EF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Meurice</surname>
                            <given-names>FP</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Determinants of vaccination coverage in rural Nigeria.</article-title>
                    <source>

                        <italic toggle="yes">BMC Public Health.</italic>
</source>
                    <year>2008</year>;<volume>8</volume>(<issue>1</issue>):<fpage>381</fpage>.
                    <pub-id pub-id-type="pmid">18986544</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1471-2458-8-381</pub-id>
                    <pub-id pub-id-type="pmcid">2587468</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-25">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Owino</surname>
                            <given-names>LO</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Irimu</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Olenja</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Factors influencing immunisation coverage in Mathare Valley, Nairobi.</article-title>
                    <source>

                        <italic toggle="yes">East Afr Med J.</italic>
</source>
                    <year>2009</year>;<volume>86</volume>(<issue>7</issue>):<fpage>323</fpage>&#x2013;<lpage>329</lpage>.
                    <pub-id pub-id-type="pmid">20499781</pub-id>
                    <pub-id pub-id-type="doi">10.4314/eamj.v86i7.54146</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-26">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ozawa</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Clark</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Portnoy</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Estimated economic impact of vaccinations in 73 low- and middle-income countries, 2001-2020.</article-title>
                    <source>

                        <italic toggle="yes">Bull World Health Organ.</italic>
</source>
                    <year>2017</year>;<volume>95</volume>(<issue>9</issue>):<fpage>629</fpage>&#x2013;<lpage>638</lpage>.
                    <pub-id pub-id-type="pmid">28867843</pub-id>
                    <pub-id pub-id-type="doi">10.2471/BLT.16.178475</pub-id>
                    <pub-id pub-id-type="pmcid">5578376</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-27">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ozawa</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mirelman</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Stack</surname>
                            <given-names>ML</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Cost-effectiveness and economic benefits of vaccines in low- and middle-income countries: A systematic review.</article-title>
                    <source>

                        <italic toggle="yes">Vaccine.</italic>
</source>
                    <year>2012</year>;<volume>31</volume>(<issue>1</issue>):<fpage>96</fpage>&#x2013;<lpage>108</lpage>.
                    <pub-id pub-id-type="pmid">23142307</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.vaccine.2012.10.103</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-28">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Paul</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Rejoice Architecture Meets Social Norms to Accelerate Vaccination in Nepal: Protocol for a Mixed-Method Quasi-Experimental Study.</article-title>
                    <year> 2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.17605/OSF.IO/JYBK4">http://www.doi.org/10.17605/OSF.IO/JYBK4</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-29">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Perry</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nurani</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Quaiyum</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Barriers to immunization among women and children living in slums of zone 3 of Dhaka City, Bangladesh: A qualitative assessment</article-title>.
                    <italic toggle="yes">icddr,b Knowledge for Global Lifesaving Solutions</italic>.<year> 2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.academia.edu/23402951/Barriers_to_immunization_among_women_and_children_living_in_slums_of_Zone_3_of_Dhaka_city_Bangladesh_a_qualitative_assessment">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-30">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rainey</surname>
                            <given-names>JJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Watkins</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ryman</surname>
                            <given-names>TK</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Reasons related to non-vaccination and under-vaccination of children in low and middle income countries: Findings from a systematic review of the published literature, 1999 &#x2013; 2009.</article-title>
                    <source>

                        <italic toggle="yes">Vaccine.</italic>
</source>
                    <year>2011</year>;<volume>29</volume>(<issue>46</issue>):<fpage>8215</fpage>&#x2013;<lpage>8221</lpage>.
                    <pub-id pub-id-type="pmid">21893149</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.vaccine.2011.08.096</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-31">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rimal</surname>
                            <given-names>RN</given-names>
                        </name>
</person-group>:
                    <article-title>Modeling the relationship between descriptive norms and behaviors: A test and extension of the theory of normative social behavior (TNSB).</article-title>
                    <source>

                        <italic toggle="yes">Health Commun.</italic>
</source>
                    <year>2008</year>;<volume>23</volume>(<issue>2</issue>):<fpage>103</fpage>&#x2013;<lpage>116</lpage>.
                    <pub-id pub-id-type="pmid">18443998</pub-id>
                    <pub-id pub-id-type="doi">10.1080/10410230801967791</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-32">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rimal</surname>
                            <given-names>RN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Real</surname>
                            <given-names>K</given-names>
                        </name>
</person-group>:
                    <article-title>How behaviors are influenced by perceived norms: A test of the theory of normative social behavior.</article-title>
                    <source>

                        <italic toggle="yes">Communication Research.</italic>
</source>
                    <year>2005</year>;<volume>32</volume>(<issue>3</issue>):<fpage>389</fpage>&#x2013;<lpage>414</lpage>.
                    <pub-id pub-id-type="doi">10.1177/0093650205275385</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-33">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Scholz</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ngoli</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Flessa</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Rapid assessment of infrastructure of primary health care facilities &#x2013; a relevant instrument for health care systems management.</article-title>
                    <source>

                        <italic toggle="yes">BMC Health Serv Res.</italic>
</source>
                    <year>2015</year>;<volume>15</volume>:<fpage>183</fpage>.
                    <pub-id pub-id-type="pmid">25928252</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12913-015-0838-8</pub-id>
                    <pub-id pub-id-type="pmcid">4421986</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-34">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shrestha</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shrestha</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wagle</surname>
                            <given-names>RR</given-names>
                        </name>
</person-group>:
                    <article-title>Predictors of incompletion of immunization among children residing in the slums of Kathmandu valley, Nepal: A case-control study.</article-title>
                    <source>

                        <italic toggle="yes">BMC Public Health.</italic>
</source>
                    <year>2016</year>;<volume>16</volume>(<issue>1</issue>):<fpage>970</fpage>.
                    <pub-id pub-id-type="pmid">27619349</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12889-016-3651-3</pub-id>
                    <pub-id pub-id-type="pmcid">5020516</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-35">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thaler</surname>
                            <given-names>RH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sunstein</surname>
                            <given-names>CR</given-names>
                        </name>
</person-group>:
                    <article-title>Nudge: Improving decisions about health, wealth, and happiness.</article-title>New Haven: Yale University Press.<year> 2008</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www0.gsb.columbia.edu/mygsb/faculty/research/pubfiles/5055/nudge.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-36">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thaler</surname>
                            <given-names>RH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sunstein</surname>
                            <given-names>CR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Balz</surname>
                            <given-names>JP</given-names>
                        </name>
</person-group>:
                    <article-title>Choice architecture.</article-title>In Shafir E (Ed.),
                    <italic toggle="yes">The behavior foundations of public policy.</italic>Princeton University Press.<year>2014</year>;<fpage>428</fpage>&#x2013;<lpage>439</lpage>.
                    <pub-id pub-id-type="doi">10.2139/ssrn.2536504</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-54">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Vedantam</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Benderev</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Boyle</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>How A theory of crime and policing was born, and went terribly wrong.</article-title>NPR.<year>2016</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.npr.org/2016/11/01/500104506/broken-windows-policing-and-the-origins-of-stop-and-frisk-and-how-it-went-wrong">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-37">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Vonasek</surname>
                            <given-names>BJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bajunirwe</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jacobson</surname>
                            <given-names>LE</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Do maternal knowledge and attitudes towards childhood immunizations in rural Uganda correlate with complete childhood vaccination?</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2016</year>;<volume>11</volume>(<issue>2</issue>):<fpage>e0150131</fpage>.
                    <pub-id pub-id-type="pmid">26918890</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0150131</pub-id>
                    <pub-id pub-id-type="pmcid">4769080</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-38">
                <mixed-citation publication-type="journal">
                    <collab>The World Medical Association</collab>:
                    <article-title>Communicable diseases: Diseases transmitted by bacteria and viruses.</article-title>
                    <year> 2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.wma.net/what-we-do/public-health/communicable-diseases/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-39">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wilson</surname>
                            <given-names>JQ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kelling</surname>
                            <given-names>GL</given-names>
                        </name>
</person-group>:
                    <article-title>Broken windows.</article-title>Atlantic Monthly.<year>1982</year>;<fpage>29</fpage>&#x2013;<lpage>36</lpage>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.theatlantic.com/magazine/archive/1982/03/broken-windows/304465/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-40">
                <mixed-citation publication-type="journal">
                    <collab>World Health Organization</collab>:
                    <article-title>Immunization coverage: Key facts.</article-title>
                    <year> 2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.who.int/en/news-room/fact-sheets/detail/immunization-coverage">Reference Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report30495">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14367.r30495</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Bednarczyk</surname>
                        <given-names>Robert A.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30495a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-6812-0928</uri>
                </contrib>
                <aff id="r30495a1">
                    <label>1</label>Rollins School of Public Health, Emory University, Atlanta, GA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>6</day>
                <month>4</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Bednarczyk RA</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30495" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13168.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This protocol describes the Rejoice Architecture intervention, designed to improve childhood vaccination in Makwanpur, Nepal. This mixed-methods study aims to utilize three theories - choice architecture, broken windows, and normative social behavior - to guide development, implementation, and evaluation of the intervention.&#x00a0;</p>
            <p> </p>
            <p> There are some clarifications needed to help this manuscript: 
                <list list-type="order">
                    <list-item>
                        <p>In the second paragraph of the introduction, please indicate which ages are under evaluation when describing 20 million children who are not appropriately vaccinated. Additionally, what percentage&#x00a0;of the global childhood population does this represent (either in total or in LMIC)?</p>
                    </list-item>
                    <list-item>
                        <p>In the first paragraph under "National Immunization Programme", please spell out rotavirus rather than saying "rota". Additionally, the language here is difficult to follow because in some cases it seems like a disease is presented and in some cases the specific vaccine is presented.&#x00a0;Please edit for clarity (e.g. "vaccines against seven additional diseases...").</p>
                    </list-item>
                    <list-item>
                        <p>I am a bit concerned about the use of Broken Windows theory, as there have been some studies that have shown that this is a flawed theory, specifically as it relates to crime in the US.&#x00a0; Has this been used to guide interventions (vaccine-related or in other settings) in Nepal?&#x00a0;&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>In the Methods, you refer to the geographic location of Makwanpur as maximizing "external validity" but given differences across Nepal, as indicated by highlighting the Terai and mountain regions, I am unclear by what you are referring to. This is especially of concern when, in the limitations, you reference generalizability issues given the location of the intervention.</p>
                    </list-item>
                    <list-item>
                        <p>Can you reference the population of Makwanpur, both in terms of numbers and breakdown of other characteristics relative to the general Nepal population, to help address some of these generalizability issues.&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>Why are you doing IDI for fathers/grandmothers and FGD for mothers?&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>In the sampling section of the Quantitative Methods, you describe sample size estimation with a starting point of 83% vaccinated, but this contradicts the 77% referenced in the first paragraph of the Methods.</p>
                    </list-item>
                    <list-item>
                        <p>In the analysis of the qualitative methods, you talk about recordings, but don't directly discuss how this recording will be done, how files will be stored, etc.&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>A figure describing the timeline for the project, to clarify the evaluation period, timing of surveys, etc. would be helpful.&#x00a0;</p>
                    </list-item>
                </list>
            </p>
            <p>Is the study design appropriate for the research question?</p>
            <p>Yes</p>
            <p>Is the rationale for, and objectives of, the study clearly described?</p>
            <p>Yes</p>
            <p>Are sufficient details of the methods provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Are the datasets clearly presented in a useable and accessible format?</p>
            <p>Not applicable</p>
            <p>Reviewer Expertise:</p>
            <p>Infectious disease epidemiology, vaccine acceptance, global health</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report30498">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14367.r30498</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Poudyal</surname>
                        <given-names>Nimesh</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30498a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-4156-7017</uri>
                </contrib>
                <contrib contrib-type="author">
                    <name>
                        <surname>Mogeni</surname>
                        <given-names>Ondari D.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30498a2">2</xref>
                    <role>Co-referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5133-3735</uri>
                </contrib>
                <aff id="r30498a1">
                    <label>1</label>Department of Epidemiology and Public Health Research, International Vaccine Institute, Seoul, South Korea</aff>
                <aff id="r30498a2">
                    <label>2</label>Department of Interventions and Implementation Research, International Vaccine Institute, Seoul, South Korea</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>24</day>
                <month>3</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Poudyal N and Mogeni OD</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30498" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13168.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The article describes a well-designed study protocol to develop an intervention termed "Rejoice Architecture" within the conceptual framework of choice architecture, broken windows theory, and theory of normative social behavior and evaluate the impact of the intervention on immunization behavior and intentions through mixed-method quasi-experimental study. The rationale on the need for developing such an intervention and approach for evaluation of the impact is well laid-down by the authors and the study objectives are also clearly described in the protocol. It is clear that the study aims to understand the challenges of immunization uptake and measuring the impact of intervention instituted.</p>
            <p> </p>
            <p> The overall design of the study is replicable, but it would be good if the authors are able to describe the study setting further elaborating the population demographics and in particular under 2 years and how this compares to the rest of the country, the size of Makwanpur district, and what is the mortality per 1000 live births, in order to put the vaccine coverage of 76.7% into perspective. Additionally, it may be good to add a justification for the selection of that particular study area and describing the selection criteria used. Furthermore, of the units to be included in the study, some will be categorized into "treatment group" and "control group". Providing more details on what qualifies a unit to be termed "control group" and providing specific activities/intervention planned in each group will help understand the study design more clearly for its replication.&#x00a0;One &#x2018;control group&#x2019; is ultimately excluded during the intervention stage of the study and it is not clear what role this excluded group serves.</p>
            <p> </p>
            <p> It may also be good to consider including a section on data management. The study design in the article mentions the use of handheld tablets, but it does not provide any detail on how the data will be managed throughout the study period,&#x00a0;where it will be warehoused, how data safety and security will be ensured,&#x00a0;who will be able to access the data? Is there an egalitarian approach given this is a collaboration?</p>
            <p> </p>
            <p> One must be 18 years and over to be eligible to participate in the study. Given the challenges faced by mothers who are less than 18 years old in accessing immunization services, not including them during the formative assessment may lead to a bias on the designing of the intervention. A few articles seem to suggest teenage motherhood is prevalent in the area as well as in the country: 
                <list list-type="order">
                    <list-item>
                        <p>https://kathmandupost.com/national/2018/02/15/teenage-pregnancy-rife-in-makwanpur</p>
                    </list-item>
                    <list-item>
                        <p>http://www.bibalex.org/Search4Dev/files/428878/455706.pdf</p>
                    </list-item>
                </list> </p>
            <p> It is not clear in the consenting process whether it will be done individually or collectively in the case of focus group discussion. And will each participant sign an informed consent form? Will a signed copy be extended to them?</p>
            <p> </p>
            <p> It is mentioned that the respective IRBs have approved the study. It will be helpful to include the IRB approval number from respective IRBs for future reference.&#x00a0;</p>
            <p> </p>
            <p> It is great that part of the dissemination process includes engagements of the participating Palikas. Will this be done at the community level or at the official level? Though it is mentioned that the results may not be generalized, it may be good to provide this feedback to stakeholders such as government officials to consider the study at a larger scale more so if the results are positive and given the overall goal is to increase immunization coverage.</p>
            <p> </p>
            <p> There is mention of COVID-19 and its impact. What may be the mitigation measures if travel is not possible?</p>
            <p>Is the study design appropriate for the research question?</p>
            <p>Yes</p>
            <p>Is the rationale for, and objectives of, the study clearly described?</p>
            <p>Yes</p>
            <p>Are sufficient details of the methods provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Are the datasets clearly presented in a useable and accessible format?</p>
            <p>Not applicable</p>
            <p>Reviewer Expertise:</p>
            <p>Vaccinology, Infectious Disease, Epidemiology</p>
            <p>We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report30492">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14367.r30492</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Weber</surname>
                        <given-names>Ann M.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30492a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-8130-5858</uri>
                </contrib>
                <aff id="r30492a1">
                    <label>1</label>School of Community Health Sciences, University of Nevada, Reno, NV, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>22</day>
                <month>3</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Weber AM</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30492" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13168.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This is a well-written manuscript of an ambitious study to improve childhood immunization rates in Nepal. Overall, the protocol is clear and easy to follow. The introduction very nicely lays out the importance of the issue, the local context, and the facilitators and barriers to increased uptake. The open source links to the qualitative interview guides and surveys are particularly appreciated and very helpful. My major comments are for 1) consideration of addressing the normative behavior aspects of the issue in more depth, 2) recommendations to describe plans for the intervention itself in more detail, and 3) improved clarity for the justification of some of the study design decisions.</p>
            <p> </p>
            <p> Major comments:</p>
            <p> </p>
            <p> 1. The inclusion of fathers and grandmothers is an important component of the qualitative research and understanding normative influences around the barriers to immunization of children. It might be helpful to readers to briefly explain the reasoning behind their inclusion. Importantly, transforming social norms is difficult, but possible. It requires engaging stakeholders at multiple levels (including fathers, grandparents, village leaders) and across multiple domains (of families, communities, and institutions) in the intervention. It would be helpful to understand how various stakeholders are involved in the intervention itself as well as in the quantitative aspect of the study, if at all. For example, are fathers and grandmothers engaged as part of the intervention? Will they be interviewed or surveyed after the program implementation to assess change in their beliefs, knowledge or attitudes? If no to both questions, I would recommend that the researchers consider opportunities to include them throughout the study process.</p>
            <p> </p>
            <p> 2. As a reader, I would appreciate more detail on the plans for the intervention itself (in addition to the question above about fathers and grandparents) that address some of the barriers raised in the introduction. For example, will health workers be trained to address barriers related to how families are treated in the clinics (assuming this issue if raised in the qualitative portion)? The implementation of an appointment reminder system seems to be a key element to addressing the essential enabler that: &#x201c;parents know and remember this schedule in order to bring their children to the facility at the appropriate time.&#x201d; How might such an appointment system be implemented, for example, with text messages to moms?&#x00a0; Does it require an electronic records system to be implemented in the clinics? How does the intervention address the issue of loss of immunization cards?</p>
            <p> </p>
            <p> 3. There are some elements of the study design that aren&#x2019;t clearly justified or motivated for the reader. For example: 
                <list list-type="bullet">
                    <list-item>
                        <p>The justification of non-random selection of wards and clinics within wards is unclear and I would encourage the researchers to consider the possibility of performing a cluster randomized study. The researchers state that they want to &#x201c;maximize geographic diversity across the three Palikas.&#x201d;&#x00a0; However, this might be accomplished with stratified sampling. &#x00a0;Athey and Imbens recommend &#x201c;researchers to stratify the population into small strata and then randomize within the strata and adjust the standard errors to capture the gains from the stratification&#x201d; and furthermore &#x201c;that one should always stratify as much as possible, up to the point that each stratum contains at least two treated and two control units.&#x201d; (Athey and Imbens, 2017
                            <sup>
                                <xref ref-type="bibr" rid="rep-ref-30492-1">1</xref>
                            </sup>).</p>
                    </list-item>
                    <list-item>
                        <p>Is limiting the participants to a 1 km radius of a study health facility for ease of access for the research? If so, are the researchers concerned that they might be overlooking an important barrier to immunization uptake due to the time cost of travel in terms of generalizability to participants living further away?&#x00a0;How are they trying to address this concern?</p>
                    </list-item>
                    <list-item>
                        <p>Why are mothers only part of focus groups and not planned for any in-depth interviews?&#x00a0;It might be useful to ask mothers in-depth questions about the people in her life that influence her behavior and the same questions about household dynamics that are asked of fathers and grandmothers.</p>
                    </list-item>
                    <list-item>
                        <p>The checklist evaluation of the intervention implementation may miss opportunities to better understand implementation challenges.&#x00a0;It might be valuable to have more quantitative data to understand implementation or process issues not picked up by the checklist in the event that the program is not as effective as hoped. For example, will any of the key health workers by surveyed before and after the intervention? How will the appointment system be evaluated?</p>
                    </list-item>
                </list> Minor comments: 
                <list list-type="bullet">
                    <list-item>
                        <p>Methods - Second paragraph &#x2013; &#x201c;For each ward in the treatment arm, we selected another ward and clinic as a 
                            <italic>treatment</italic> site in that Palika, matched on population characteristics with the treatment ward.&#x201d;&#x00a0;Did the authors mean to write &#x201c;&#x2026;we selected another ward and clinic as a 
                            <italic>control</italic> site in that Palika&#x2026;&#x201d;?&#x00a0; Also, what are the population characteristics that they will match on?</p>
                    </list-item>
                    <list-item>
                        <p>Qualitative - What is the rationale for excluding one control site from the collection of qualitative data?</p>
                    </list-item>
                    <list-item>
                        <p>Quantitative - The ICC of 0.01 seems very small.&#x00a0;How was this value determined?</p>
                    </list-item>
                    <list-item>
                        <p>Will administrative data be available on overall vaccination rates in the communities?</p>
                    </list-item>
                    <list-item>
                        <p>A 20% attrition rate after 8 months seems high. Why do the researchers think that there will be so much attrition?&#x00a0;Is there any action that could be ethically included in the study to minimize attrition?</p>
                    </list-item>
                </list>
            </p>
            <p>Is the study design appropriate for the research question?</p>
            <p>Yes</p>
            <p>Is the rationale for, and objectives of, the study clearly described?</p>
            <p>Yes</p>
            <p>Are sufficient details of the methods provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Are the datasets clearly presented in a useable and accessible format?</p>
            <p>Not applicable</p>
            <p>Reviewer Expertise:</p>
            <p>Child health and development; program impact evaluations in low- and middle-income countries; gender inequality and norms; health disparities.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-30492-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>The Econometrics of Randomized Experiments a</article-title>.<volume>1</volume>:
                        <elocation-id>10.1016/bs.hefe.2016.10.003</elocation-id>
                        <fpage>73</fpage>-<lpage>140</lpage>
                        <pub-id pub-id-type="doi">10.1016/bs.hefe.2016.10.003</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
    </sub-article>
</article>
