<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Gates Open Res</journal-id>
            <journal-title-group>
                <journal-title>Gates Open Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2572-4754</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/gatesopenres.13407.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Improving data use for decision making by neglected tropical disease program teams: eight use cases</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved, 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Grubin</surname>
                        <given-names>Liz</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-3053-0972</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Balachandran</surname>
                        <given-names>Lakshmi</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Bartlett</surname>
                        <given-names>Sarah</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Biritwum</surname>
                        <given-names>Nana-Kwadwo</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Brooker</surname>
                        <given-names>Simon</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-2314-0415</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Fleming</surname>
                        <given-names>Fiona</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-3866-2232</uri>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Kollie</surname>
                        <given-names>Karsor</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a6">6</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Matendechero</surname>
                        <given-names>Sultani</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a7">7</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Mengistu</surname>
                        <given-names>Birhan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a8">8</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Muehleman</surname>
                        <given-names>TJ</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a9">9</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Mwingira</surname>
                        <given-names>Upendo</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a10">10</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Partridge</surname>
                        <given-names>Brooke</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Pavluck</surname>
                        <given-names>Alex</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Rebollo Polo</surname>
                        <given-names>Maria</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a11">11</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Tezembong</surname>
                        <given-names>Modeste</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-6417-1699</uri>
                    <xref ref-type="aff" rid="a11">11</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Treatman</surname>
                        <given-names>Derek</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Yeary</surname>
                        <given-names>Rosalyn</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Zoerhoff</surname>
                        <given-names>Katie</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a12">12</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Zoure</surname>
                        <given-names>Honorat</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a11">11</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Vital Wave, Palo Atlo, CA, USA</aff>
                <aff id="a2">
                    <label>2</label>Clinton Health Access Initiative, Boston, MA, USA</aff>
                <aff id="a3">
                    <label>3</label>Sightsavers, Haywards Heath, UK</aff>
                <aff id="a4">
                    <label>4</label>Bill &amp; Melinda Gates Foundation, Seattle, WA, USA</aff>
                <aff id="a5">
                    <label>5</label>SCI Foundation, London, UK</aff>
                <aff id="a6">
                    <label>6</label>Non-Communicable and Neglected Tropical Disease Program, Ministry of Health and Social Welfare, Monrovia, Liberia</aff>
                <aff id="a7">
                    <label>7</label>Division of Vector Borne and Neglected Tropical Diseases, Kenya Ministry of Health, Nairobi, Kenya</aff>
                <aff id="a8">
                    <label>8</label>Neglected Tropical Diseases, Federal Ministry of Health of Ethiopia, Addis Ababa, Ethiopia</aff>
                <aff id="a9">
                    <label>9</label>Standard Code, Atlanta, USA</aff>
                <aff id="a10">
                    <label>10</label>Tanzanian Neglected Tropical Diseases Control Programme, Ministry of Health, Dar es Salaam, Tanzania</aff>
                <aff id="a11">
                    <label>11</label>Expanded Special Project on the Elimination of Neglected Tropical Diseases, WHO-AFRO, Brazzaville, Congo</aff>
                <aff id="a12">
                    <label>12</label>RTI International, Research Triangle Park, NC, USA</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:simon.brooker@gatesfoundation.org">simon.brooker@gatesfoundation.org</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>N-K B, RY and SJB work for the Bill and Melinda Gates Foundation which funded the work. </p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>9</day>
                <month>11</month>
                <year>2021</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>5</volume>
            <elocation-id>153</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>25</day>
                    <month>10</month>
                    <year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Grubin L et al.</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://gatesopenresearch.org/articles/5-153/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> The achievement of neglected tropical diseases (NTDs) program goals depends on numerous factors, including the ability of national programs to use high-quality, timely data to inform their decision-making and program delivery. This paper presents a use case analysis of the routine data used by national NTD programs targeting lymphatic filariasis, onchocerciasis, schistosomiasis, soil-transmitted helminthiasis, and trachoma.</p>
                <p>
                    <bold>Methods:</bold> The use cases were developed through a combination of secondary and primary research focused on both global trends and deep dives into Burkina Faso, Ethiopia, and Tanzania. Results were refined through a stakeholder convening and the final eight use cases were determined through iteration and prioritization with stakeholders.</p>
                <p>
                    <bold>Results:</bold> Eight use cases were developed: improve treatment register data quality, strengthen supervision of drug distributors during mass drug administration (MDA), generate accurate community-level population data for MDAs, create and manage an accurate inventory of drugs, meet district coverage targets during MDA campaigns, feedback and performance to sub-district teams, feedback on performance to sub-national teams, and national-level program use of data for evaluation and decision making. Each use case identifies key actors and their data-related needs and critical challenges, defines the current and desired state, and articulates the profile of a solution (digital and non-digital) needed to complete the use case.</p>
                <p>
                    <bold>Conclusion:</bold> The systematic strengthening of data use for decision-making in NTD programs is key for reaching the 2030 Roadmap goals. Integrated together, the presented use cases, when translated into action using appropriate and innovative solutions, can help to ensure that accurate and timely data are present at every step of a program and empower countries to use these data to make program decisions.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Neglected tropical diseases; data systems; decision-making; use cases; data solutions</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>Gates Foundation</funding-source>
                    <award-id>INV-006254</award-id>
                </award-group>
                <funding-statement>This work was supported by the Gates Foundation [INV-006254].</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>Since 2010, the global community has made strong progress in the prevention, control, and elimination of neglected tropical diseases (NTDs). The number of people requiring NTD interventions has declined by 500 million, and more than 40 countries have eliminated at least one NTD (
                <xref ref-type="bibr" rid="ref-1">The Lancet Global Health, 2020</xref>; 
                <xref ref-type="bibr" rid="ref-8">WHO, 2020a</xref>). The year 2020 saw the launch of a new WHO roadmap for 2021&#x2013;2030, which outlines targets and milestones in the fight against 20 NTDs. Achievement of these targets depends on numerous factors, including the ability of national programs to use high-quality, timely data to inform their decision-making and program delivery. In particular, programs need to (i) determine where to target mass drug administration (MDA) and other interventions, (ii) undertake planning and resource-allocation, (iii) detect and address poorly performing areas, (iv) determine where there is a need to change intervention strategy or whether interventions can be stopped, and (v) how to implement post-MDA surveillance, among others. If programs cannot access relevant data or do not trust the quality of available data, they will not use them; and if they use low-quality data, they may make incorrect decisions that will ultimately hamper progress towards programmatic targets. </p>
            <p>There are several reasons as to why programs do not use the best available data to make decisions including: NTD data sources and health information systems are often fragmented, which makes it difficult for data users to access relevant data; data collection and data management may be prone to technical or human error (
                <xref ref-type="bibr" rid="ref-2">de Souza 
                    <italic toggle="yes">et al</italic>., 2016</xref>); and technical and institutional barriers to sharing of data may exist. Improved data sources, tools, and systems can help address some of these issues, but alone they will not be sufficient to ensure data are used effectively; there is a need to strengthen the capacity of individuals working at all levels of the health system and to couple that with a supportive enabling environment.</p>
            <p>The Global Strategy on Digital Health, 2020&#x2013;2024 developed by the World Health Organization (WHO) defines seven components of such enabling environments (
                <xref ref-type="bibr" rid="ref-9">WHO, 2020b</xref>), based upon the WHO&#x2019;s health system strengthening building blocks, with an emphasis on standards and interoperability, workforce, and leadership and governance (
                <xref ref-type="bibr" rid="ref-7">WHO, 2010</xref>). In the context of NTDs, the WHO Roadmap, 2021&#x2013;2030 emphasizes the need for integrated, digital data systems that support decision-making at national and local levels and which are interoperable with national health information systems (
                <xref ref-type="bibr" rid="ref-8">WHO, 2020a</xref>).</p>
            <p>To understand opportunities to improve data use within a given context, it is important to identify the main decisions faced by NTD programs and the specific situations in which data are used &#x2013; or not used &#x2013; by different individuals. In particular, it is instructive to understand the challenges faced by individuals in using data in their decision-making and the broader implications of these challenges for NTD programs, as this can help identify gaps and appropriate solutions. Here, a useful framework is use case analysis which is commonly used in diagnostic, pharmaceutical and other industries to define the intended use of a technology or data type, identify key actors and their needs with regards to a solution, and determine the key features and capabilities that solutions will need to fully address the use case (
                <xref ref-type="bibr" rid="ref-5">Hunt, 1999</xref>).</p>
            <p>This paper presents eight priority data use cases for NTD programs targeting lymphatic filariasis, onchocerciasis, schistosomiasis, soil-transmitted helminths, and trachoma. The use cases are designed to provide NTD stakeholders with information to improve the accuracy, completeness and timeliness of NTD data and to understand where new data solutions (digital and non-digital) could improve data-driven decision-making. </p>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <p>Between 2017 and 2018, the Bill &amp; Melinda Gates Foundation (the foundation) partnered with Vital Wave to engage national NTD programs and the global NTD community to define a series of data use cases in MDA campaigns. Development of the use cases arose from four phases of work focused on the data use and data needs of NTD program actors involved in MDA campaigns.</p>
            <p>The first phase of research informed the broader context for NTD program activities and priorities, identifying common data needs and challenges. This phase included literature reviews and semi-structured interviews with 26 international stakeholders including NTD experts, implementing partners, the World Health Organization, donors, and technology experts. The literature review was based on a structured search of the online database PubMed using key MeSH terms related to NTDs and data systems and data use. Grey literature was also sought through abstract searches and internet searches. The international stakeholders were identified at the COR-NTD conference in 2017 and interviews were scheduled either at the meeting or soon afterwards. An interview guide was used and included prompts on a number of key areas for discussion, including the main objectives and activities in completing MDAs, the different types of data sources that each stakeholder type relied on, current challenges or advantages of those data sources, and the different country-level actors engaged in NTD program activities.</p>
            <p>The second phase assessed country-level use of NTD data and focused on further detailing and validating the process and data flow for MDA campaigns in Burkina Faso, Ethiopia, and Tanzania. In-country research conducted in 2017 and early 2018 focused on identifying each data-related step taken by relevant actors responsible for MDA implementation. Research was conducted by Vital Wave in Burkina Faso and Tanzania, while RTI International undertook similar work in Ethiopia. In-person interviews and focus group discussions were conducted with actors at all levels of the health system, including national NTD program managers and data managers, pharmacists at the regional and district level, health workers at the district and facility level, and drug distributors and teachers responsible for administering MDAs in communities and schools. The assessments characterized the main NTD data flows and their bottlenecks as well as root causes and implications of identified bottlenecks. The assessment also identified potential solutions.</p>
            <p>Findings from both the stakeholder interviews and in-country research formed the third phase, an expert strategic convening held in March 2018 and attended by interviewed stakeholders as well as other NTD program experts and technologists active in digital health. The convening was used to refine and validate the findings on critical challenges and priority focus areas, leading to the development of over 20 potential use cases.</p>
            <p>Lastly, a prioritization process informed the selection of use cases, using a phased approach. Through a process of review, discussion, and iteration with the NTD team at the foundation, eight final use cases were selected. Once selected, the use cases were fully developed, with the finalization process including additional review from the foundation team and select stakeholders from the NTD global community at an in-person workshop during the Coalition for Operational Research on NTDs (COR-NTD) meeting in 2018.</p>
            <p>The content of each data use case is comprised of four components: the objective, key actors, critical data challenges, and causal issues. The objective defines the overarching goal of the use case, essentially the &#x201c;desired state&#x201d; that appropriate solutions can help to realize. Key actors are the NTD program team members involved in the use case activities, and the data challenges are the data-related pain points they experience (the &#x201c;current state&#x201d;), which were mapped in a graphical data flow. Causal issues driving the critical challenges are identified, and the enabling environment component most essential to the use case is also defined.</p>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>
                <xref ref-type="fig" rid="f1">Figure 1</xref> presents the flow of data for a typical MDA campaign. The diagram depicts each data-related step and which actors, by health system level, are involved. Identified pain points are noted, representing steps where actors reported that their decision was compromised as a result of data-related challenges. The data flow provides a framework to identify different use cases.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>MDA campaign data flow.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14661/43acf708-0cbc-4f34-a5d6-281434ab20a1_figure1.gif"/>
            </fig>
            <p>The assessments identified common broad themes for data use by NTD programs. First, actors at every level of the health system depend on data to make good decisions but are inhibited by system bottlenecks, including lack of programmatic and technical system integration, an over-stretched and under-capacitated workforce, and limited financial resources. Second, data systems and tools used by NTD programs are limited in their ability to support using high-quality data for real-time decision making because of fragmented, non-interoperable systems that inhibit data sharing and lack visualization and analysis capabilities. Third, priority data sources for NTD programs are fragmented and have compromised data quality and access. Lastly, there are few incentives to use data in decision-making at different levels of NTD programs.</p>
            <p>Four data sources were identified as having the greatest impact on programmatic decision-making: (i) community and treatment registers to record individuals who receive treatment during an MDA; (ii) official census data to estimate population requiring treatment and treatment coverage; (iii) drug ledgers to capture drug inventory before, during, and after MDA throughout the supply chain; and (iv) monitoring and evaluation (M&amp;E) data to record routine MDA data, MDA monitoring data, and epidemiological survey data. While issues with inaccurate and delayed data for treatment registers originate at the community level, this poor data quality inhibits decision-making for NTD actors at all levels of the health system. A lack of acceptable denominator data (based on either census data, community registers, or both) compromises planning and implementation of MDA campaigns and estimating their coverage. NTD drug inventory estimates are often based on the treatment registers as no dedicated and comprehensive system currently exists to track NTD supplies, and there is poor or no integration with national logistics management information systems (LMIS). Finally, though M&amp;E data are usually of high quality, access and use of such data are inhibited by minimal system integrations and lack of feedback loops.</p>
            <p>The articulation of challenges and limitations related to priority data sources and the subsequent expert convening led to the development of 12 use cases, from which eight use cases were prioritized by expert discussion and are shown in 
                <xref ref-type="table" rid="T1">Table 1</xref>. Detailed descriptions of each use are provided elsewhere (
                <xref ref-type="bibr" rid="ref-4">Grubin, 2021</xref>).</p>
            <table-wrap id="T1" orientation="portrait" position="anchor">
                <label>Table 1. </label>
                <caption>
                    <title>Eight prioritized NTD data use cases.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Use Case</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Objective</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Key Actors</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Critical Data Challenges</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Causal Issues</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 1. Improve</bold>
                                <break/>
                                <bold> treatment </bold>
                                <break/>
                                <bold>register data</bold>
                                <break/>
                                <bold> quality</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Enable good decision 
                                <break/>making for stronger NTD 
                                <break/>country programs by
                                <break/> improving the accuracy,
                                <break/>comprehensiveness,
                                <break/> timeliness, access, and use 
                                <break/>of treatment register data.</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Drug 
                                <break/>distributors</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data accuracy
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data timeliness
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Drug distributor
                                <break/> workload</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of appropriate data 
                                <break/>collection tools
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;High volumes of data
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient training and
                                <break/> incentives around data
                                <break/> use
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient or late 
                                <break/>stipend payments
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient funds for
                                <break/> operations</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 2. Strengthen</bold>
                                <break/>
                                <bold> supervision of </bold>
                                <break/>
                                <bold>drug distributors</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Support drug distributors 
                                <break/>in meeting coverage
                                <break/> targets through provision
                                <break/> of consistent training and
                                <break/> supervision</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Supervisors 
                                <break/>of drug
                                <break/> distributors </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data accuracy
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data timeliness
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Drug distributor
                                <break/> workload</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;High volumes of data
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient human
                                <break/> resources at health
                                <break/> facilities
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient training for
                                <break/> supervisors
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient data tools
                                <break/> or systems to support 
                                <break/>supervision</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 3. Generate</bold>
                                <break/>
                                <bold> accurate </bold>
                                <break/>
                                <bold>community-level </bold>
                                <break/>
                                <bold>population data</bold>
                                <break/>
                                <bold> for MDAs</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Determine resources
                                <break/> needed and coverage
                                <break/> rates achieved for 
                                <break/>MDA campaigns by 
                                <break/>providing sufficiently 
                                <break/>accurate community-level 
                                <break/>denominator data</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Drug 
                                <break/>distributors
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;District NTD
                                <break/> officers
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;National NTD 
                                <break/>program team
                                <break/> members</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data accuracy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of financial 
                                <break/>resources
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Dependency on 
                                <break/>data sources of poor 
                                <break/>quality or insufficient
                                <break/> granularity
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of appropriate tools</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 4. Create</bold>
                                <break/>
                                <bold> and manage</bold>
                                <break/>
                                <bold> an accurate</bold>
                                <break/>
                                <bold> inventory of drugs</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Manage drug supply for
                                <break/> successful MDA campaigns 
                                <break/>effectively through 
                                <break/>improved accuracy, 
                                <break/>transparency, and access
                                <break/> to NTD drug supply chain 
                                <break/>data (including reverse 
                                <break/>supply chain) at all levels of 
                                <break/>the health system </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;NTD district
                                <break/> and regional
                                <break/> officer/
                                <break/>pharmacist
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;National NTD
                                <break/> team members</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data accuracy
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Incomplete data
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of access to
                                <break/> data</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;NTD supply chain
                                <break/> managed separately
                                <break/> from national supply
                                <break/> chain
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient funds for 
                                <break/>operations to support
                                <break/> reverse supply chain
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient training for 
                                <break/>data management
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of appropriate data 
                                <break/>collection tools</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 5. Meet district </bold>
                                <break/>
                                <bold>coverage targets</bold>
                                <break/>
                                <bold> during MDA</bold>
                                <break/>
                                <bold> campaigns</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Assess progress towards
                                <break/> coverage targets in
                                <break/> real-time during MDAs, 
                                <break/>including determination
                                <break/> of resources reallocation
                                <break/> or mop-up activities,
                                <break/> through improved access
                                <break/> to sub-district NTD data for 
                                <break/>district NTD officers </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;District NTD
                                <break/> officer</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Cumbersome manual 
                                <break/>processes
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Disparate/siloed
                                <break/> databases and 
                                <break/>systems</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient data tools
                                <break/> and systems for timely
                                <break/> data sharing and
                                <break/> analysis
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of human 
                                <break/>resources at the district
                                <break/> level</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 6. Feedback on</bold>
                                <break/>
                                <bold> performance to</bold>
                                <break/>
                                <bold> sub-district teams</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Create data and
                                <break/> performance feedback
                                <break/> loops to incentivize
                                <break/> data use and improve
                                <break/> implementation at sub-
                                <break/>district level</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Drug 
                                <break/>distributors
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;First-line health 
                                <break/>workers
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;District NTD 
                                <break/>officer</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of access to
                                <break/> data and MDA results
                                <break/> at sub-district levels
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data not used or
                                <break/> valued by sub-district 
                                <break/>actors</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data only flows one way,
                                <break/> limiting access to data at
                                <break/> sub-district levels
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient tools or 
                                <break/>systems to support data 
                                <break/>sharing and feedback
                                <break/> loops
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient training and
                                <break/> incentives around data
                                <break/> use
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of human
                                <break/> resources to support 
                                <break/>robust feedback loops</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 7. Feedback</bold>
                                <break/>
                                <bold> on performance</bold>
                                <break/>
                                <bold> related to </bold>
                                <break/>
                                <bold>monitoring </bold>
                                <break/>
                                <bold>activities and data</bold>
                                <break/>
                                <bold> quality provided</bold>
                                <break/>
                                <bold> to sub-national</bold>
                                <break/>
                                <bold> teams</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Create data and
                                <break/> performance feedback
                                <break/> loops to incentivise
                                <break/> data use and improve 
                                <break/>implementation at sub-
                                <break/>national level</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;District NTD 
                                <break/>Officer
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;National NTD
                                <break/> team</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of access to
                                <break/> data and MDA results
                                <break/> at sub-national levels
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data not used or 
                                <break/>valued by sub-
                                <break/>national actors</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data only flows one way,
                                <break/> limiting access to data at 
                                <break/>sub-national levels
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient tools or
                                <break/> systems to support data
                                <break/> sharing and feedback
                                <break/> loops
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient training and
                                <break/> incentives around data
                                <break/> use
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of human
                                <break/> resources to support
                                <break/> robust feedback loops</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 8. Improved </bold>
                                <break/>
                                <bold>system </bold>
                                <break/>
                                <bold>interoperability</bold>
                                <break/>
                                <bold> for stronger</bold>
                                <break/>
                                <bold> national-level </bold>
                                <break/>
                                <bold>program use </bold>
                                <break/>
                                <bold>of data for </bold>
                                <break/>
                                <bold>evaluation and </bold>
                                <break/>
                                <bold>decision making</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Effective evaluation and 
                                <break/>decision making for 
                                <break/>NTD programs through
                                <break/> improved access to NTD
                                <break/> and relevant HIS data,
                                <break/> including analysis and
                                <break/> visualization capabilities </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;National NTD
                                <break/> team</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Data stored in 
                                <break/>disparate databases
                                <break/> and systems
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Cumbersome manual 
                                <break/>processes
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Systems not
                                <break/> designed for long-
                                <break/>term sustainability to
                                <break/> support surveillance</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Insufficient data analysis 
                                <break/>and visualization tools to
                                <break/> support decision making
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Lack of system
                                <break/> interoperability
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Limited human
                                <break/> resources
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;Limited financial
                                <break/> resources</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>Two of the use cases address treatment registers (improving data collection and strengthening supervision of drug distributors), one looks to strengthen census data with the generation of accurate community-level population data, and one aims to create and manage an accurate drug ledger. The remaining four &#x2013; meeting district coverage targets, ensuring both sub-district and sub-national teams receive feedback on performance, and improving national-level program use of data for evaluation and decision making &#x2013; look to strengthen M&amp;E survey data. The key actors involved in the data activities ranged from national NTD staff through district officers to drug distributors and first-line health workers. The main data challenges faced in each use case included lack of data access, low data accuracy and timelines, and siloed data systems. The causal factors underpinning all eight use cases are, in part, a result of the enabling environment and the maturity of the related components defined by the WHO building blocks of data systems (
                <xref ref-type="bibr" rid="ref-7">WHO, 2010</xref>).</p>
            <p>
                <xref ref-type="table" rid="T2">Table 2</xref> presents the key solution profile for each use case. Improved data access and data quality were key features in many of the solution profiles. Strategies that reduced workload and enabled increased use and analysis of data were also important.  Another theme was supported supervision and use of feedback loops at each level of the data system. Lastly, better integration of data systems within NTD programs and across the health system were also seen as important.</p>
            <table-wrap id="T2" orientation="portrait" position="anchor">
                <label>Table 2. </label>
                <caption>
                    <title>Main solution profiles of the eight use cases.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Use Case</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Solution profile</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 1. Improve treatment</bold>
                                <break/>
                                <bold> register data quality</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Quality</italic>: improve the ability to measure data accuracy and comprehensiveness of 
                                <break/>treatment register data and track them over time with demonstrated improvement;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Transmission Time</italic>: improve timeliness of reporting treatment register data;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Access</italic>: increase access to dis-aggregated treatment register data for use by relevant 
                                <break/>stakeholders during and after an MDA campaign; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Reduced Workload</italic>: streamline the work of data collection and reporting for drug distributors, 
                                <break/>contributing to an overall reduction in workload. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 2. Strengthen supervision </bold>
                                <break/>
                                <bold>of drug distributors</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Adherence</italic>: improve the effectiveness of training campaigns for drug distributors, thereby
                                <break/> improving their adherence to guidelines;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Supportive Supervision</italic>: improve the provision of and access to supervision during an MDA and
                                <break/> the ability to track related differences in drug distributor performance, ensuring targets are
                                <break/> met and community members are not missed during MDA; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Quality</italic>: improve the ability to measure data accuracy and comprehensiveness and to 
                                <break/>track them over time with demonstrated improvement. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 3. Generate accurate</bold>
                                <break/>
                                <bold> community-level population</bold>
                                <break/>
                                <bold> data for MDAs</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Flexibility</italic>: have the ability to work for different actors, across various types of locations and 
                                <break/>working environments, each with potentially different levels of access to technology, power, 
                                <break/>connectivity, etc.;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Access</italic>: increase access to community-level census data for use by relevant stakeholders
                                <break/> before, during, and after MDA campaigns; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Quality</italic>: improve the ability to measure data accuracy and comprehensiveness and to
                                <break/> track them over time with demonstrated improvement;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Alignment</italic>: all in keeping with national systems and other community health programs.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 4. Create and manage an</bold>
                                <break/>
                                <bold> accurate inventory of drugs</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Transparency</italic>: improve oversight for the drug inventory (stock levels, distribution, reallocation 
                                <break/>needs, etc.);
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Transmission Time</italic>: improve timeliness of reporting drug inventory data;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Access</italic>: increase access to the drug ledger data and supply chain data tools for use by relevant 
                                <break/>stakeholders;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Quality</italic>: improve the ability to measure data accuracy and comprehensiveness of drug
                                <break/> ledger data and track them over time with demonstrated improvement; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Integration:</italic> ensure integration to existing LMIS and export into Joint Request for Select 
                                <break/>Medicines (JRSM) and Zithromax applications. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 5. Meet district coverage </bold>
                                <break/>
                                <bold>targets during MDA</bold>
                                <break/>
                                <bold> campaigns</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Transmission Time</italic>: improve the timeliness of reporting aggregate treatment register data to 
                                <break/>the district level;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Access</italic>: increase access to the summary form treatment register data for use by relevant 
                                <break/>stakeholders during the MDA campaign; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Analysis</italic>: have the ability to summarize and quantify data in a simple interface, allowing NTD
                                <break/> District officers to view patterns and totals and use data for decision making. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 6. Feedback on </bold>
                                <break/>
                                <bold>performance to sub-district</bold>
                                <break/>
                                <bold> teams</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Aggregation &amp; Visualization</italic>: aggregate data from disperse data sets and enable users to 
                                <break/>quickly and effectively visualize data and create reports to share information with stakeholders 
                                <break/>at sub-district levels of the health system;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Feedback Loops</italic>: enhance bilateral communication between NTD district, health facility, and
                                <break/> community-level actors, focused on providing feedback and information to project teams at
                                <break/> each level;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Access</italic>: increase access to the data for use by relevant stakeholders; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Use</italic>: include mechanisms and approaches to improving data use at sub-district levels of 
                                <break/>the health system. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 7. Feedback on</bold>
                                <break/>
                                <bold> performance related to</bold>
                                <break/>
                                <bold> monitoring activities and</bold>
                                <break/>
                                <bold> data quality provided to sub-</bold>
                                <break/>
                                <bold>national teams</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Integration:</italic> integrate with national systems and web-based access to promote secure
                                <break/> accessibility by multiple users at different levels of the health system;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Aggregation &amp; Visualization</italic>: aggregate data from disperse data sets and enable users to
                                <break/> quickly and effectively visualize data and create reports to share information with stakeholders
                                <break/> at other levels of the health system;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Feedback Loops</italic>: enhance bilateral communication between the national NTD team and NTD
                                <break/> regional and district teams, focused on providing feedback and information to project teams at 
                                <break/>each level;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Access</italic>: increase access to the data for use by relevant stakeholders; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Use</italic>: include mechanisms and approaches to improving data use at sub-national levels of
                                <break/> the health system. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold># 8. Improved system</bold>
                                <break/>
                                <bold> interoperability for stronger</bold>
                                <break/>
                                <bold> national-level program use</bold>
                                <break/>
                                <bold> of data for evaluation and </bold>
                                <break/>
                                <bold>decision making</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Integration</italic>: import or access data from disparate data sets that may be stored in different
                                <break/> paper or electronic systems (e.g., routine MDA data, drug inventory data, morbidity data,
                                <break/> impact evaluation surveys, non-NTD data sets held in national systems that are relevant to NTD
                                <break/> program management) to facilitate centralized access to these data and improved data use;
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Analysis and Visualization</italic>: enable users to quickly and effectively conduct analysis and
                                <break/> data visualization to enhance data use and support decision making; and
                                <break/>&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x2022;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                                <italic toggle="yes">Data Quality</italic>: improve the ability to measure data accuracy and comprehensiveness and to
                                <break/> track them over time with demonstrated improvement. </td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
        </sec>
        <sec sec-type="discussion">
            <title>Discussion</title>
            <p>These eight use cases illustrate the level of specificity required to understand the needs of NTD program actors making decisions as well as the systematic bottlenecks that prevent the effective use of data. Each use case highlights the parallel existence of system-specific and enabling environment challenges that prevent the ready access to and effective use of data. Effective system design requires focusing on actor needs from the start, including clear articulation of what data will be collected, by whom, how, and for what purpose, in turn ensuring data are usable and being used for decision making. The successful completion of these use cases would result in improved data quality, access, and use for NTD actors across the different levels of the health system.</p>
            <p>The development of any tool or system will need to take local context into account (
                <xref ref-type="bibr" rid="ref-6">Novillo-Ortiz 
                    <italic toggle="yes">et al</italic>., 2018</xref>). For some programs, the introduction of digital solutions where appropriate could bring the most benefit, while for others improving operational processes or streamlining paper-based reporting may bring the most value. Consideration for how the use cases fit together is also critical, as introducing tools to support analysis and visualization are of little value if the data inputs are unreliable or incomplete. The recent COVID-19 pandemic has introduced an additional complexity for introducing data solutions, but there also may be opportunities to leverage some of the data solutions introduced for COVID-19 responses. </p>
            <p>Additionally, the use cases emphasize the value of data systems that are integrated across the different NTDs and with national HIS. Any integrated systems should capture complete, timely, accurate, and disaggregated (at least by location, age, and gender) data, provide tools for data collection and analysis, and enable standardized, online reporting through harmonized data platforms such as the ESPEN Data Portal (
                <xref ref-type="bibr" rid="ref-3">ESPEN, 2020</xref>). An integrated system would avoid disease-specific databases and separate reporting by different stakeholders and donors. An example of an integrated system is presented in 
                <xref ref-type="fig" rid="f2">Figure 2</xref>. Here, administrative units, population, treatments, and morbidity are tracked by the national HIS; drug supplies and inventory are tracked by the LMIS; and epidemiological surveys, treatment coverage surveys, and water, sanitation, and hygiene data are aggregated into a national NTD database. Such a system would allow for data use by different users at multiple levels, thereby minimizing the risk of data divergence across different NTD data systems.</p>
            <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                <label>Figure 2. </label>
                <caption>
                    <title>Illustrative example of an integrated NTD system.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/14661/43acf708-0cbc-4f34-a5d6-281434ab20a1_figure2.gif"/>
            </fig>
            <p>New tools and systems alone will not be sufficient to ensure that data are used effectively by NTD actors in their decision-making and activities. There is a need to strengthen the capacity to analyze and use data at all levels of the NTD program. Part of the solution is to create a culture of data use in the NTD sector. Innovations implemented to date have demonstrated the usefulness of data review sessions to improve the quality of data (
                <xref ref-type="bibr" rid="ref-2">de Souza 
                    <italic toggle="yes">et al.,</italic> 2016</xref>). Each of the use cases presented here provides opportunities to empower NTD programs from district to national levels to use data to inform their decision-making.</p>
            <p>The systematic strengthening of data use for decision-making in NTD programs is key for reaching the 2030 Roadmap goals. Integrated together, the presented use cases, when translated into actions using appropriate and innovative solutions, can help to ensure that accurate and timely data are present at every step of a program and empower countries to use these data to make program decisions.</p>
        </sec>
        <sec>
            <title>Data availability</title>
            <sec>
                <title>Underlying data</title>
                <p>Harvard Dataverse: Improving data use for decision making by neglected tropical disease programs. Detailed description of NTD use cases, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.7910/DVN/SPZGFU">https://doi.org/10.7910/DVN/SPZGFU</ext-link>.</p>
                <p>This project contains the following underlying data:</p>
                <list list-type="bullet">
                    <list-item>
                        <p>Data file 1. (Detailed description of NTD data use cases. (2021-10-22)</p>
                    </list-item>
                </list>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero "No rights reserved" data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgements</title>
            <p>We would like to thank the ministry of health staff in Burkina Faso, Ethiopia and Tanzania for providing informative insight into data use in NTD programs. We also thank individuals who attended the various convenings and meetings.</p>
        </ack>
        <ref-list>
            <ref id="ref-2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>de Souza</surname>
                            <given-names>DK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yirenkyi</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Otchere</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Assessing lymphatic filariasis data quality in endemic communities in Ghana, using the neglected tropical diseases data quality assessment tool for preventive chemotherapy.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Negl Trop Dis.</italic>
</source>
                    <year>2016</year>;<volume>10</volume>(<issue>3</issue>):<fpage>e0004590</fpage>.
                    <pub-id pub-id-type="pmid">27028010</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pntd.0004590</pub-id>
                    <pub-id pub-id-type="pmcid">4814091</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <mixed-citation publication-type="journal">
                    <article-title>ESPEN Portal. </article-title>Accessed 20 May 2020.
                    <ext-link ext-link-type="uri" xlink:href="https://espen.afro.who.int/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Grubin</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Improving data use for decision making by neglected tropical disease programs: eight use cases.</article-title>
                    <source>

                        <italic toggle="yes">Detailed description of NTD data use cases" Harvard Daatverse.</italic>
</source>
                    <year> 2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.7910/DVN/SPZGFU">http://www.doi.org/10.7910/DVN/SPZGFU</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hunt</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>Use Case Analysis.</article-title>In: Java for Practitioners. Practitioner Series. Springer, London;<year> 1999</year>.
                    <pub-id pub-id-type="doi">10.1007/978-1-4471-0843-6_46</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Novillo-Ortiz</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>De F&#x00e1;tima Marin</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Saig&#x00ed;-Rubi&#x00f3;</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>The role of digital health in supporting the achievement of the sustainable development goals (SDGs).</article-title>
                    <source>

                        <italic toggle="yes">Int J Med Inform.</italic>
</source>
                    <year>2018</year>;<volume>114</volume>:<fpage>106</fpage>&#x2013;<lpage>107</lpage>.
                    <pub-id pub-id-type="pmid">29602629</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.ijmedinf.2018.03.011</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-1">
                <mixed-citation publication-type="journal">
                    <collab>The Lancet Global Health</collab>:
                    <article-title>Taking the neglected out of neglected tropical diseases.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Glob Health.</italic>
</source>
                    <year>2020</year>;<volume>8</volume>(<issue>2</issue>):<fpage>e152</fpage>.
                    <pub-id pub-id-type="pmid">31981542</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S2214-109X(19)30529-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <mixed-citation publication-type="journal">
                    <collab>WHO (World Health Organization)</collab>:
                    <article-title>Monitoring the Building Blocks of Health Systems: A Handbook of Indicators and their Measurement Strategies.</article-title>Geneva.<year> 2010</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.who.int/workforcealliance/knowledge/toolkit/26/en/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <mixed-citation publication-type="journal">
                    <collab>WHO (World Health Organization)</collab>:
                    <article-title>Ending the neglect to attain the sustainable development goals: A roadmap for neglected tropical diseases, 2021-2030.</article-title>Geneva,<year> 2020a</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.who.int/publications/i/item/9789240010352">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <mixed-citation publication-type="journal">
                    <collab>WHO (World Health Organization)</collab>:
                    <article-title>Global strategy on digital health 2020-2024.</article-title>World Health Organization. Geneva,<year> 2020b</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://saluddigital.com/wp-content/uploads/2019/09/Draft-Global-Strategy-on-Digital-Health.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report31398">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14661.r31398</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Okoyo</surname>
                        <given-names>Collins</given-names>
                    </name>
                    <xref ref-type="aff" rid="r31398a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-2647-1359</uri>
                </contrib>
                <aff id="r31398a1">
                    <label>1</label>Eastern and Southern Africa Centre of International Parasite Control, Kenya Medical Research Institute (KEMRI), Nairobi, Kenya</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>8</day>
                <month>12</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Okoyo C</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport31398" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13407.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The paper &#x201c;Improving data use for decision making by neglected tropical disease program teams: eight use cases&#x201d; is well presented in general. The authors have discussed the results in a balanced way. Below are some general comments for your consideration. Additional comments are highlighted within the annotated manuscript which can be found 
                <ext-link ext-link-type="uri" xlink:href="https://s3-eu-west-1.amazonaws.com/gatesopenresearch/linked/201728.Inline_review_comments_%28Gates_Open_Research_article_13407_annotated_by_reviewer_Collins_Okoyo%29.pdf">here</ext-link>:</p>
            <p> </p>
            <p> Introduction: 
                <list list-type="bullet">
                    <list-item>
                        <p>State why the eight use cases were only applied to the 5 NTDs (LF, Oncho, SCH, STH and Trachoma) but not other NTDs.</p>
                    </list-item>
                    <list-item>
                        <p>Justify why the focus (data gathering) was made only for three countries (Burkina Faso, Ethiopia and Tanzania) and describe their current disease burden with regards to the 5 NTDs.</p>
                    </list-item>
                </list> Methods: 
                <list list-type="bullet">
                    <list-item>
                        <p>During phase 2 (assessment of country level use of NTD data), how were the participants of interest (program managers, data managers, pharmacists, health workers, drug distributors and teachers) sampled for inclusion in the study?</p>
                    </list-item>
                    <list-item>
                        <p>Please indicate whether the study received ethical approval or if this requirement was waivered.</p>
                    </list-item>
                    <list-item>
                        <p>Please indicate how the qualitative data collected from the participants was managed and analyzed.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Statistics; Data management; Infectious disease epidemiology; Neglected tropical diseases; Public health; Mathematical modeling</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report31399">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14661.r31399</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Gass</surname>
                        <given-names>Katherine M.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r31399a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-2084-8039</uri>
                </contrib>
                <aff id="r31399a1">
                    <label>1</label>Neglected Tropical Disease Support Center, Task Force for Global Health, Decatur, GA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>24</day>
                <month>11</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Gass KM</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport31399" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13407.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This article provides a comprehensive summary of the ways in which NTD programs collect and use data to make decisions. The authors used a series of collaborative processes to engage national NTD programs, implementing partners, and global stakeholders to understand the generation and use of NTD data. This information was used to map the flow of MDA campaign data and led to the identification of broad themes for how NTD programs use data and the data sources that are most pivotal to decision making. A prioritization process was used to determine the top 8 use cases for NTD data, the critical challenge preventing the full realization of these use cases and the causal issues behind the challenges. Finally, a solution profile was generated for each use case, elucidating several cross-cutting themes such as data quality, timeliness, transparency, access, integration, and visualization and analysis.&#x00a0;</p>
            <p> </p>
            <p> This article was well-written, succinct in its presentation and delivers timely information. It is clear that data related challenges are, to varying degrees, holding NTD programs back from making more appropriate, accurate, efficient or timely decisions. I appreciate that this review of data processes covered all aspects of NTD program data (from registers to drug ledgers to M&amp;E data) and involved input from in-country stakeholders at the district and community level. The Figure 1 in this article, which depicts MDA campaign data flow, helps to clarify and illustrate the complexity of NTD data flow and should serve as a useful primer for anyone entering NTD program work.&#x00a0;</p>
            <p> </p>
            <p> My wish for this article is that it can lead to a call to action around concrete steps that NTD programs and their stakeholders can take to relieve these data bottlenecks. The solutions outlined for each use case are helpful in calling out the broad solutions required but lack the specificity needed to implement them locally.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Partly</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>NTD epidemiologist, survey design, monitoring and evaluation</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report31396">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14661.r31396</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>de Souza</surname>
                        <given-names>Dziedzom&#x00a0;K.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r31396a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5000-6177</uri>
                </contrib>
                <aff id="r31396a1">
                    <label>1</label>Department of Parasitology, Noguchi Memorial Institute for Medical Research, University of Ghana, Accra, Ghana</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>15</day>
                <month>11</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 de Souza D</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport31396" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13407.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This paper presents the important description of eight use cases of NTD data to improve the activities and decision making of different stakeholders for the five main PC NTDs. It is very well written. A couple of additional inputs/clarifications will improve it quality.&#x00a0;</p>
            <p> </p>
            <p> Introduction, last paragraph: - Perhaps, it should be indicated that these use cases target the PC NTDs, as the data use cases for CM NTDs might vary.</p>
            <p> </p>
            <p> The list of all the 20 potential use cases identified at the expert strategic convening in 2018 should be provided as a table. They many not be relevant for this paper, but identifying these use cases may enable other actors to act accordingly depending on the local needs.</p>
            <p> </p>
            <p> Were the eight selected use cases a combination of the previous 20 identified? What informed the selection of the eight use cases over others?</p>
            <p> </p>
            <p> Figure 1: I see a potential issue at the health facility level. If the coverage target is not met, drug distribution is usually not done again. The figure makes it seem that is usually the case, but NTD programmes have limited periods within which to conduct the MDA. The tools available (e.g. SCT) to ensure adequate coverage are usually implemented during the MDA.</p>
            <p> Figure 1: Perhaps the different survey options use for the QC/QC procedures (SCT, CES, DQA-S, etc.) and where along the health system they can be implemented should be indicated in the Figure (or a separate figure).</p>
            <p> Figure 1: QA/QC is also done at the regional level.</p>
            <p> Figure 1: It might be useful to include a 6th level (INTERNATIONAL) to reflect the data use by WHO and NTD funding partners. This level also determines the drug requests and funding needs.</p>
            <p> Figure 1: Ideally, QA/QC should also be done at the community level. While the overall data at the district level may balance out and reflect an effective coverage at the district level, individual community level coverages may not be optimal. Further, data inaccuracies at the community level will be aggregated throughout the entire system to the national level. This should also be considered as a solution in Table 2.</p>
            <p> </p>
            <p> A critical use case not identified is the identification of MDA non-compliants (and systematic non-compliants or "Never Treated"). Registers do provide the opportunity to identify such individuals. As one of the critical challenges to MDA, the use of data to address non-compliance levels in a population should be addressed.</p>
            <p> </p>
            <p> Table 2: The time and funding for MDA are two important components that need to be considered/discussed in the challenges and the solutions. It is known that the time to conduct MDA (usually 2 weeks) is a limiting factor for an effective MDA campaign. Funding by partners and reporting timelines also force NTD programmes to restrict activities within a certain time frame. As such the solutions should include extending the timing of activities and not limiting it to the demands of the international donor community.</p>
            <p> </p>
            <p> Discussions: The critical roles of external stakeholders (WHO, funding partners, etc.), and their data needs and uses, must be discussed as this influences activities in the countries.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>No source data required</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Lymphatic filariasis, NTDs</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
</article>
