<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Gates Open Res</journal-id>
            <journal-title-group>
                <journal-title>Gates Open Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2572-4754</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/gatesopenres.13909.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Incentives and disincentives to private sector reporting on family planning in Kenya: 
                    <italic>why these matter, and how they may change over time</italic>
                </article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved, 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Appleford</surname>
                        <given-names>Gabrielle</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-4454-7871</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Mumbia</surname>
                        <given-names>Daniel</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-8384-3534</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Emmart</surname>
                        <given-names>Priya</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Track20, AVENIR, Nairobi, Kenya, Kenya</aff>
                <aff id="a2">
                    <label>2</label>Track20, AVENIR, Glastonbury, Connecticut, USA</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:Gabrielle.aline@gmail.com">Gabrielle.aline@gmail.com</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>5</day>
                <month>10</month>
                <year>2022</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2022</year>
            </pub-date>
            <volume>6</volume>
            <elocation-id>124</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>27</day>
                    <month>9</month>
                    <year>2022</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Appleford G et al.</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://gatesopenresearch.org/articles/6-124/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> This study sought to understand private sector reporting on family planning in Kenya&#x2019;s health information system (KHIS). We approached this through three lenses: governance, procedural and technical. Our study looked at these areas of interest in Kenya, complemented by deeper exploration in Nairobi County.</p>
                <p>
                    <bold>Methods:</bold>The study used mixed methods drawing on analysis from the KHIS and surveys, complemented by desk review. The qualitative research entailed group discussions with public sector personnel while more in-depth qualitative interviews were done with public and private sector respondents. A framework matrix was developed for the qualitative analysis. The study was approved by the Ministry of Health in March 2022 and conducted over the period March - May 2022. </p>
                <p>
                    <bold>Results:</bold>From a governance lens, private sector respondents recognised the importance of registry and reporting as a government policy requirement. From a procedural lens, private sector respondents saw reporting procedures as duplicative and parallel processes as reports are not generated through digitised information systems. From a technical lens, private sector reporting rates have improved over time however other data quality issues remain, which include over- and under-reporting of family planning services into KHIS. Secondary analysis for Nairobi County shows that the private facility contribution to family planning has declined over time while family planning access through pharmacies have grown over the same period; there is no visibility on this shift within the KHIS. Changes in private sector family service provision have implications for assumptions underpinning modern contraceptive modelled estimates and programmatic decision-making.</p>
                <p>
                    <bold>Conclusions:</bold> There is limited monitoring of the incentives and disincentives for reporting by private health facilities into the KHIS. These have changed over time and place. Sustained private sector engagement is important to align incentives for reporting as is greater visibility on the role of pharmacies in family planning.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Health information policy</kwd>
                <kwd>private sector</kwd>
                <kwd>family planning</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>Gates Foundation</funding-source>
                    <award-id>INV-007530</award-id>
                </award-group>
                <funding-statement>This work was supported by the Gates Foundation [INV-007530].</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>Like many other lower- and middle-income countries (LMICs), Kenya has a pluralist health system in which a mix of public and private entities deliver health related goods and services. Within the health sector, interactions between public and private entities are intended to improve health system performance in line with policies established by government. Data and information are foundational to interaction and performance. However too often data and information are incomplete making them unreliable for performance monitoring.</p>
            <p>This study sought to understand private sector reporting on family planning in Kenya&#x2019;s health information system (KHIS). We approached this through three lenses: governance, procedural and technical. Specifically, we were interested in exploring:</p>
            <list list-type="bullet">
                <list-item>
                    <p>Governance: What are the reporting incentives and disincentives for private sector entities delivering family planning services? Have these changed over time?</p>
                </list-item>
                <list-item>
                    <p>Procedural: How do private sector entities report into the KHIS? Are there concerns with the quality of reporting? Has this changed over time?</p>
                </list-item>
                <list-item>
                    <p>Technical: What is the contribution of the private sector to family planning? What are the assumptions underpinning adjustments in modelled estimates of contraceptive prevalence? Do these remain valid? </p>
                </list-item>
            </list>
            <p>Our study looked broadly at these areas of interest in Kenya, complemented by a deeper exploration in Nairobi County.</p>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <sec>
                <title>Ethics and consent</title>
                <p>The study was approved by the Ministry of Health (MoH), Office of the Director General in March 2022 (reference MoH/ADM/1/1/82 (182)) and conducted over the period March - May 2022. Informed verbal consent was sought for the interviews as the nature of the inquiry presented minimal risk to participants. Respondents&#x2019; information was anonymised as part of data analysis and presentation of findings. Quotations are referenced as county respondent, non-government respondent and private sector respondent respectively.</p>
            </sec>
            <sec>
                <title>Design</title>
                <p>This study used a mixed methods approach drawing on analysis from the KHIS and population-based surveys, complemented by qualitative research. The qualitative research entailed group discussions with county health teams in seven counties. More in-depth qualitative interviews were done in Nairobi County with public and private sector respondents. A literature review as not conducted as part of this study however background articles relevant to the context have been referenced in the paper.</p>
            </sec>
            <sec>
                <title>Health information systems and population-based surveys</title>
                <p>Data on reporting rates by sector were extracted from the KHIS. Data on facilities by ownership were extracted from the Kenya Health Master Facilities List (KHMFL). Secondary data analysis was conducted for the 2014 Demographic and Health Survey (DHS) and 2016, 2017, 2018, 2019, and 2020 Performance Monitoring for Action (PMA) surveys. For women who were using a modern method and residing in Nairobi, weighted distributions were created of the source of modern methods of family planning (in total and by method) for each survey.  Results are limited to methods with 25 (unweighted) observations.</p>
            </sec>
            <sec>
                <title>Group discussion and individual interviews</title>
                <p>Group discussions were conducted in seven counties (Laikipia, Nyandarua, Isiolo, Mombasa, Meru, West Pokot, Nakuru) with reproductive health coordinators and health records and information officers (HRIOs). These were done in person as part of a Track20/MoH family planning training activity. This was a scheduled 30-minute discussion in the training and entailed 15&#x2013;20 participants per group per county (approximately 120 participants). Discussions were used to verify county health team perceptions of the growth of the private sector and conformity with reporting requirements in their context. Counties represented diverse geographic and demographic contexts. In-depth interviews were conducted with reproductive health coordinators and/or HRIOs from four of Nairobi&#x2019;s 17 sub-counties, managers from two international family planning organisations, and three private providers, affiliated with one of the family planning organisations, through social franchising. The four Nairobi sub-counties were selected based on contextual factors, such as the presence of large informal settlements and family planning organisations. Selection of sub-county and non-governmental respondents was done in conjunction with the Nairobi Reproductive Health Coordinator. Private sector respondents were identified by the family planning organisation. In total, 11 respondents were interviewed.</p>
                <p>Group discussions were led by the second author with the primary author participating in three county group discussions to test the guide and as part of quality assurance. The in-depth interviews were conducted by both the primary and secondary authors. Respondents were given the option of an in-person or remote interview using an online meeting application. All those that provided consent to be interviewed, opted for an online interview citing convenience as the reason. Verbal consent was obtained for the discussions and interviews. Interviews were audio recorded.</p>
            </sec>
            <sec>
                <title>Analysis</title>
                <p>Detailed notes were prepared for both the group discussions and in-depth interviews by the primary and secondary authors. A coding frame was developed for data extraction, based on the semi-structured group discussion and interview guides. Key themes analysed were the public-private mix of health entities; volumes of family planning services in the private sector; private sector reporting trends; data quality and procedural issues with reporting; use of family planning data, as well as insights or recommendations on how to improve private sector reporting.</p>
                <p>Information from the discussions and interviews was triangulated with MoH information systems and was done by the second author. For example, county respondent views on growth of the private sector were triangulated through the KHIS and KHMFL, while volumes of family planning services offered through the private sector were verified through the KHIS. The KHIS provided information on trends over time (a five-year horizon is available) however the KHMFL does not allow for year-on-year comparison in health facility composition and growth. Secondary data analysis using population-based surveys explored the extent and changes in the use of private sector entities by family planning method over time in Nairobi County. This was done by a Track20 expert (see acknowledgements) to provide information on the contribution of private pharmacies to family planning volumes, given that this is not captured in MoH information systems.</p>
                <p>A framework matrix was developed by the primary author for the analysis using Microsoft Excel 2016. The matrix was constructed horizontally with the key themes and vertically by respondent. Group discussion and interview notes were condensed, with information arising from data sources inserted into the matrix. Quotes from the detailed notes were inserted as part of data extraction. Where needed, the primary and secondary authors compared notes and understandings to ensure completeness of information and consistency of interpretation. The completed framework matrix was reviewed by all authors. The primary author drafted the paper, and the other two authors reviewed the drafts and final manuscripts.</p>
            </sec>
            <sec>
                <title>Research team and reflexivity</title>
                <p>The primary author is a public health specialist with extensive contextual experience, subject matter expertise and qualitative research skills. She is a contracted Track20 consultant based in Nairobi, Kenya. The second author is a Monitoring and Evaluation Officer (MEO) with the Track20 project seconded to the MoH health informatics division, and is based in Nairobi, Kenya. He has contextual experience, and an advanced degree in health informatics. The third author is the Deputy Director of the Track20 project and has extensive expertise in monitoring and evaluation and mixed methods. </p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <sec>
                <title>Governance</title>
                <p>
                    <bold>
                        <italic toggle="yes">What are the reporting incentives and disincentives for private sector entities delivering family planning services? Have these changed over time?</italic>
                    </bold>
                </p>
                <p>
                    <boxed-text content-type="website" orientation="portrait" position="float">
                        <caption>
                            <title>&#x00a0;</title>
                        </caption>
                        <p>
                            <italic toggle="yes">Summary</italic>
                        </p>
                        <p>Private sector respondents recognised the importance of registry and reporting as a Government of Kenya policy requirement</p>
                        <p>Public sector respondents indicated that most health facilities in their counties comply with registry and reporting requirements</p>
                        <p>Public and private sector respondents recognised the limited visibility of pharmacies to family planning services as these entities do not report into the KHIS</p>
                    </boxed-text>
</p>
                <p>There has been substantial growth in both the public and private sectors over time (
                    <xref ref-type="table" rid="T1">Table 1</xref>) however, this has not kept pace with population growth. Coverage of health facilities remains inadequate and uneven &#x2013; at its extremes, Nairobi County contains just over 10% of all health facilities, while Isiolo County in the arid lands of northern Kenya has 0.5%
                    <sup>
                        <xref ref-type="bibr" rid="ref-1">1</xref>
                    </sup>. The health sector as a whole is characterized as one of increasing demand for health care alongside under resourcing, underdeveloped infrastructure, shortages in human resources for health, and essential drugs and medical supplies with significant variation across the country
                    <sup>
                        <xref ref-type="bibr" rid="ref-2">2</xref>
                    </sup>.</p>
                <table-wrap id="T1" orientation="portrait" position="anchor">
                    <label>Table 1. </label>
                    <caption>
                        <title>Facility distribution by ownership (Source: KMHFL).</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="center" colspan="1" rowspan="1" valign="top">Year</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Private (for-profit)</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Private (faith-based)</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Total Private</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Total Public</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="top">2006</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2217</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">792</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3009</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2120</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="top">2013</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3500</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1053</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">4553</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3965</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="top">2022</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">6004</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">1140</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7144</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">7204</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="top">% growth over time</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">63%</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">30%</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">58%</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">71%</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>Devolution, which commenced in 2013, transferred responsibility for service delivery to Kenya&#x2019;s 47 counties. As part of devolution, the majority of Kenya&#x2019;s public health facilities and stewardship (oversight) of private facilities was transferred to county departments of health (CDoH). The national MoH retains the roles of health policy and standards formulation, pre-service training for health workers, and management of national referral services as part of health governance
                    <sup>
                        <xref ref-type="bibr" rid="ref-3">3</xref>
                    </sup>. This includes information and data architecture through the KHIS as well as a digital registry of all health facilities in the KMHFL.</p>
                <p>Kenya&#x2019;s health policy 2014&#x2013; 2030 aims to strengthen the KHIS for complete and timely reporting of all health-related events, including family planning. The Health Act 2017 and KHIS policy directs all private sector entities to mandatorily submit their data to the MoH, through the CDoH. The Health Act also requires that all private facilities are licensed and registered. This includes inspection, geo-referencing, and registry in the KMHFL. Across counties, respondents indicated that the majority of private health facilities are registered and included within the KMHFL.</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>
                            <italic toggle="yes">&#x201c;We have more facilities that what is in the KMHFL, some which are dormant and not reporting but 75% are reporting. New facilities always come to us for mapping i.e., KMHFL&#x2026;some, months are busy, we get five facilities while others are quiet.&#x201d;</italic> (County respondent)</p>
                    </list-item>
                </list>
                <p>Most county respondents indicated that the number of private sector entities had grown over time. Growth has been uneven across counties and more pronounced in urban counties, such as Nairobi and Mombasa where the private sector accounts for 75% and 74% of all health facilities. There was also reportedly substantial growth in private pharmacies, however data and information are lacking as they do not report into the KHIS while only some are registered in the KMHFL.</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>
                            <italic toggle="yes">&#x201c;We had a partner who came through national level. We tried to incorporate some chemists [pharmacies] in our system. It was not possible for them to report. Our mothers are still going there for family planning services.&#x201d;</italic> (County respondent)</p>
                    </list-item>
                </list>
                <p>There was reported to be a visible shift to more &#x201c;modernized&#x201d; private health entities, including franchise chains, alongside more traditional small-to-medium (SME) clinics and nursing homes. Modernisation of the sector was attributed to population demand and improved access, through facility accreditation in universal health care (UHC) schemes, such as the National Health Insurance Fund (NHIF). As part of modernisation in the sector, there was reported to be an increase in the use of digitized information systems and reporting within private sector entities, particularly in urban counties.</p>
                <p>
                    <italic toggle="yes">&#x201c;There is a trend towards modernisation within private facilities and digitised reporting is a requirement of the NHIF and private insurers.&#x201d;</italic> (Non-governmental respondent)</p>
            </sec>
            <sec>
                <title>Procedural</title>
                <p>
                    <bold>
                        <italic toggle="yes">How do private sector entities report into the KHIS? Are there concerns with the quality of reporting? Has this changed over time?</italic>
                    </bold>
                </p>
                <p>
                    <boxed-text content-type="website" orientation="portrait" position="float">
                        <caption>
                            <title>&#x00a0;</title>
                        </caption>
                        <p>
                            <italic toggle="yes">Summary</italic>
                        </p>
                        <p>Monthly reporting into the KHIS is manual using paper-based tools, submitted in-person to the sub-county by private and public sector entities</p>
                        <p>Private sector respondents saw current procedures as duplicative and parallel processes as reports are not generated through digitised information systems</p>
                        <p>Submission of reports provides opportunity to access routine vaccines and family planning commodities however family planning supply is often limited to short-term methods and disrupted due to stock outs</p>
                        <p>Paper-based reporting formats are seen as necessary for data quality audits and a check against data manipulation</p>
                    </boxed-text>
</p>
                <p>Private entities, along with their public facility counterparts, are expected to produce and submit in-person monthly reports as well as maintain the MoH 512 register, where all client visit details are recorded. The MoH 512 register is the data source for the reports: family planning visits are tallied in the MoH 711 report while commodities distributed to clients are tallied into the MoH 747A Facility Contraceptive Consumption Data Report and Request (FCDRR).</p>
                <list list-type="bullet">
                    <list-item>
                        <p>
                            <bold>MoH 711 Integrated Summary Report Form: reproductive and child health, medical and rehabilitative services</bold>. There are 11 service areas and 157 data elements contained within the form. For family planning, data elements include services offered to clients, including type of contraceptive received, whether it was a new visit or a follow-up visit, whether the service was post-partum or post-abortion as well as information on client age.</p>
                    </list-item>
                </list>
                <list list-type="bullet">
                    <list-item>
                        <p>
                            <bold>MoH 747A FCDRR</bold>. This tool collects information on commodities by method&#x2014;combined oral contraceptive pills, progestin-only pills, injectables, implants (1-Rod), implants (2-Rod), emergency contraceptive pills, IUCDs, male condoms, female condoms, cycle beads, and others.</p>
                    </list-item>
                </list>
                <p>Digitised information systems within private entities have not facilitated reporting into the KHIS, the generation of MoH monthly reports or maintenance of paper-based registers. Private sector respondents saw manual reporting as duplicative and parallel processes to their digitised systems. For their part, public sector respondents viewed paper-based reporting formats as necessary for data quality audits and a check against data manipulation. There are no immediate plans to replace paper-based reports with electronic reports although there is longer-term work on a national client medical records (CMR) system. There is also a small pilot with a subset of health facilities with CMR directly linked to the KHIS.</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>
                            <italic toggle="yes">&#x201c;Reporting is done manually in the 711 and FCDRR; this is then hand-carried to the sub-county HRIO. Providers complain about the time required for reporting, including the need to wait at the sub-county to submit the reports to the HRIOs and collect commodities&#x2026;this can be a 1&#x2013;3 hour wait.&#x201d;</italic> (Non-governmental respondent)</p>
                    </list-item>
                </list>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>
                            <italic toggle="yes">&#x201c;The manual system&#x2026;the entire process is slow. I have to do double, fill in the manual forms from our computerized system.&#x201d;</italic> (Private sector respondent)</p>
                    </list-item>
                </list>
                <p>Availability of the registers and reporting forms is a challenge in counties, which often lack adequate tools for facilities (both public and private). Updates to the register and reports to cater for additional reporting elements was undertaken in late 2020 but many facilities are not using these. 
                    <italic toggle="yes">&#x201c;Now we do not have 711 tools even a copy&#x2026;since August [2021] we have not had 711.&#x201d;</italic> (County respondent). In some instances, private facilities are advised to make photocopies of the forms using their own resources which further acts as a disincentive for reporting.</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>
                            <italic toggle="yes">&#x201c;It&#x2019;s a cumbersome way of doing it [reporting]&#x2026;paperwork can have many errors. It&#x2019;s not easy to correct errors you have made. If the HRIO notices any error during reporting, you have to go back to the facility, write again and take it on different day.&#x201d;</italic> (Private sector respondent)</p>
                    </list-item>
                </list>
                <p>Sub-county HRIO have the mandate to give access rights to private sector entities for reporting directly into the KHIS. For a facility to be given access rights, staff capacity must be vetted by the sub-county HRIO. In practice, access rights appear to be granted in very few cases, including for monitoring officers in international non-governmental family planning organisations. This also means that entities reporting into KHIS cannot verify that their facility data has been correctly captured in the system. In some instances, it may not be captured at all. One facility indicated that three years of 711 reports (2016&#x2013;2019) had not been captured in KHIS. This came to light during a training facilitated by the national KHIS team, after which access rights were subsequently granted to the private entity. This appears to be a rare occurrence, however, and may be due to a lack of procedural clarity. There is also a disincentive to pursue access rights as this does not negate the need for physical submission of hard-copy reports.</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>
                            <italic toggle="yes">&#x201c;We do not have access to KHIS system. I can only do manual analysis since I do not have access to the system. I am not able to confirm what I report is captured in DHIS2 [KHIS]. I was given information on how to get access [KHIS] but I did not proceed to follow up since they only insist on sending hard copies.&#x201d;</italic> (Private sector respondent)</p>
                    </list-item>
                </list>
                <p>When reports are submitted, private health entities, through their facility-in-charge or designate, can access family planning commodities and vaccines for routine immunisation. These products are distributed through the Kenya Medical Supplies Authority (KEMSA), the government body responsible for procurement, warehousing and distribution of medical supplies and commodities to county and sub-county stores. This provision requires that the private health entity is included in the KMHFL, complies with reporting requirements, and there is &#x2018;excess&#x2019; commodity availability beyond what is required in the public sector. There is no visibility at national level on the amount of family planning commodities accessed by private sector providers through sub-county stores as these, along with vaccines, are issued by sub-county RH Coordinators. However, private sector respondents indicated that family planning commodities were increasingly unavailable and were limited to short-term methods suggesting that this reporting incentive was more diluted than it may have been in the past.</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>
                            <italic toggle="yes">&#x201c;We used to get commodities from the government. It was based on our consumption data. Since COVID-19, we have not received any commodities.&#x201d;</italic> (Private sector respondent)</p>
                    </list-item>
                </list>
            </sec>
            <sec>
                <title>Technical</title>
                <p>
                    <bold>
                        <italic toggle="yes">What is the contribution of the private sector to family planning? What are the assumptions underpinning adjustments in modelled estimates of contraceptive prevalence? Do these remain valid? </italic>
                    </bold>
                </p>
                <p>
                    <boxed-text content-type="website" orientation="portrait" position="float">
                        <caption>
                            <title>&#x00a0;</title>
                        </caption>
                        <p>
                            <italic toggle="yes">Summary</italic>
                        </p>
                        <p>Despite procedural challenges, private sector reporting rates have improved over time however other data quality issues remain</p>
                        <p>Family planning services have not kept pace with the growth of private sector entities or their integration within government UHC schemes which may incentivise service provision through pharmacies</p>
                        <p>Secondary analysis for Nairobi County shows that the private facility contribution to family planning has declined over time while family planning access through pharmacies have grown over the same period; there is no visibility on this shift within the KHIS</p>
                        <p>Changes in private sector family service provision have implications for assumptions underpinning modern contraceptive modelled estimates and programmatic decision-making</p>
                    </boxed-text>
</p>
                <p>Despite procedural challenges, private sector reporting rates have improved over time (
                    <xref ref-type="fig" rid="f1">Figure 1</xref> and 
                    <xref ref-type="fig" rid="f2">Figure 2</xref>). Improvements have been more pronounced in the MOH 711 as private facilities tend to complete the FCDRR only for the months when they received commodities from county depots. Within the MoH 711 there is more attention to data for maternal and child health (MCH), such as ANC and skilled delivery, as these services receive more scrutiny and attention.</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>FCDRR reporting rates by sector (faith-based, public and private).</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/15202/cb3e44d0-3e60-44ce-b71d-4cb2c2d03771_figure1.gif"/>
                </fig>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>MoH 711 reporting rates by sector (faith-based, public and private).</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/15202/cb3e44d0-3e60-44ce-b71d-4cb2c2d03771_figure2.gif"/>
                </fig>
                <p>While private sector reporting rates have improved over time, other data quality issues remain. As some respondents indicated, incentives also exist for both over- and under-reporting family planning services. For example, commodity supply is based on the previous month&#x2019;s consumption and may be inflated to gain more supply. Conversely, some providers may prefer to underreport so that family planning services remain modest and don&#x2019;t attract attention (this may be in contexts where services are being provided to adolescents, given the current wave of conservatism and unclear communication from the MoH on adolescent access). For these and other reasons, data completeness and quality remain issues for family planning. While not specific to the private sector reporting, data quality has affected the ability to use family planning service statistics in the KHIS for modelled estimates of family planning. The private sector adjustment is not tied to reporting rates but assumes that if reporting is not 100%, then it is partial and equal to 50%. The question is whether this assumption is reasonable in general or is a different adjustment for urban counties needed where the private sector has a bigger impact on volumes.</p>
                <p>Changes in private sector family planning services is supported by secondary analysis for Nairobi County (
                    <xref ref-type="fig" rid="f3">Figure 3</xref>). This shows that the private facility contribution to family planning has declined over time. In contrast, services provided through pharmacies have grown over the same period. Pharmacy services are not captured in service statistics through the KHIS. There have been no concerted government-directed efforts in place to address the pharmacy governance gap for family planning
                    <sup>
                        <xref ref-type="bibr" rid="ref-4">4</xref>
                    </sup>.</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Trends in private sector family planning for Nairobi County.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://gatesopenresearch-files.f1000.com/manuscripts/15202/cb3e44d0-3e60-44ce-b71d-4cb2c2d03771_figure3.gif"/>
                </fig>
                <p>Changes in private sector family service provision have implications for the assumptions underpinning mCPR modelled estimates. Gaps in understanding private sector contribution &#x2013; both facility- and pharmacy-based &#x2013; also have implications for programmatic decision-making. Accurate information is a powerful tool at both the county and national level when identifying and generating targets, allocating resources, and measuring performance. For instance, family planning forecasting and quantification in Kenya is based on consumption data yet it&#x2019;s not clear how much the private sector is contributing to average monthly consumption.  Furthermore, counties provide commodities to some private health facilities, but this is not accurately reflected in the national logistics information system.</p>
                <p>Changes in private sector family planning services have not kept pace with the growth of the private health sector or their integration within government UHC schemes. While family planning services are included in Kenya&#x2019;s essential health care package, this has not guided the development of NHIF packages or offer of family planning in practice through private health facilities
                    <sup>
                        <xref ref-type="bibr" rid="ref-5">5</xref>,
                        <xref ref-type="bibr" rid="ref-6">6</xref>
                    </sup>. In contrast, the contribution of pharmacies to family planning has grown &#x2013; particularly during the COVID-19 pandemic &#x2013; but with limited visibility in terms of contraceptive products, sources, quality, or volumes sold. A previous study noted the range of family planning products provided through pharmacies as including combined oral contraceptives, injectables, patches, spermicides and emergency contraception
                    <sup>
                        <xref ref-type="bibr" rid="ref-4">4</xref>
                    </sup>. This study attempted to support private pharmacies in Nairobi to report into the KHIS but struggled with pharmacy interest and sustained engagement.</p>
            </sec>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusion</title>
            <p>There is limited monitoring of the incentives and disincentives for reporting by private health facilities into the KHIS. These have changed over time and place and are summarised in 
                <xref ref-type="table" rid="T2">Table 2</xref>. </p>
            <table-wrap id="T2" orientation="portrait" position="anchor">
                <label>Table 2. </label>
                <caption>
                    <title>Summary of incentives and disincentives for private sector reporting into the KHIS (KHIS = Kenya Health Information System; NHIF = National Hospital Insurance Fund).</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Incentives</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Disincentives</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Recognition and respect for registry and reporting as a 
                                <break/>Government of Kenya policy requirement
                                <break/>Accreditation within the NHIF and other insurance schemes
                                <break/>Access to family planning commodities as part of 
                                <break/>submission of monthly reports </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Lack of registers and reporting forms
                                <break/>Manual entry of data and physical presentation of reports
                                <break/>Lack of private entity visibility of facility data capture in the KHIS
                                <break/>Maintenance of parallel systems, manual and digitised, within 
                                <break/>private facilities
                                <break/>Family planning commodity stock outs </td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>The study highlights the importance of routine monitoring and qualitative research methodologies as a complementary information source to data and information generated through the KHIS. Combined, these allow for richer understanding of &#x201c;what we don&#x2019;t know about private sector reporting&#x201d;. Findings suggest that sustained private sector engagement is important to align incentives for reporting into the KHIS. Greater visibility on the role of pharmacies in family planning is further suggested. While pharmacies have been promoted as part of self-care, there is little visibility into the quality of products and services or the role that commodity stock outs in public and private health facilities play in increased client volumes through this channel. Respondents, both public and private, expressed concerns about the quality of services provided through pharmacies and chemists, in particular, in relation to the administration of injectables.</p>
        </sec>
        <sec>
            <title>Recommendations</title>
            <p>Recommendations have been formulated for the Kenya MoH but may be applicable in other settings.</p>
            <p>Clarify reporting of commodities on FCDRR with the intention of balancing this with client visits reported on the MoH 711. The FCDRR allows for reporting of all sources of commodities, not only those provided through KEMSA, and could provide useful information on private sector access to commodities, through KEMSA and the open market.</p>
            <p>Consider the cost-benefit of paperless reporting into the KHIS by adopting digital versions of the MoH 711 and the FCDRR reporting forms. While these forms are seen as providing a paper trail for audit purposes, other means of verification could be adopted. In addition to being a &#x2018;greener&#x2019; option, it is also more efficient. </p>
            <p>Gain greater insights into the provision of family planning through the pharmacies to understand the quality and volume of services and products offered through this channel. Additionally, explore the sources of private health facility commodities on the open market.  This intelligence would help with forecasting and allocating scarce family planning resources as well as understand movement of commodities between the public and private sectors.</p>
        </sec>
    </body>
    <back>
        <sec sec-type="data-availability">
            <title>Data availability</title>
            <sec>
                <title>Underlying data</title>
                <p>This study uses secondary data from the Demographic and Health Surveys and Performance Monitoring for Action which provide anonymized data to researchers.</p>
                <p>The Demographic and Health Surveys are available from 
                    <ext-link ext-link-type="uri" xlink:href="https://dhsprogram.com/">https://dhsprogram.com/</ext-link> at no cost for academic research. Users must register to request and download dataset at 
                    <ext-link ext-link-type="uri" xlink:href="https://dhsprogram.com/data/new-user-registration.cfm">https://dhsprogram.com/data/new-user-registration.cfm</ext-link>. After approval, datasets can be downloaded from 
                    <ext-link ext-link-type="uri" xlink:href="https://dhsprogram.com/data/Using-Datasets-for-Analysis.cfm">https://dhsprogram.com/data/Using-Datasets-for-Analysis.cfm</ext-link>.  Datasets are available as SAS, Stata, SPSS, and Flat Ascii files.</p>
                <p>The Performance Monitoring for Action surveys are available from 
                    <ext-link ext-link-type="uri" xlink:href="https://www.pmadata.org/">https://www.pmadata.org/</ext-link> at no cost for academic research. Users must register to request and download dataset at 
                    <ext-link ext-link-type="uri" xlink:href="https://www.pmadata.org/data/request-access-datasets">https://www.pmadata.org/data/request-access-datasets</ext-link>. Datasets are available as Stata files.</p>
                <p>Kenya Health Information System (log-in credentials required) 
                    <ext-link ext-link-type="uri" xlink:href="https://hiskenya.org/">https://hiskenya.org/</ext-link>
                </p>
                <p>1. Click the &#x201c;data visualizer app&#x201d; in the menu APP</p>
                <p>2. Select dimensions i.e. Data, Period, Organization unit and Facility Ownership</p>
                <p>Data type: select &#x201c;Data sets&#x201d;, select &#x201c;Reporting rates&#x201d;</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>Search and select &#x201c;MOH 747A_Facility Contraceptives Consumption Report and Request Form Reporting rate Revised Private (2018) 2020&#x201d;</p>
                    </list-item>
                </list>
                <p>Period: Click &#x201c;fixed period&#x201d;, select &#x201c;2015, 2016, 2017, 2018, 2019, 2020 and 2021&#x201d;</p>
                <p>Organization Unit: Click &#x201c;Organization Unit&#x201d; and select &#x201c;Kenya&#x201d;</p>
                <p>Facility Ownership: Click &#x201c;Facility Ownership&#x201d; and select &#x201c;Revised faith based organization (2018), revised Ministry of Health (2018), Revised private (2018)&#x201d;</p>
                <p>3. Click &#x201c;Update&#x201d;</p>
                <p>4. Click &#x201c;Options&#x201d; then &#x201c;Styles&#x201d; to name title and axes</p>
                <p>5. Click &#x201c;Save&#x201d; and Download&#x201d; to save the chart in the computer.</p>
                <p>Generating Reporting Rates Family Planning Visits </p>
                <p>Access to Kenya Health Information System Aggregate (log-in credentials required) 
                    <ext-link ext-link-type="uri" xlink:href="https://hiskenya.org/">https://hiskenya.org/</ext-link>
                </p>
                <p>1. Click the &#x201c;data visualizer app&#x201d; in the menu APP</p>
                <p>2. Select dimensions i.e. Data, Period, Organization unit and Facility Ownership</p>
                <p>Data type: select &#x201c;Data sets&#x201d;, select &#x201c;Reporting rates&#x201d;</p>
                <list list-type="bullet">
                    <list-item>
                        <label/>
                        <p>Search and select &#x201c;MOH 711 Integrated Summary Report: Reproductive &amp; Child Health, Medical &amp; Rehabilitation Services Rev 2020  Reporting rate Revised Private(2018) &#x201c;</p>
                    </list-item>
                </list>
                <p>Period: Click &#x201c;fixed period&#x201d;, select &#x201c;2015, 2016, 2017, 2018, 2019, 2020 and 2021&#x201d;</p>
                <p>Organization Unit: Click &#x201c;Organization Unit&#x201d; and select &#x201c;Kenya&#x201d;</p>
                <p>Facility Ownership: Click &#x201c;Facility Ownership&#x201d; and select &#x201c;Revised faith based organization (2018), revised Ministry of Health (2018), Revised private (2018)&#x201d;</p>
                <p>3. Click &#x201c;Update&#x201d;</p>
                <p>4. Click &#x201c;Options&#x201d; then &#x201c;Styles&#x201d; to name title and axes</p>
                <p>5. Click &#x201c;Save&#x201d; and Download&#x201d; to save the chart in the computer.</p>
                <p>For the qualitative research, detailed notes have not been made publicly available as there is the possibility that they would identify respondents. Please contact Gabrielle Appleford on 
                    <email xlink:href="mailto:gabrielle.aline@gmail.com">gabrielle.aline@gmail.com</email> for access.</p>
            </sec>
            <sec>
                <title>Extended data</title>
                <p>figshare: Private sector guides.docx. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.6084/m9.figshare.21201193.v1">https://doi.org/10.6084/m9.figshare.21201193.v1</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-7">7</xref>
                    </sup>
                </p>
                <p>This project contains the interview guide.</p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            </sec>
        </sec>
        <sec>
            <title>Software availability</title>
            <p>Source code available from: 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/Track20/NairobiPrivateSectorFPProvision">https://github.com/Track20/NairobiPrivateSectorFPProvision</ext-link>.</p>
            <p>Archived DOI at time of publication: 
                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.7086477">https://doi.org/10.5281/zenodo.7086477</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-8">8</xref>
                </sup>.</p>
            <p>Zenodo: V1Track20/NairobiPrivateSectorFPProvision: Release 091622 (Track20, 2022).</p>
            <p>This project contains the following files:</p>
            <list list-type="bullet">
                <list-item>
                    <p>Kenya Nairobi Method Source 091622.R</p>
                </list-item>
                <list-item>
                    <p>LICENSE</p>
                </list-item>
                <list-item>
                    <p>README.md</p>
                </list-item>
            </list>
            <p>Code is available under an MIT license.</p>
        </sec>
        <ack>
            <title>Acknowledgments</title>
            <p>We wish to acknowledge public and private sector respondents who provided insights to this study. We further wish to acknowledge Kristin Bietsch of Avenir Health for her support with the secondary data analysis. </p>
        </ack>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <collab>Government of Kenya, Ministry of Health</collab>:
                    <article-title>Kenya Service Availability and Readiness Assessment Mapping (SARAM).</article-title>Ministry of Health, Nairobi, Kenya,<year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://visualdata.co.ke/projects/doctorabsenteeism/data/SARAM_report.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <collab>Government of Kenya, Ministry of Health</collab>:
                    <article-title>Kenya Draft Health Financing Strategy, Report of an External Review.</article-title>Commissioned by the Ministry of Medical Services, Nairobi, Kenya,<year>2012</year>.</mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tsofa</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Molyneux</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gilson</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>How does decentralisation affect health sector planning and financial management? a case study of early effects of devolution in Kilifi County, Kenya.</article-title>
                    <source>

                        <italic toggle="yes">Int J Equity Health.</italic>
</source>
                    <year>2017</year>;<volume>16</volume>;<fpage>151</fpage>.
                    <pub-id pub-id-type="pmid">28911325</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12939-017-0649-0</pub-id>
                    <pub-id pub-id-type="pmcid">5599897</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bunyi</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>SHOPS Plus Pilot on Private Sector Pharmacies Reporting into DHIS 2: Final Report.</article-title>Rockville, MD: Sustaining Health Outcomes through the Private Sector Plus Project, Abt Associates Inc.<year>2018</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://shopsplusproject.org/sites/default/files/resources/SHOPS%20Plus%20Pilot%20on%20Private%20Sector%20Pharmacies%20Reporting%20into%20DHIS%202_0.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tama</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Molyneux</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Waweru</surname>
                            <given-names>E</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Examining the implementation of the free maternity services policy in Kenya: a mixed methods process evaluation.</article-title>
                    <source>

                        <italic toggle="yes">Int J Health Policy Manag.</italic>
</source>
                    <year>2018</year>;<volume>7</volume>(<issue>7</issue>):<fpage>603</fpage>&#x2013;<lpage>613</lpage>.
                    <pub-id pub-id-type="pmid">29996580</pub-id>
                    <pub-id pub-id-type="doi">10.15171/ijhpm.2017.135</pub-id>
                    <pub-id pub-id-type="pmcid">6037504</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Appleford</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Owino</surname>
                            <given-names>E</given-names>
                        </name>
</person-group>:
                    <article-title>AHME Case Study: National Hospital Insurance Fund tariffs - what are the effects on Amua franchisee businesses?</article-title>Marie Stopes International, London, UK,<year>2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://hanshep.org/our-programmes/AHMEresources/case-study-national-hospital-insurance-fund-tariffs">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Appleford</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mumbia</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Emmart</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>Private sector guides.docx</article-title>. figshare. Online resource.<year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.6084/m9.figshare.21201193.v2">http://www.doi.org/10.6084/m9.figshare.21201193.v2</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <collab>Track20</collab>:
                    <article-title>Track20/NairobiPrivateSectorFPProvision: Release 091622. (Version V1) [Code].</article-title>Zenodo.<year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.5281/zenodo.7086477">http://www.doi.org/10.5281/zenodo.7086477</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report33281">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.15202.r33281</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Manya</surname>
                        <given-names>Ayub</given-names>
                    </name>
                    <xref ref-type="aff" rid="r33281a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5026-2074</uri>
                </contrib>
                <aff id="r33281a1">
                    <label>1</label>Ministry of Health, Nairobi, Kenya</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>31</day>
                <month>5</month>
                <year>2023</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2023 Manya A</copyright-statement>
                <copyright-year>2023</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport33281" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13909.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <bold>Methods:</bold>
            </p>
            <p> I suggest a rearrangement of the method section. Maybe it is not interesting to start with Ethics and consent. Regarding approval, some people might argue that the Ministry of Health does not have a scientific committee to approve research. Most of these are in KEMRI and teaching institutions like the University of Nairobi and Kenyatta University. However, the ministry can grant permission for the study once relevant institutions have done appropriate ethical reviews.</p>
            <p> </p>
            <p> 
                <bold>Study Design:</bold>
            </p>
            <p> Usually the design includes cross-sectional, case studies, cohort etc. But you have talked about data collection methods &#x201c;The qualitative research entailed group discussions with county health teams in seven counties&#x201d;. Please reorganize the study design section. In this area of the study design, the authors say that no literature review was done but contradicted themselves by saying &#x201c;Background articles relevant to the context have been referenced in the paper&#x201d;. In my opinion, this is part of the literature review. &#x00a0;</p>
            <p> </p>
            <p> 
                <bold>Study site and population:</bold>
            </p>
            <p> It is unclear how the counties and participants were selected. The only reason given was for Nairobi -&#x201c;The four Nairobi sub-counties were selected based on contextual factors, such as the presence of large informal settlements and family planning organisations&#x201d;.</p>
            <p> </p>
            <p> 
                <bold>Results:</bold>
            </p>
            <p> There is a tendency to provide discussion in the results section. Results should be in the results section without much explanation. Some parts of the results should have been in discussion to provide context. For instance: &#x201c;Devolution, which commenced in 2013, transferred responsibility for service delivery to Kenya&#x2019;s 47 counties".&#x00a0;</p>
            <p> </p>
            <p> I suggest that we separate the findings from the discussion.</p>
            <p> </p>
            <p> 
                <bold>Conclusions:</bold>
            </p>
            <p> The study is rich in results that are not consistent with the title. For instance, pharmacies were introduced but just lost focus. Given time, this would produce another paper with a different focus.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>The authors to do some revisions as suggested</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report33287">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.15202.r33287</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>P. Do</surname>
                        <given-names>Mai</given-names>
                    </name>
                    <xref ref-type="aff" rid="r33287a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-2965-4812</uri>
                </contrib>
                <aff id="r33287a1">
                    <label>1</label>School Of Public Health And Tropical Medicine, Tulane University, New Orleans, Louisiana, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>30</day>
                <month>5</month>
                <year>2023</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2023 P. Do M</copyright-statement>
                <copyright-year>2023</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport33287" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13909.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The paper addresses a very interesting topic related to the private sector&#x2019;s involvement in FP service provision, and the quality of data reporting in this sector. I think the approach from three angles: governance, procedural and technical, is a good way to organize the study. However, I feel that the authors fell a bit short of delivering key messages, particularly to readers who may not have intimate understanding of the health systems and FP service provision in Kenya. Below are some suggestions for consideration: 
                <list list-type="order">
                    <list-item>
                        <p>Overall I think the &#x201c;incentives&#x201d; part is not well and explicitly laid out, relative to the &#x201c;disincentives&#x201d; part. It leaves a lot for readers to figure out on their own. This is particularly true for the section on governance, where I could not tell what may be incentives or disincentives. It is also a bit muddy in the other sections.</p>
                    </list-item>
                    <list-item>
                        <p>Related to the point above, it may be helpful to present the findings as public vs. private sector, and/or findings from public vs. private sector respondents. Only until much later in the paper that I understood that the private sector did not include pharmacies, when there was a discussion about changes in FP services in the private sector.</p>
                    </list-item>
                    <list-item>
                        <p>An overview of the FP service provision systems and environment in Kenya would help readers understand the findings better.</p>
                    </list-item>
                    <list-item>
                        <p>Similarly, the authors should define the public vs. private sector, counties, and explain KHIS as well as KHMFL in the Methods section.</p>
                    </list-item>
                    <list-item>
                        <p>It is not clear if Table 1 included only FP facilities or all facilities.</p>
                    </list-item>
                    <list-item>
                        <p>I am not sure if I agree that the private sector reporting rates have improved over time, based on Figure 1.</p>
                    </list-item>
                    <list-item>
                        <p>Under the technical section, I am not clear about the point of the discussion on the private sector adjustment. What adjustments and assumptions are being discussed? How do they influence the private sector facilities&#x2019; reporting and/or the quality of reporting?</p>
                    </list-item>
                    <list-item>
                        <p>The three paragraphs discussing changes in private sector that came right before Conclusions did not seem to come from the findings, but seemed more appropriate for a Discussion section.</p>
                    </list-item>
                    <list-item>
                        <p>Inconsistent use of &#x201c;FP service provision&#x201d; vs. &#x201c;family service provision&#x201d; &#x2013; these are two different types of services.</p>
                    </list-item>
                    <list-item>
                        <p>Careful editing is necessary, e.g. &#x201c;A literature review as not conducted as part of this study&#x201d; as opposed to &#x201c;&#x2026;was not conducted&#x2026;&#x201d;.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>No source data required</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>family planning</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
</article>
