<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Gates Open Res</journal-id>
            <journal-title-group>
                <journal-title>Gates Open Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2572-4754</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/gatesopenres.13182.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>&#x201c;I felt like a TRIO champion&#x201d;: end-user perspectives on their role as co-designers of multi-purpose technologies</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Agot</surname>
                        <given-names>Kawango</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Lutnick</surname>
                        <given-names>Alexandra</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Shapley-Quinn</surname>
                        <given-names>Mary Kate</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-9805-3132</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Ahmed</surname>
                        <given-names>Khatija</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Okello</surname>
                        <given-names>Timothy</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>van der Straten</surname>
                        <given-names>Ariane</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-8536-648X</uri>
                    <xref ref-type="aff" rid="a3">3</xref>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <collab>The TRIO Study Team</collab>
                </contrib>
                <aff id="a1">
                    <label>1</label>Impact Research and Development Organization, Kisumu, Kenya</aff>
                <aff id="a2">
                    <label>2</label>Behavioral and Urban Health Program, RTI International, San Francisco, California, USA</aff>
                <aff id="a3">
                    <label>3</label>Women's Global Health Imperative, RTI International, Berkeley, California, USA</aff>
                <aff id="a4">
                    <label>4</label>Setshaba Research Centre, Soshanguve, Gauteng, South Africa</aff>
                <aff id="a5">
                    <label>5</label>Department of Medicine, Center for AIDS Prevention Studies, UCSF, San Francisco, California, USA</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:mshapley@rti.org">mshapley@rti.org</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>26</day>
                <month>10</month>
                <year>2020</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2020</year>
            </pub-date>
            <volume>4</volume>
            <elocation-id>163</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>8</day>
                    <month>10</month>
                    <year>2020</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2020 Agot K et al.</copyright-statement>
                <copyright-year>2020</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://gatesopenresearch.org/articles/4-163/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> The likelihood that research will be relevant to and accepted by end-users and their communities is enhanced when the perspectives of both the &#x201c;researchers&#x201d; and the &#x201c;researched&#x201d; are considered. The Tablets, Ring, Injections as Options (TRIO) Study, conducted with young women in Kenya and South Africa, assessed the acceptability and preferences of three placebo-only multi-purpose technology (MPT) forms for prevention of HIV and unintended pregnancy. The objective of this analysis was to assess whether, and if so how, the women participating in the TRIO Study perceived themselves as co-designers of the three MPT products.</p>
                <p>
                    <bold>Methods:</bold> We conducted 55 in-depth interviews, 6 focus group discussions, and 5 dissemination workshops with TRIO Study participants. Woven throughout these activities were questions and opportunities for participants to reflect on their role in the study, and to what extent they identified with their role as a co-designer. Qualitative data from these activities were analyzed thematically.</p>
                <p>
                    <bold>Results:</bold> The analysis revealed four key themes about what resulted in the women&#x2019;s views as co-designers: altruism, respectful treatment, agency, and reciprocity. The women were aware of their role in determining what end-users would and would not prefer and were motivated by a desire to help themselves and others. They recognized their role as co-designers and cited being treated well by study staff, being given a chance to make choices during the study period, and being recognized as equal partners of the researchers as the main reasons.</p>
                <p>
                    <bold>Conclusions:</bold> If prevention products are going to be successfully developed, end-users and researchers must work hand in hand. Engaging participants meaningfully as co-designers in product development research can be a powerful tool in the effort to ensure new prevention products brought to market are acceptable to the population of interest.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Co-designer</kwd>
                <kwd>multipurpose technologies</kwd>
                <kwd>end-users</kwd>
                <kwd>HIV prevention</kwd>
                <kwd>contraception</kwd>
                <kwd>women</kwd>
                <kwd>Africa</kwd>
                <kwd>PrEP</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/100008199">
                    <funding-source>RTI International</funding-source>
                </award-group>
                <award-group id="fund-2" xlink:href="http://www.gatesfoundation.org">
                    <funding-source>Gates Foundation</funding-source>
                    <award-id>OPP1114942</award-id>
                </award-group>
                <funding-statement>This work was supported by the Gates Foundation [OPP1114942]. &#13;
&#13;
Writing of this manuscript was funded in part by internal funds from RTI International.</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>In sub-Saharan Africa, adolescents and young people aged 15&#x2013;24 years make up only 10% of the population yet accounted for 32% of new HIV infections in 2019 (
                <xref ref-type="bibr" rid="ref-27">UNAIDS, 2020</xref>). Adolescent girls and young women in the sub-continent are more disproportionately affected, accounting for 62.5% of the new infections among adolescents and young people (
                <xref ref-type="bibr" rid="ref-27">UNAIDS, 2020</xref>) and acquiring HIV 5 to 7 years earlier than their male counterparts (
                <xref ref-type="bibr" rid="ref-6">Dellar 
                    <italic toggle="yes">et al.</italic>, 2015</xref>). Despite the increased vulnerability of adolescent girls and young women to HIV in sub-Saharan Africa, their uptake, retention, and adherence to HIV prevention interventions that work (notably pre-exposure prophylaxis), have been sub-optimal both during trials and rollout (
                <xref ref-type="bibr" rid="ref-4">Celum 
                    <italic toggle="yes">et al.</italic>, 2019</xref>; 
                <xref ref-type="bibr" rid="ref-12">Koss 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref-32">Were 
                    <italic toggle="yes">et al.</italic>, 2020</xref>). It is hypothesized that, when new products are discussed with future end-users before development and their opinions are considered at the design stage, uptake and adherence are likely to improve (
                <xref ref-type="bibr" rid="ref-8">Guthrie 
                    <italic toggle="yes">et al.</italic>, 2018</xref>; 
                <xref ref-type="bibr" rid="ref-20">Shah &amp; Robinson, 2007</xref>; 
                <xref ref-type="bibr" rid="ref-24">Swain 
                    <italic toggle="yes">et al.</italic>, 2019</xref>). Therefore, end-user input is increasingly considered essential for product development to ensure their attributes and usage preferences help guide the development process (
                <xref ref-type="bibr" rid="ref-3">Brady &amp; Tolley, 2014</xref>; 
                <xref ref-type="bibr" rid="ref-8">Guthrie 
                    <italic toggle="yes">et al.</italic>, 2018</xref>; 
                <xref ref-type="bibr" rid="ref-26">Thilo 
                    <italic toggle="yes">et al.</italic>, 2017</xref>).</p>
            <p>Most end-user studies focus on bringing together potential users and researchers/programmers to co-design strategies for roll-out after the intervention/product has been developed (
                <xref ref-type="bibr" rid="ref-22">Slater 
                    <italic toggle="yes">et al.</italic>, 2017</xref>). At this point it may be too late or too expensive to consider modifying product attributes that may be unacceptable to end-users. The likelihood that research results will be relevant to and valued by end-users and their communities is enhanced when the perspectives of the &#x201c;researchers&#x201d; and the &#x201c;researched&#x201d; jointly inform the design of the intervention products (
                <xref ref-type="bibr" rid="ref-18">Montgomery 
                    <italic toggle="yes">et al.</italic>, 2017</xref>). It is therefore prudent to bring end-users on board earlier in the product design stage to partner with developers and researchers in designing products that would be more acceptable &#x2014; and adhered to when put on the market (
                <xref ref-type="bibr" rid="ref-14">Krogstad 
                    <italic toggle="yes">et al.</italic>, 2018</xref>; 
                <xref ref-type="bibr" rid="ref-18">Montgomery 
                    <italic toggle="yes">et al.</italic>, 2017</xref>). The co-designer concept, in which the three key players (developers, researchers, and end-users) collaborate, encourages end-users to take an equal role in the design of healthcare interventions (
                <xref ref-type="bibr" rid="ref-2">Bate &amp; Robert, 2006</xref>).</p>
            <p>We conducted a study to assess the acceptability of and preferences for the attributes and routes of administration of three placebo-only multi-purpose technology (MPT) products (tablets, ring, and injections) for prevention of HIV and unintended pregnancy among young women in Kenya and South Africa (
                <xref ref-type="bibr" rid="ref-28">van der Straten 
                    <italic toggle="yes">et al.</italic>, 2018</xref>). As part of joining the study, participants were invited to engage as co-designers so that their feedback could help researchers and product developers improve the products they would receive and use. The purpose of the sub-analysis informing this paper was to assess whether, and if so how, the young women who participated in the study perceived themselves as co-designers in the development of the three MPT products being investigated.</p>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <p>Tablets, Ring, Injections as Options (TRIO) was a 5-month clinical study conducted at the Impact Research and Development Organization (IRDO) in Kisumu, Kenya and Setshaba Research Centre (SRC) in Soshanguve, South Africa. Study enrollment occurred between December 2015 and June 2016, with follow-up visits completed in December 2016 and dissemination of results in May/June 2017. Details of the methods have been presented elsewhere (
                <xref ref-type="bibr" rid="ref-17">Minnis 
                    <italic toggle="yes">et al.</italic>, 2018</xref>; 
                <xref ref-type="bibr" rid="ref-28">van der Straten 
                    <italic toggle="yes">et al.</italic>, 2018</xref>). Briefly, women were eligible to participate if they were aged 18 to 30 years, sexually active, not pregnant, HIV negative, and had no prior participation in HIV prevention product trials or demonstration studies. The three placebo-only MPTs that the women used and assessed were daily oral tablets, a monthly silicone vaginal ring, and two 2 mL monthly saline injections. This analysis focuses on findings from the qualitative data collected throughout the study, including during dissemination of results, to explore participants&#x2019; perceptions of being invited to engage as co-designers in the development of the MPTs.</p>
            <p>Strategies for engaging TRIO participants started during recruitment and continued through to the end of the study (
                <xref ref-type="table" rid="T1">Table 1</xref>). Pre-enrollment workshops were held to introduce interested community members to the study and the placebo products being evaluated and to answer any questions. Once enrolled in the study, women received telephone check-ins between their monthly visits. Participants received a certificate at their month 5 visit with stars for each time they gave a pledge to provide honest responses about what they really thought of the products during monthly interviews. Additionally, suggestion boxes were available at the clinic for those wanting to provide anonymous feedback about their study experiences, and &#x201c;Chill sessions&#x201d; (where participants came to the study site to simply hang out) were conducted (at SRC site only) so that participants could receive more education about the study and to facilitate an atmosphere of trust, openness, and partnership among participants and the research team.</p>
            <table-wrap id="T1" orientation="portrait" position="anchor">
                <label>Table 1. </label>
                <caption>
                    <title>Engagement activities by site and overall for TRIO.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th colspan="1" rowspan="1"/>
                            <th align="left" colspan="1" rowspan="1" valign="top">IRDO </th>
                            <th align="left" colspan="1" rowspan="1" valign="top">SRC </th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Total </th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Pre-enrollment workshops </td>
                            <td align="left" colspan="1" rowspan="1" valign="top"/>
                            <td align="left" colspan="1" rowspan="1" valign="top"/>
                            <td align="left" colspan="1" rowspan="1" valign="top"/>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;No. Conducted</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">13</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">33</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">44</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;No. of workshop participants</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">387</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">289</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">676</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">No. Phone check ins/No. participants contacted</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">358/126</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">347/135</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">705/261</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">No. Certificates of completion provided </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">122</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">124</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">246</td>
                        </tr>
                    </tbody>
                </table>
                <table-wrap-foot>
                    <fn>
                        <p>IRDO, Impact Research and Development Organization; SRC, Setshaba Research Centre; TRIO, Tablets, Ring, Injections as Options Study.</p>
                    </fn>
                </table-wrap-foot>
            </table-wrap>
            <p>The qualitative data sources (
                <xref ref-type="table" rid="T2">Table 2</xref>) used for this analysis include 55 in-depth interviews (IDIs), six focus group discussions (FGDs), and five dissemination workshops, all conducted at the research sites. IDIs were conducted with randomly selected participants following their month 3 visit in TRIO, or with a purposive sample of women based on their decision to switch products during the usage period. The 37 women who participated in the six FGDs at study exit were purposively selected and stratified according to the product selected during the usage period. Detailed methods related to the IDI and FGD component are previously reported elsewhere (
                <xref ref-type="bibr" rid="ref-21">Shapley-Quinn 
                    <italic toggle="yes">et al.</italic>, 2019</xref>).</p>
            <table-wrap id="T2" orientation="portrait" position="anchor">
                <label>Table 2. </label>
                <caption>
                    <title>Qualitative activities by site and overall for the TRIO qualitative sample.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th colspan="1" rowspan="1"/>
                            <th align="left" colspan="1" rowspan="1" valign="top">IRDO
                                <break/>(N=90)</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">SRC
                                <break/>(N=75)</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Total
                                <break/>(N=165)</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">No. IDIs</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">25</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">30</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">55</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">No. FGDs (No. participants)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3 (n=18)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3 (n=19)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">6 (n=37)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">No. Dissemination workshops (No. of participants
                                <break/>who joined)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2 (n=71)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3 (n=46)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5 (n= 117)</td>
                        </tr>
                    </tbody>
                </table>
                <table-wrap-foot>
                    <fn>
                        <p>Forty participants completed either an IDI or FGD, and a dissemination workshop; three completed an IDI, FGD, and attended a dissemination workshop. FGD, focus group discussion; IDI, in-depth interview; IRDO, Impact Research and Development Organization; SRC, Setshaba Research Centre; TRIO, Tablets, Ring, Injections as Options Study.</p>
                    </fn>
                </table-wrap-foot>
            </table-wrap>
            <p>Approximately 6 months after the study ended, we conducted dissemination workshops at each site with a total of 117 former study participants to share the key findings and solicit the women&#x2019;s feedback about those findings; the results have been presented elsewhere (
                <xref ref-type="bibr" rid="ref-1">Agot 
                    <italic toggle="yes">et al.</italic>, 2019</xref>). The workshops also explored how participants viewed their role as co-designers during their participation in TRIO and heard their recommendations to enhance a co-designer relationship between researchers and participants in future studies (see extended data for slide (
                <xref ref-type="bibr" rid="ref-31">Wagner &amp; Shapley-Quinn, 2020</xref>)).</p>
            <p>All qualitative data collection was conducted by trained interviewers and facilitators in local languages. IDIs and FGDs were conducted using semi-structured guides (see extended data (
                <xref ref-type="bibr" rid="ref-31">Wagner &amp; Shapley-Quinn, 2020</xref>)), audio-recorded, transcribed, and translated into English when needed. The dissemination workshops were conducted using a structured guide. Dissemination workshops at SRC were audio-recorded, transcribed, and translated into English where necessary. A secure File Transfer Protocol site was used to transmit all audio recordings. Audio recordings were stored securely as protected health data until analyses were completed and audio recordings destroyed. At IRDO, three note-takers attended each workshop because the site did not apply for ethics approval to audio-record the workshop proceedings. Once the workshops were complete, the note-takers compared and triangulated their notes to develop full text.</p>
            <sec>
                <title>Data analysis</title>
                <p>A codebook was developed for the IDI and FGD data, and three analysts coded all transcripts using 
                    <ext-link ext-link-type="uri" xlink:href="https://www.dedoose.com/">Dedoose</ext-link>, a web-based qualitative analysis software (see extended data (
                    <xref ref-type="bibr" rid="ref-31">Wagner &amp; Shapley-Quinn, 2020</xref>)). The average coder inter-rater reliability score was 0.82 (calculated as a pooled Cohen&#x2019;s kappa). After coding was completed, code reports were generated for the following codes: &#x201c;engagement,&#x201d; &#x201c;research,&#x201d; &#x201c;visits and procedures,&#x201d; &#x201c;TRIO Study,&#x201d; and &#x201c;recommendations,&#x201d; and summary memos were written for each of these code reports. Thematic analysis was used with the transcripts (SRC) and expanded notes (IRDO) from the dissemination workshops to explore the contents of the discussions related to people&#x2019;s perceptions of their role as co-designers.</p>
            </sec>
            <sec>
                <title>Ethics</title>
                <p>The study obtained ethics approval from Scientific and Ethics Review Unit of the Kenya Medical Research Institute (Ref #: NON-SCC 474) and from South Africa's Pharma Ethics (Pty) Ltd (Ref #: 150110905). RTI International's IRB transferred oversight responsibilities to the Kenyan and South African IRBs through formal authorization agreements. The study was not registered with a clinical trials site as the products were all placebo.</p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>Across the two TRIO sites 165 women participated in at least one qualitative activity. Over half of the women were ages 18&#x2013;24 and had completed secondary school (see 
                <xref ref-type="table" rid="T3">Table 3</xref>). Among those who joined one or more qualitative activities, four key themes emerged from the data about what resulted in the women feeling like co-designers; these included altruism, respect, agency, and reciprocity.</p>
            <table-wrap id="T3" orientation="portrait" position="anchor">
                <label>Table 3. </label>
                <caption>
                    <title>Background characteristics of TRIO participants.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Characteristics</th>
                            <th align="center" colspan="2" rowspan="1" valign="top">Total Sample</th>
                            <th align="center" colspan="2" rowspan="1" valign="top">Qualitative sample
                                <xref ref-type="other" rid="TFN1">*</xref>
</th>
                        </tr>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top"> </th>
                            <th align="center" colspan="1" rowspan="1" valign="top">N</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">(%)</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">N</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">(%)</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top">277</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(100)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">165</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(100)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Age</td>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;18 to 24</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">183</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(66)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">109</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(66)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;25 to 30</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">94</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(34)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">56</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(34)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Education</td>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;Completed secondary school</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">143</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(52)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">85</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(52)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Income</td>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;Earns an income</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">86</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(31)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">56</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(34)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Relationship Status</td>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;Currently has a primary partner</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">261</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(94)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">158</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(96)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;Married or cohabiting</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">79</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(29)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">53</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(32)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;Currently has a casual sex partner</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">50</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(18)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">27</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(16)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Site</td>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top"/>
                            <td align="center" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;IRDO</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">137</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(49)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">90</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(55)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;&#x00a0;&#x00a0;SRC</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">140</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(51)</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">75</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">(45)</td>
                        </tr>
                    </tbody>
                </table>
                <table-wrap-foot>
                    <fn>
                        <p id="TFN1">*Qualitative sample is comprised of women who participated in an IDI, FGD, and/or dissemination workshop. Forty participants completed either an IDI or FGD and also a dissemination workshop; three completed an IDI, FGD, and attended a dissemination workshop. FGD, focus group discussion; IDI, in-depth interview; IRDO, Impact Research and Development Organization; SRC, Setshaba Research Centre; TRIO, Tablets, Ring, Injections as Options Study.</p>
                    </fn>
                </table-wrap-foot>
            </table-wrap>
            <sec>
                <title>Altruism</title>
                <p>Although women reported feeling special because they were 
                    <italic toggle="yes">&#x201c;among the few selected&#x2026;to join the TRIO Study&#x201d;</italic> (IDI, IRDO), it was more important to many that they were representing and ultimately helping other women. This sense of service to others was noted by the women as a crucial aspect of their co-designer role. The women commented about how their involvement would save other women. During an individual interview at IRDO, one woman reflected that, 
                    <italic toggle="yes">&#x201c;I strongly felt that I should take the responsibility to save other women around the world if I participated in the study.&#x201d;</italic> Similarly, several discussants who participated in the dissemination workshops at IRDO said that the term included on the TRIO Certificates of Completion, 
                    <italic toggle="yes">&#x201c;shujaa</italic>,
                    <italic toggle="yes">&#x201d;</italic> (champions/heroes) resonated with them, 
                    <italic toggle="yes">&#x201c;because I have been able to help women in Kenya and South Africa through being part of the research of these products&#x201d;</italic> and because they volunteered 
                    <italic toggle="yes">&#x201c;to help other women like me.&#x201d;</italic> Women who participated in the FGDs at SRC reflected that they, and sometimes even their family members, felt proud of themselves because their contribution to the design of the MPTs was 
                    <italic toggle="yes">&#x201c;gonna bring a change in the world.&#x201d;</italic>
                </p>
                <p>The women&#x2019;s altruistic motivation as co-designers was also expressed by their understanding that they were working directly with the research team to help develop products that women will like and want to use. It appears that this motivation to co-design the MPTs encouraged the women to communicate honestly their opinions about the products. Knowing that they were participating to help 
                    <italic toggle="yes">&#x201c;the generation to come&#x201d;</italic> (FGD, SRC), they seemed more inclined to 
                    <italic toggle="yes">&#x201c;&#x2026;.give true feedback because it is going to help other women. So when I was given a product and returned</italic> (to the site)
                    <italic toggle="yes">, I made sure I gave honest answers&#x201d;</italic> (FGD, IRDO). As one woman shared during a dissemination workshop in SRC, 
                    <italic toggle="yes">&#x201c;The information I gave was honest. It will be able to help other women because I&#x2019;m sure that what I like is not only liked by me alone, and my health and safety is like everybody else&#x2019;s.&#x201d;</italic>
                </p>
            </sec>
            <sec>
                <title>Respect</title>
                <p>The interviews revealed that for participants, it was extremely important that the research team extended the same respect to them as they would to their research colleagues. Women noted that the calls they received from the study staff made them feel appreciated, special, cared for, and part of the team: 
                    <italic toggle="yes">&#x201c;I felt appreciated like, at least like I&#x2019;ve been remembered and these people like they care about their participants&#x201d;</italic> (IDI, SRC). In IRDO, a FGD participant described how she 
                    <italic toggle="yes">&#x201c;&#x2026;.felt so good when I received the phone call to find out how I was fairing on with the ring and said to myself, &#x2018;so these people care so much about me that even though they gave me this thing</italic> [ring] 
                    <italic toggle="yes">if I feel any discomfort I can easily go back to have it sorted out.&#x2019;&#x201d;</italic> This air of respect, caring, and openness was noted by many women as a key component of feeling like co-designers&#x2014;like they and the researchers were working together to identify attributes of the MPTs that would be acceptable to women. Women in SRC were particularly appreciative of the kindness with which staff treated them and the confidentiality the staff maintained about their discussions. As one woman shared during a dissemination workshop, &#x201c;
                    <italic toggle="yes">You would never find that when you leave the room you would find</italic> [name of staff] 
                    <italic toggle="yes">telling other people that this one has had a lot of sex with her partner during the week.&#x201d;</italic> Participants were therefore able to share freely how they felt the products needed to be fashioned to fit the expectations of end-users.</p>
                <p>The respect the women felt they were shown by the study staff helped facilitate open communication about their opinions and preferences. During dissemination workshops in both sites, a number of participants said reminders about attending clinic visits by study staff and receiving follow-up phone calls to find out how they were doing, and to update them about the study, made them feel part of the game: "
                    <italic toggle="yes">I like the love from the people at</italic> SRC
                    <italic toggle="yes">, ever smiling, and then when you were unable to come they would call and ask why you could not make it and then you would apologize and they would ask when will you would be able to come and when you are able to come, they won&#x2019;t cast you aside because it&#x2019;s been a while since you came in; no they give you attention and you also feel at ease....if you have a problem, they listen to your problem. That is what Setshaba did for me so yes, well done."</italic> A FGD participant at SRC also captured this mood clearly: "
                    <italic toggle="yes">It</italic> [phone check in] 
                    <italic toggle="yes">is very important because it shows us that we are important. You are not taking us for granted, that we are just doing the study and that&#x2019;s it. Like you do everything in your power to show us how important we are&#x2026;..after I&#x2019;ve come here for the second time I just experienced that wow, no, these people are not just caring about their research.&#x201d;</italic> These statements emphasized that the care and attention from study staff gave participants a sense of belonging that made them open up to sharing honest views about what they liked and did not like about the products.</p>
                <p>Understanding the ways in which women felt that the respect they were shown fostered the co-designer relationship; it is not surprising then that women who did not feel respected did not feel like they were important or part of the team. Some women felt disrespected because they had to endure long wait times at the clinic, they sometimes were not informed about what would take place during a study visit, or they felt the study team did not trust them. Explaining this lack of trust, one woman in an IDI at IRDO described that the study procedure around ring insertion and removal communicated that the staff did not believe the women would follow the directions: 
                    <italic toggle="yes">&#x201c;If you did not want to participate in the TRIO project, you would have refused and left it. Which means you accepted and agreed to do those things and that is the reason you accepted to be coming back, so I always don&#x2019;t see the need that they insist you have to put in the ring here and you come and remove it here.&#x201d;</italic>
                </p>
            </sec>
            <sec>
                <title>Agency</title>
                <p>For some, the study design itself awakened their perception of being co-designers. They described that because they were given the opportunity to choose a product to use during the usage stage of TRIO, they felt like they were 
                    <italic toggle="yes">&#x201c;study partners and not participants&#x201d;</italic> and that they were 
                    <italic toggle="yes">&#x201c;part of the team&#x201d;</italic> (dissemination workshop, IRDO). Putting this choice in their hands sufficiently disrupted the traditional top-down approach of research and resulted in the women feeling empowered and engaged. 
                    <italic toggle="yes">&#x201c;I felt I was involved because at some point I was the one who chose whatever I wanted, like it was up to me&#x2026;I was able to say what was on my mind&#x201d;</italic> (IDI, SRC). Recognizing their agency, the women reflected that because they are co-designers, the 
                    <italic toggle="yes">&#x201c;top dogs&#x201d;</italic> (i.e., &#x201c;big&#x201d; people [important people, decision makers] with the money who come up with new things) valued their opinions as 
                    <italic toggle="yes">&#x201c;professionals&#x201d;</italic> and that 
                    <italic toggle="yes">&#x201c;in the end they&#x2019;ll take my opinion on whatever I tell them&#x201d;</italic> (IDI, SRC). The women understood that without them 
                    <italic toggle="yes">&#x201c;there won&#x2019;t be any survey conducted&#x201d;</italic> (IDI, SRC).
                    <italic toggle="yes"/>
                </p>
            </sec>
            <sec>
                <title>Reciprocity</title>
                <p>In their role as co-designers, the women spoke about the mutually beneficial nature of their relationship with the research team. In addition to the remuneration they received for their participation, several women also reported that they gained knowledge and skills as co-designers. A participant at a dissemination workshop in IRDO shared that 
                    <italic toggle="yes">&#x201c;I did not know that there could be a product that prevents both pregnancy and HIV, but now I have knowledge and experience and I feel good.&#x201d;</italic> For others, their involvement changed their perceptions about the types of prevention products they would be willing to use. One of the participants during an IDI at SRC explained, 
                    <italic toggle="yes">&#x201c;I&#x2019;ve never thought that I&#x2019;ll&#x2014;even a female condom, I never thought I&#x2019;ll use it. Like putting something in my vagina. So when I got there, I changed my mind, my mindset</italic> (on) 
                    <italic toggle="yes">how things are done. I was willing to do it and it was quite an experience for me.&#x201d;</italic> Feeling empowered to co-design the products both for their own benefit and for the benefit of others was also expressed by a FGD participant at IRDO: &#x201c;
                    <italic toggle="yes">I can now teach somebody else who is ignorant on HIV and family planning issues the way I have been taught and make them understand with the hope that suppose that the medicine will be there</italic> (when the MPT products will be active, not placebo)
                    <italic toggle="yes">, then I am in a position to influence a fellow woman to access it and get helped</italic>.&#x201d; Knowing such technical topics resulted in some women feeling elevated to the level of a community resource person.</p>
                <p>To demonstrate the reciprocal nature of the TRIO Study further, the research team provided Certificates of Completion. In both IDIs and FGDs women discussed how the certificates made them feel important, that they were a part of positive change for their communities, and they were able to see something through to completion. During a FGD at SRC, a woman shared how it 
                    <italic toggle="yes">&#x201c;</italic>&#x2026;.
                    <italic toggle="yes">made me feel proud of myself because I was able to begin something and go through to the ending.&#x201d;</italic> Some thought that they may even be able to include the certificate in future job applications as evidence of their ability to complete significant tasks and that they engaged in 
                    <italic toggle="yes">&#x201c;voluntary work&#x201d;</italic> (IDI, SRC). Lastly, one woman spoke about how meaningful it was to her that she received the certificate, especially as someone who had not completed high school or college. She said, 
                    <italic toggle="yes">&#x201c;The certificates, it felt, it felt so good because some of us never got the chance to go to tertiary&#x2026;So receiving the certificate meant a lot you see&#x2026;more than the Malu &#x2013;Malusi</italic> [matric certificate] 
                    <italic toggle="yes">you see. So yes, it felt good indeed&#x201d;</italic> (FGD, SRC).</p>
            </sec>
        </sec>
        <sec sec-type="discussion">
            <title>Discussion</title>
            <p>Although the main purpose of the TRIO Study was to obtain end-user perspectives into the development of three potential MPT products&#x2014;tablets, ring and injections, the objective of this analysis is to present how participants perceived their role as co-designers of the three products being evaluated. Trying out each product and sharing their views on the attributes they liked or did not like, then making suggestions on aspects that could be modified made participants view themselves as more than a mere source of information for researchers; they felt like co-creators of the products. Even though the products are already designed and at different stages of clinical development as HIV prevention methods, none existed yet as MPTs or dual prevention products for pregnancy and HIV prevention. Furthermore, participants&#x2019; co-designer ideas truly contributed to identifying barriers to each of the product forms as well as potential solutions. As reported in another paper from the TRIO Study (
                <xref ref-type="bibr" rid="ref-16">Minnis 
                    <italic toggle="yes">et al.</italic>, Under review</xref>), participants came with suggestions for improved product dosage and delivery modalities currently being evaluated by developers. These included a weekly pill (
                <xref ref-type="bibr" rid="ref-11">Kirtane 
                    <italic toggle="yes">et al.</italic>, 2018</xref>), a transdermal patch (
                <xref ref-type="bibr" rid="ref-19">Puri 
                    <italic toggle="yes">et al.</italic>, 2019</xref>; 
                <xref ref-type="bibr" rid="ref-30">Vogler 
                    <italic toggle="yes">et al.</italic>, 2010</xref>), and longer acting bi-monthly injections (
                <xref ref-type="bibr" rid="ref-10">Kerrigan 
                    <italic toggle="yes">et al.</italic>, 2020</xref>). Thus, involving end-users early in product development can inform product attributes before form factors are locked in (
                <xref ref-type="bibr" rid="ref-14">Krogstad 
                    <italic toggle="yes">et al.</italic>, 2018</xref>; 
                <xref ref-type="bibr" rid="ref-29">van Velsen 
                    <italic toggle="yes">et al.</italic>, 2018</xref>).</p>
            <p>In a systematic review of 49 studies addressing the development of supportive technologies for persons with dementia, 
                <xref ref-type="bibr" rid="ref-23">Suijkerbuijk 
                    <italic toggle="yes">et al.</italic> (2019)</xref> explored the level of engagement with end-users as co-designers, driving the process into four phases: pre-design (exploring people&#x2019;s lived experiences that would make a product necessary), generative (exploring ideas of the product design), evaluation (iterative development and testing of the product in different formats with representative end-users), and post-design (actual use of the product while also monitoring acceptability). The authors reported that only 7 of 49 studies included people with dementia in multiple phases of development and iteratively consulted them across all the four co-designer phases while, similar to our study, the majority engaged end-users in the development (38/49) and generative (25/49) phases only. Importantly though, 38 (77.6%) of the studies reported explicitly that the recommendations by the end-users resulted in one or more changes in the design of the final product (11 studies did not report on this).</p>
            <p>It was important for us to find out whether, in taking part in the study, participants were aware that they were co-designers of these products and that their opinions would be considered by product developers in designing new biomedical interventions. This is important in two ways: one, participants would appreciate the important role they play in determining how the products would look like when released into the market for use and two, in knowing and appreciating their co-designer role they would better understand the importance of providing their honest views.</p>
            <p>As experts of their own lives, end-users should be offered an opportunity to influence the design processes of products being development for them (
                <xref ref-type="bibr" rid="ref-7">Giroux 
                    <italic toggle="yes">et al.</italic>, 2019</xref>; 
                <xref ref-type="bibr" rid="ref-9">Hussey 
                    <italic toggle="yes">et al.</italic>, 2019</xref>), and working collaboratively can optimize the eventual acceptability of the interventions. Results from our study indicate that the women appreciated the respect accorded to them and the recognition that they as end-users and researchers must work hand in hand for the successful development of prevention products. Latkin and colleagues (
                <xref ref-type="bibr" rid="ref-15">Latkin 
                    <italic toggle="yes">et al.</italic>, 2016</xref>) noted that a key to overcoming social desirability within research is to treat participants with respect, a factor also considered important by our participants. Participants were clearly aware of their role in determining what the end-users would and would not prefer. For some, volunteering to participate in the research to help other women made them feel like heroes. In joining the TRIO Study to share their experiences and preferences of the three dual-use products, participants made the statement that they were volunteering for the benefit of others. Joining a study for altruistic reasons has been expressed by participants in other studies, including one that examined acceptability of vaginal ring for HIV prevention (
                <xref ref-type="bibr" rid="ref-18">Montgomery 
                    <italic toggle="yes">et al.</italic>, 2017</xref>).</p>
            <p>Altruism alone is not enough to maintain a co-designer relationship. In co-designing health products, future end-users are empowered through being engaged as experts of their experiences (
                <xref ref-type="bibr" rid="ref-5">Cottam &amp; Leadbeater, 2004</xref>; 
                <xref ref-type="bibr" rid="ref-25">Taffe, 2015</xref>; 
                <xref ref-type="bibr" rid="ref-33">Wetter-Edman, 2012</xref>). True to a participatory approach to the research process, the TRIO Study provided the women with new information on a topic of concern to them, worked with the women to increase the resources available to their community, delivered the study findings back to them and asked for their perceptions on those results, and translated what was learned from the women into strategies that will hopefully meet their HIV and unintended pregnancy prevention needs. Ideas from potential end-users better match the needs of the actual end-user than the ideas generated by professional developers or researchers (
                <xref ref-type="bibr" rid="ref-13">Kristensson &amp; Magnusson, 2010</xref>). By engaging local knowledge, the quality and validity of the research is improved (
                <xref ref-type="bibr" rid="ref-9">Hussey 
                    <italic toggle="yes">et al.</italic>, 2019</xref>). Thus, it is important to recognize the symbiotic relationship between product developers who understand what is technologically feasible and end-users who experience the product and therefore know what is best for them.</p>
            <p>This study has several limitations to consider. The women who participated in IDIs, FGDs, and/or dissemination workshops may not represent the larger sample of women who participated in the TRIO Study. The qualitative sample participants were not selected based on perceptions of being co-designers. It is also worth considering whether women who felt more engaged with the study and who felt respected by the research team were more likely to participate in the qualitative components. Additionally, the study sought views from end-users after two of the products were approved or in late clinical stages for HIV prevention, although none had progressed very far yet for a dual or MPT indication.</p>
            <p>Our study has demonstrated that when study participants are engaged to give opinions on the design of health products before they are developed and released into the market, they embrace their role as co-designers if they are treated well by study staff, given a chance to make choices during the study period, are recognized as equal partners of the researchers, and are motivated by a desire to help themselves and others. Studies are needed to engage end-users of multi-purpose technologies as co-designers across the different product development phases.</p>
            <sec>
                <title>Consent</title>
                <p>All study participants provided written informed consent in a language that was understandable to them.</p>
            </sec>
        </sec>
        <sec>
            <title>Data availability</title>
            <sec>
                <title>Underlying data</title>
                <p>Given the sensitive nature of the qualitative data collected in this study, RTI International is unable to make the dataset publicly available. Those wishing to gain access to the data are invited to contact the corresponding author and will be asked to complete a data use request and execute a Data Use Agreement (DUA) with RTI International before gaining access. Those who have completed a signed DUA will be granted access to the data.</p>
            </sec>
            <sec>
                <title>Extended data</title>
                <p>Open Science Framework: TRIO Project, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.17605/OSF.IO/MYC9R">https://doi.org/10.17605/OSF.IO/MYC9R</ext-link> (
                    <xref ref-type="bibr" rid="ref-31">Wagner &amp; Shapley-Quinn, 2020</xref>).</p>
                <p>This project contains the following extended data:</p>
                <list list-type="bullet">
                    <list-item>
                        <label>-</label>
                        <p>2017_May 01 Trio dissemination slides_ka_FO.ppt (dissemination workshop guidance slides)</p>
                    </list-item>
                    <list-item>
                        <label>-</label>
                        <p>Trio_IDI_FGD_Codebook_v1.4_no additional info.docx (Codebook)</p>
                    </list-item>
                    <list-item>
                        <label>-</label>
                        <p>Trio FGD Guide_V2.1.pdf (Focus group discussion guide)</p>
                    </list-item>
                    <list-item>
                        <label>-</label>
                        <p>Trio IDI 1_V1.0.pdf (Round 1 interview guide)</p>
                    </list-item>
                    <list-item>
                        <label>-</label>
                        <p>Trio IDI 2_V2.1.pdf (Round 2 interview guide)</p>
                    </list-item>
                    <list-item>
                        <label>-</label>
                        <p>Trio Male Partner IDI Guide_V2.1.pdf (Male partner interview guide)</p>
                    </list-item>
                </list>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero "No rights reserved" data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgements</title>
            <p>We are grateful to the TRIO study participants for contributing to the research as co-designers and would like to acknowledge the role played by the following TRIO study staff at IRDO (Jacob Onyango, Millicent Oswe, Lillian Akoth Ouma, Nancy Oyugi, Ezinah Kemunto, Roselyne Aluoch, Olivia Atieno Okumu, Philip Owiti Odote, Florence Sijenje, Frederick Owino), SRC (Kgahlisho N Manenzhe, Lebogang Letta Mpete, Thulisile Enough Mbatsane, Tsholofelo Engla Malapane), and RTI (Alexandra Minnis, Rachel Weinrib, Erica Browne, Danielle Wagner, Jonah Leslie, Shannon O&#x2019;Rourke).</p>
        </ack>
        <ref-list>
            <ref id="ref-1">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Agot</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Minnis</surname>
                            <given-names>AM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Manenzhe</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Engaging study participants in interpreting results: lessons from the TRIO study in Kenya and South Africa.</article-title>
                    <source>

                        <italic toggle="yes">Int J Womens Health.</italic>
</source>
                    <year>2019</year>;<volume>11</volume>:<fpage>395</fpage>&#x2013;<lpage>403</lpage>.
                    <pub-id pub-id-type="pmid">31372060</pub-id>
                    <pub-id pub-id-type="doi">10.2147/IJWH.S193905</pub-id>
                    <pub-id pub-id-type="pmcid">6636186</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bate</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Robert</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <article-title>Experience-based design: from redesigning the system around the patient to co-designing services with the patient.</article-title>
                    <source>

                        <italic toggle="yes">Qual Saf Health Care.</italic>
</source>
                    <year>2006</year>;<volume>15</volume>(<issue>5</issue>):<fpage>307</fpage>&#x2013;<lpage>310</lpage>.
                    <pub-id pub-id-type="pmid">17074863</pub-id>
                    <pub-id pub-id-type="doi">10.1136/qshc.2005.016527</pub-id>
                    <pub-id pub-id-type="pmcid">2565809</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Brady</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tolley</surname>
                            <given-names>E</given-names>
                        </name>
</person-group>:
                    <article-title>Aligning product development and user perspectives: social-behavioural dimensions of multipurpose prevention technologies.</article-title>
                    <source>

                        <italic toggle="yes">BJOG.</italic>
</source>
                    <year>2014</year>;<volume>121 Suppl 5</volume>:<fpage>70</fpage>&#x2013;<lpage>78</lpage>.
                    <pub-id pub-id-type="pmid">25335843</pub-id>
                    <pub-id pub-id-type="doi">10.1111/1471-0528.12844</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Celum</surname>
                            <given-names>CL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Delany-Moretlwe</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baeten</surname>
                            <given-names>JM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>HIV pre-exposure prophylaxis for adolescent girls and young women in Africa: from efficacy trials to delivery.</article-title>
                    <source>

                        <italic toggle="yes">J Int AIDS Soc.</italic>
</source>
                    <year>2019</year>;<volume>22 Suppl 4</volume>(<issue>Suppl Suppl 4</issue>):<fpage>e25298</fpage>.
                    <pub-id pub-id-type="pmid">31328444</pub-id>
                    <pub-id pub-id-type="doi">10.1002/jia2.25298</pub-id>
                    <pub-id pub-id-type="pmcid">6643076</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cottam</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Leadbeater</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>RED PAPER 01 HEALTH: Co-creating Services.</article-title>London, Design Council.<year>2004</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.designcouncil.org.uk/sites/default/files/asset/document/red-paper-health.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dellar</surname>
                            <given-names>RC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dlamini</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Karim</surname>
                            <given-names>QA</given-names>
                        </name>
</person-group>:
                    <article-title>Adolescent girls and young women: key populations for HIV epidemic control.</article-title>
                    <source>

                        <italic toggle="yes">J Int AIDS Soc.</italic>
</source>
                    <year>2015</year>;<volume>18</volume>(<issue>2 Suppl 1</issue>):<fpage>19408</fpage>.
                    <pub-id pub-id-type="pmid">25724504</pub-id>
                    <pub-id pub-id-type="doi">10.7448/IAS.18.2.19408</pub-id>
                    <pub-id pub-id-type="pmcid">4344544</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Giroux</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tremblay</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Latulippe</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Promoting identification and use of aid resources by caregivers of seniors: co-design of an electronic health tool.</article-title>
                    <source>

                        <italic toggle="yes">JMIR Aging.</italic>
</source>
                    <year>2019</year>;<volume>2</volume>(<issue>2</issue>):<fpage>e12314</fpage>.
                    <pub-id pub-id-type="pmid">31518284</pub-id>
                    <pub-id pub-id-type="doi">10.2196/12314</pub-id>
                    <pub-id pub-id-type="pmcid">6744817</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Guthrie</surname>
                            <given-names>KM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rohan</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rosen</surname>
                            <given-names>RK</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Vaginal film for prevention of HIV: using visual and tactile evaluations among potential users to inform product design.</article-title>
                    <source>

                        <italic toggle="yes">Pharm Dev Technol.</italic>
</source>
                    <year>2018</year>;<volume>23</volume>(<issue>3</issue>):<fpage>311</fpage>&#x2013;<lpage>314</lpage>.
                    <pub-id pub-id-type="pmid">28592183</pub-id>
                    <pub-id pub-id-type="doi">10.1080/10837450.2017.1339085</pub-id>
                    <pub-id pub-id-type="pmcid">5740013</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hussey</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Trinder-Widdess</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dee</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Co-design of harm reduction materials for people who inject drugs to implement research findings.</article-title>
                    <source>

                        <italic toggle="yes">Harm Reduct J.</italic>
</source>
                    <year>2019</year>;<volume>16</volume>(<issue>1</issue>):<fpage>36</fpage>.
                    <pub-id pub-id-type="pmid">31174536</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12954-019-0300-z</pub-id>
                    <pub-id pub-id-type="pmcid">6555749</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kerrigan</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sanchez Karver</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Muraleetharan</surname>
                            <given-names>O</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>"A dream come true": perspectives on long-acting injectable antiretroviral therapy among female sex workers living with HIV from the Dominican Republic and Tanzania.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2020</year>;<volume>15</volume>(<issue>6</issue>):<fpage>e0234666</fpage>.
                    <pub-id pub-id-type="pmid">32530939</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0234666</pub-id>
                    <pub-id pub-id-type="pmcid">7292359</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kirtane</surname>
                            <given-names>AR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Abouzid</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Minahan</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Development of an oral once-weekly drug delivery system for HIV antiretroviral therapy.</article-title>
                    <source>

                        <italic toggle="yes">Nat Commun.</italic>
</source>
                    <year>2018</year>;<volume>9</volume>(<issue>1</issue>):<fpage>2</fpage>.
                    <pub-id pub-id-type="pmid">29317618</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41467-017-02294-6</pub-id>
                    <pub-id pub-id-type="pmcid">5760734</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Koss</surname>
                            <given-names>CA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Charlebois</surname>
                            <given-names>ED</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ayieko</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Uptake, engagement, and adherence to pre-exposure prophylaxis offered after population HIV testing in rural Kenya and Uganda: 72-week interim analysis of observational data from the SEARCH study.</article-title>
                    <source>

                        <italic toggle="yes">Lancet HIV.</italic>
</source>
                    <year>2020</year>;<volume>7</volume>(<issue>4</issue>):<fpage>e249</fpage>&#x2013;<lpage>e261</lpage>.
                    <pub-id pub-id-type="pmid">32087152</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S2352-3018(19)30433-3</pub-id>
                    <pub-id pub-id-type="pmcid">7208546</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kristensson</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Magnusson</surname>
                            <given-names>PR</given-names>
                        </name>
</person-group>:
                    <article-title>Tuning users' innovativeness during ideation.</article-title>
                    <source>

                        <italic toggle="yes">Creativity and Innovation Management.</italic>
</source>
                    <year>2010</year>;<volume>19</volume>(<issue>2</issue>):<fpage>147</fpage>&#x2013;<lpage>159</lpage>.
                    <pub-id pub-id-type="doi">10.1111/j.1467-8691.2010.00552.x</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Krogstad</surname>
                            <given-names>EA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Atujuna</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Montgomery</surname>
                            <given-names>ET</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Perspectives of South African youth in the development of an implant for HIV prevention.</article-title>
                    <source>

                        <italic toggle="yes">J Int AIDS Soc.</italic>
</source>
                    <year>2018</year>;<volume>21</volume>(<issue>8</issue>):<fpage>e25170</fpage>.
                    <pub-id pub-id-type="pmid">30152004</pub-id>
                    <pub-id pub-id-type="doi">10.1002/jia2.25170</pub-id>
                    <pub-id pub-id-type="pmcid">6111144</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Latkin</surname>
                            <given-names>CA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mai</surname>
                            <given-names>NV</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ha</surname>
                            <given-names>TV</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Social desirability response bias and other factors that may influence self-reports of substance use and HIV risk behaviors: a qualitative study of drug users in Vietnam.</article-title>
                    <source>

                        <italic toggle="yes">AIDS Educ Prev.</italic>
</source>
                    <year>2016</year>;<volume>28</volume>(<issue>5</issue>):<fpage>417</fpage>&#x2013;<lpage>425</lpage>.
                    <pub-id pub-id-type="pmid">27710083</pub-id>
                    <pub-id pub-id-type="doi">10.1521/aeap.2016.28.5.417</pub-id>
                    <pub-id pub-id-type="pmcid">5268760</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Minnis</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shapley-Quinn</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ahmed</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Giving voice to the end-user: input on multipurpose prevention technologies from the perspectives of young women in Kenya and South Africa.</article-title>
                    <source>

                        <italic toggle="yes">Sexual and Reproductive Health Matters</italic>
                    </source>. Under review.</mixed-citation>
            </ref>
            <ref id="ref-17">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Minnis</surname>
                            <given-names>AM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Roberts</surname>
                            <given-names>ST</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Agot</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Young women&#x2019;s ratings of three placebo multipurpose prevention technologies for HIV and pregnancy prevention in a randomized, cross-over study in Kenya and South Africa.</article-title>
                    <source>

                        <italic toggle="yes">AIDS Behav.</italic>
</source>
                    <year>2018</year>;<volume>22</volume>(<issue>8</issue>):<fpage>2662</fpage>&#x2013;<lpage>2673</lpage>.
                    <pub-id pub-id-type="pmid">29560570</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s10461-018-2078-5</pub-id>
                    <pub-id pub-id-type="pmcid">6097726</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Montgomery</surname>
                            <given-names>ET</given-names>
                        </name>

                        <name name-style="western">
                            <surname>van der Straten</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chitukuta</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Acceptability and use of a dapivirine vaginal ring in a phase III trial.</article-title>
                    <source>

                        <italic toggle="yes">AIDS.</italic>
</source>
                    <year>2017</year>;<volume>31</volume>(<issue>8</issue>):<fpage>1159</fpage>&#x2013;<lpage>1167</lpage>.
                    <pub-id pub-id-type="pmid">28441175</pub-id>
                    <pub-id pub-id-type="doi">10.1097/QAD.0000000000001452</pub-id>
                    <pub-id pub-id-type="pmcid">5557083</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Puri</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bhattaccharjee</surname>
                            <given-names>SA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zhang</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Development of a transdermal delivery system for tenofovir alafenamide, a prodrug of tenofovir with potent antiviral activity against HIV and HBV.</article-title>
                    <source>

                        <italic toggle="yes">Pharmaceutics.</italic>
</source>
                    <year>2019</year>;<volume>11</volume>(<issue>4</issue>):<fpage>173</fpage>.
                    <pub-id pub-id-type="pmid">30970630</pub-id>
                    <pub-id pub-id-type="doi">10.3390/pharmaceutics11040173</pub-id>
                    <pub-id pub-id-type="pmcid">6523937</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shah</surname>
                            <given-names>SG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Robinson</surname>
                            <given-names>I</given-names>
                        </name>
</person-group>:
                    <article-title>Benefits of and barriers to involving users in medical device technology development and evaluation.</article-title>
                    <source>

                        <italic toggle="yes">Int J Technol Assess Health Care.</italic>
</source>
                    <year>2007</year>;<volume>23</volume>(<issue>1</issue>):<fpage>131</fpage>&#x2013;<lpage>137</lpage>.
                    <pub-id pub-id-type="pmid">17234027</pub-id>
                    <pub-id pub-id-type="doi">10.1017/S0266462307051677</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-21">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shapley-Quinn</surname>
                            <given-names>MK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Manenzhe</surname>
                            <given-names>KN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Agot</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>"We are not the same": African women's view of multipurpose prevention products in the TRIO clinical study.</article-title>
                    <source>

                        <italic toggle="yes">Int J Womens Health.</italic>
</source>
                    <year>2019</year>;<volume>11</volume>:<fpage>97</fpage>&#x2013;<lpage>107</lpage>.
                    <pub-id pub-id-type="pmid">30799959</pub-id>
                    <pub-id pub-id-type="doi">10.2147/IJWH.S185712</pub-id>
                    <pub-id pub-id-type="pmcid">6369839</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-22">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Slater</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Campbell</surname>
                            <given-names>JM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Stinson</surname>
                            <given-names>JN</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>End user and implementer experiences of mHealth technologies for noncommunicable chronic disease management in young adults: systematic review.</article-title>
                    <source>

                        <italic toggle="yes">J Med Internet Res.</italic>
</source>
                    <year>2017</year>;<volume>19</volume>(<issue>12</issue>):<fpage>e406</fpage>.
                    <pub-id pub-id-type="pmid">29233804</pub-id>
                    <pub-id pub-id-type="doi">10.2196/jmir.8888</pub-id>
                    <pub-id pub-id-type="pmcid">5743925</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-23">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Suijkerbuijk</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nap</surname>
                            <given-names>HH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cornelisse</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Active Involvement of People with Dementia: A Systematic Review of Studies Developing Supportive Technologies.</article-title>
                    <source>

                        <italic toggle="yes">J Alzheimers Dis.</italic>
</source>
                    <year>2019</year>;<volume>69</volume>(<issue>4</issue>):<fpage>1041</fpage>&#x2013;<lpage>1065</lpage>.
                    <pub-id pub-id-type="pmid">6597993</pub-id>
                    <pub-id pub-id-type="doi">10.3233/JAD-190050</pub-id>
                    <pub-id pub-id-type="pmcid">6597993</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-24">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Swain</surname>
                            <given-names>CA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sawicki</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Addison</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An end-user participatory approach to collaboratively refine HIV care data, the New York State experience.</article-title>
                    <source>

                        <italic toggle="yes">AIDS Behav.</italic>
</source>
                    <year>2019</year>;<volume>23</volume>(<issue>Suppl 1</issue>):<fpage>83</fpage>&#x2013;<lpage>93</lpage>.
                    <pub-id pub-id-type="pmid">29611095</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s10461-018-2104-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-25">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Taffe</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>The hybrid designer/end-user: Revealing paradoxes in co-design.</article-title>
                    <source>

                        <italic toggle="yes">Design Studies.</italic>
</source>
                    <year>2015</year>;<volume>40</volume>:<fpage>39</fpage>&#x2013;<lpage>59</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.destud.2015.06.003</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-26">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thilo</surname>
                            <given-names>FJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bilger</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Halfens</surname>
                            <given-names>RJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Involvement of the end user: exploration of older people's needs and preferences for a wearable fall detection device - a qualitative descriptive study.</article-title>
                    <source>

                        <italic toggle="yes">Patient Prefer Adherence.</italic>
</source>
                    <year>2017</year>;<volume>11</volume>:<fpage>11</fpage>&#x2013;<lpage>22</lpage>.
                    <pub-id pub-id-type="pmid">28053509</pub-id>
                    <pub-id pub-id-type="doi">10.2147/PPA.S119177</pub-id>
                    <pub-id pub-id-type="pmcid">5189694</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-27">
                <mixed-citation publication-type="journal">
                    <collab>UNAIDS</collab>:
                    <article-title>Global AIDS Update 2020: Seizing the moment-tackling entrenched inequalities to end epidemics.</article-title>
                    <year> 2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://reliefweb.int/report/world/global-aids-update-2020-seizing-moment-tackling-entrenched-inequalities-end-epidemics">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-28">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>van der Straten</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Agot</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ahmed</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The Tablets, Ring, Injections as Options (TRIO) study: what young African women chose and used for future HIV and pregnancy prevention.</article-title>
                    <source>

                        <italic toggle="yes">J Int AIDS Soc.</italic>
</source>
                    <year>2018</year>;<volume>21</volume>(<issue>3</issue>):<fpage>e25094</fpage>.
                    <pub-id pub-id-type="pmid">29600595</pub-id>
                    <pub-id pub-id-type="doi">10.1002/jia2.25094</pub-id>
                    <pub-id pub-id-type="pmcid">5876496</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-29">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>van Velsen</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Evers</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bara</surname>
                            <given-names>CD</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Understanding the acceptance of an eHealth technology in the early stages of development: an end-user walkthrough approach and two case studies.</article-title>
                    <source>

                        <italic toggle="yes">JMIR Form Res.</italic>
</source>
                    <year>2018</year>;<volume>2</volume>(<issue>1</issue>):<fpage>e10474</fpage>.
                    <pub-id pub-id-type="pmid">30684434</pub-id>
                    <pub-id pub-id-type="doi">10.2196/10474</pub-id>
                    <pub-id pub-id-type="pmcid">6334698</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-30">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Vogler</surname>
                            <given-names>MA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Patterson</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kamemoto</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Contraceptive efficacy of oral and transdermal hormones when co-administered with protease inhibitors in HIV-1-infected women: pharmacokinetic results of ACTG trial A5188.</article-title>
                    <source>

                        <italic toggle="yes">J Acquir Immune Defic Syndr.</italic>
</source>
                    <year>2010</year>;<volume>55</volume>(<issue>4</issue>):<fpage>473</fpage>&#x2013;<lpage>482</lpage>.
                    <pub-id pub-id-type="pmid">20842042</pub-id>
                    <pub-id pub-id-type="doi">10.1097/QAI.0b013e3181eb5ff5</pub-id>
                    <pub-id pub-id-type="pmcid">4197050</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-31">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wagner</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shapley-Quinn</surname>
                            <given-names>MK</given-names>
                        </name>
</person-group>:
                    <article-title>TRIO Project.</article-title>
                    <year> 2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.17605/OSF.IO/MYC9R">http://www.doi.org/10.17605/OSF.IO/MYC9R</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-32">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Were</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Musau</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mutegi</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Using a HIV prevention cascade for identifying missed opportunities in PrEP delivery in Kenya: results from a programmatic surveillance study.</article-title>
                    <source>

                        <italic toggle="yes">J Int AIDS Soc.</italic>
</source>
                    <year>2020</year>;<volume>23 Suppl 3</volume>(<issue>Suppl 3</issue>):<fpage>e25537</fpage>.
                    <pub-id pub-id-type="pmid">32602658</pub-id>
                    <pub-id pub-id-type="doi">10.1002/jia2.25537</pub-id>
                    <pub-id pub-id-type="pmcid">7325512</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-33">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wetter-Edman</surname>
                            <given-names>K</given-names>
                        </name>
</person-group>:
                    <article-title>Relations and rationales of user's involvement in service design and service management</article-title>.
                    <italic toggle="yes">Service Design with Theory Discussion on Value, Societal Change and Methods</italic>.&#x201d; S. Miettinen and A. Valtonen, Lapland University Press,<year>2012</year>; 105-114.</mixed-citation>
            </ref>
            <ref id="ref-34">
                <mixed-citation publication-type="journal">
                    <article-title>Discussion on Value, Societal Change and Methods.</article-title>S. Miettinen and A. Valtonen, Lapland University Press:<fpage>105</fpage>&#x2013;<lpage>114</lpage>.</mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report30511">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14386.r30511</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Asuquo</surname>
                        <given-names>Sarah E.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r30511a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-0193-1838</uri>
                </contrib>
                <aff id="r30511a1">
                    <label>1</label>UNC Gillings School of Global Public Health, Chapel Hill, NC, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>6</day>
                <month>4</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Asuquo SE</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport30511" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13182.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <bold>Methods:</bold> 
                <list list-type="bullet">
                    <list-item>
                        <p>More detail is needed in describing the translation process. It is not mentioned who was involved in translation, their proficiency in the languages translated and in the English language, how the English translation was verified, and if reverse translation was done or not.</p>
                    </list-item>
                </list> </p>
            <p> 
                <bold>Table 2:</bold> 
                <list list-type="bullet">
                    <list-item>
                        <p>Having "Total (n=165) and total for each site written at the top of the table is distracting when the numbers don't add up. Consider removing or making the footnote clearer. The footnote mentioned how many women participated in more than one qualitative activity but did not mention for which site.&#x00a0;</p>
                    </list-item>
                </list> </p>
            <p> 
                <bold>Discussion:</bold> 
                <list list-type="bullet">
                    <list-item>
                        <p>"The authors reported that only 7 of 49 studies included people with dementia in multiple phases of development and iteratively consulted them across all the four co-designer phases while, similar to our study, the majority engaged end-users in the development (38/49) and generative (25/49) phases only." -&#x00a0; The sentence is winding and unclear. Consider revising.</p>
                    </list-item>
                    <list-item>
                        <p>"As experts of their own lives, end-users should be offered an opportunity to influence the design processes of products being development for them..." - Wrong grammar. Change "being development" to "developed"</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>No source data required</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>My areas of research include qualitative research, community-based participatory research, public health, and health behavior</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report29880">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/gatesopenres.14386.r29880</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Ngure</surname>
                        <given-names>Kenneth</given-names>
                    </name>
                    <xref ref-type="aff" rid="r29880a1">1</xref>
                    <xref ref-type="aff" rid="r29880a2">2</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-8062-0933</uri>
                </contrib>
                <aff id="r29880a1">
                    <label>1</label>Department of Global Health, University of Washington, Seattle, WA, USA</aff>
                <aff id="r29880a2">
                    <label>2</label>Jomo Kenyatta University of Agriculture and Technology, Juja, Kenya</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>20</day>
                <month>11</month>
                <year>2020</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2020 Ngure K</copyright-statement>
                <copyright-year>2020</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport29880" related-article-type="peer-reviewed-article" xlink:href="10.12688/gatesopenres.13182.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <bold>Comments to the Author</bold>
            </p>
            <p> This is an interesting and well written paper focusing on how the young women who participated in the TRIO study in Kenya and South Africa perceived themselves as co-designers in the development of the three MPT products. I am recommending minor changes because I think there are a few details especially in the methods that would strengthen the paper.</p>
            <p> </p>
            <p> 
                <bold>Methods</bold>
            </p>
            <p> This is a well written manuscript. The investigators will need to provide a rationale of using the three qualitative methods - IDIs, FGDs and dissemination workshops. Also what informed the number of IDIs, FGDs, and dissemination workshops especially the IDIs - was saturation achieved?</p>
            <p> </p>
            <p> It will be good to mention the proportion of women who participated in more than one research activity e.g. how many participated in IDIs only, IDIs and FGDs, or all the three activities?</p>
            <p> </p>
            <p> Specify the number of interviewers, training, and gender to enable the reader put the findings in context. Also good to include the mean duration of the IDIs and FGDs plus the average number of participants per FGD.</p>
            <p> </p>
            <p> The analysts could also be identified by initials since if they are co-authors.</p>
            <p> </p>
            <p> Include more details of how the thematic analysis was conducted and provide relevant references where readers can refer to understand the authors analytical approach better.</p>
            <p> </p>
            <p> 
                <bold>Results</bold>
            </p>
            <p> Although the quotes are identified by interview type, I would recommend an addition of more identification for IDIs (e.g. age, marital status of the participants, etc.) because some of these attributes could influence views.</p>
            <p> </p>
            <p> It would be great to highlight the other non-key (minor) themes, even if briefly.</p>
            <p> </p>
            <p> 
                <bold>Discussion</bold>
            </p>
            <p> Could the researchers push their analysis a bit more and reflect on how these findings of these three methods agree or differ and therefore discuss surrounding points of convergence and divergence between the three groups interviewed?</p>
            <p> </p>
            <p> Further discussion of study limitations is warranted, including how the context being the larger TRIO study was likely to affect the findings and their generalizability.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>HIV prevention, behavioral research, qualitative&#x00a0; and quantitative&#x00a0; research methods</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
</article>
