Cost per insertion and couple year of protection for postpartum intrauterine devices and implants provided during service scale-up in Kigali, Rwanda

Kristin M. Wall; Rosine Ingabire; Susan Allen; Etienne Karita

doi:10.12688/gatesopenres.12858.3

Home Browse Cost per insertion and couple year of protection for postpartum intrauterine...

ALL Metrics

Views

Downloads

Get PDF

Get XML

Export

▬

✚

Research Note

Revised

Cost per insertion and couple year of protection for postpartum intrauterine devices and implants provided during service scale-up in Kigali, Rwanda

[version 3; peer review: 3 approved with reservations]

Previously titled: Cost per insertion and couple year of protection for post-partum intrauterine devices and implants provided during service scale-up in Kigali, Rwanda

Kristin M. Wall ^1,2, Rosine Ingabire³, Susan Allen², Etienne Karita³

PUBLISHED 29 Mar 2019

Author details Author details

¹ Department of Epidemiology, Rollins School of Public Health, Laney Graduate School, Emory University, Atlanta, GA, 30322, USA
² Rwanda Zambia HIV Research Group, Department of Pathology & Laboratory Medicine, School of Medicine, Rollins School of Public Health, Emory University, Atlanta, GA, 30322, USA
³ Projet San Francisco, Rwanda Zambia HIV Research Group, Department of Pathology & Laboratory Medicine, School of Medicine, Rollins School of Public Health, Emory University, Kigali, Rwanda

Kristin M. Wall
Roles: Conceptualization, Data Curation, Formal Analysis, Funding Acquisition, Investigation, Methodology, Project Administration, Supervision, Writing – Original Draft Preparation, Writing – Review & Editing

Rosine Ingabire
Roles: Data Curation, Investigation, Methodology, Project Administration, Supervision, Writing – Review & Editing

Susan Allen
Roles: Conceptualization, Funding Acquisition, Methodology, Project Administration, Resources, Writing – Review & Editing

Etienne Karita
Roles: Conceptualization, Investigation, Methodology, Project Administration, Supervision, Writing – Review & Editing

OPEN PEER REVIEW

REVIEWER STATUS

Abstract

Introduction: In two high-volume government hospitals, their two affiliated health facilities, and two additional health facilities, we developed and implemented postpartum intrauterine device (PPIUD) and postpartum (PP) implant promotional counseling and service delivery procedures between May-July 2017 in Kigali, Rwanda. Between August 2017 and July 2018, 9,073 pregnant women received PPIUD/PP implant promotions who later delivered in one of our selected facilities. Of those, 2,633 had PPIUDs inserted, and 955 had PP implants inserted. The goal of the present analysis is to detail implementation expenditures and estimate incremental costs per insertion and couple years of protection (CYP) for PPIUD and PP implant users.
Methods: We detail the incremental costs during the implementation from the health system perspective (including both the implementation costs and the cost of contraceptive methods) and use of standard methods to estimate the cost per insertion and CYP for PPIUD and PP implant users. In addition to the incremental costs of labor and supplies, the costs of promotional activities are included. Research costs for formative work were excluded.
Results: A total of $74,147 USD was spent on the implementation between August 2017 and July 2018. The largest expense (34% of total expenses) went toward personnel, including doctoral-level, administrative, data management and nurse counseling staff. Training for PPIUD and implant providers and promoters comprised 8% of total expenses. Recruitment and reimbursements comprised 6% of expenses. Costs of implants to the government comprised 12% of the expenses, much higher than the cost of IUDs (1%). Costs per insertion were $25/PPIUDs and $77/PP implant. Costs per CYP were $5/PPIUDs and $20/PP implant.
Conclusion: Understanding the cost per PPIUD/PP implant inserted and CYP can help to inform the cost of scaling up PPIUD/PP implant service implementation activities and resource allocation decision-making by the Rwandan Ministry of Health.

Keywords

Couple year of protection, post-partum, intrauterine device, contraceptive implant, Rwanda

Corresponding author: Kristin M. Wall

Competing interests: No competing interests were disclosed.

Grant information: This work was supported by the Bill & Melinda Gates Foundation [OPP1160661]. Additional support came from the Emory University Research Council Grant [URCGA16872456], Emory Global Field Experience Award, the Emory Center for AIDS Research [P30 AI050409], the National Institutes of Health [NIAID R01 AI51231; NIAID R01 AI64060; NIAID R37 AI51231], Emory AITRP Fogarty [5D43TW001042], and the International AIDS Vaccine Initiative (IAVI) [SOW2166]. The contents of this manuscript are the responsibility of the authors and do not necessarily reflect the views of the funders
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Copyright: © 2019 Wall KM et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

How to cite: Wall KM, Ingabire R, Allen S and Karita E. Cost per insertion and couple year of protection for postpartum intrauterine devices and implants provided during service scale-up in Kigali, Rwanda [version 3; peer review: 3 approved with reservations]. Gates Open Res 2019, 2:39 (https://doi.org/10.12688/gatesopenres.12858.3) First published: 31 Aug 2018, 2:39 (https://doi.org/10.12688/gatesopenres.12858.1) Latest published: 28 Feb 2020, 2:39 (https://doi.org/10.12688/gatesopenres.12858.4)

Revised Amendments from Version 2

In this revision, we clarify that the salaries paid to study coordinators and data managers were in fact for implementation. We are reporting on findings from an implementation study, and during the implementation, coordinators were responsible for arranging training activities, organizing PPIUD certifications, scheduling providers across the hospitals and health centers, and managing other implementation logistics. Data managers were responsible for extracting the government log book data to enable monitoring of PPIUD uptake and occurrence of PPIUD side-effects (e.g., infections) and expulsions. We envision that these would be regular activities required to implement and monitor a large-scale implementation. We have also addressed several minor concerns.

The Introduction has been improved with transition sentences, clarification of the country data source of Pasha et al., 2015, noting the duration of the hormonal IUD, and noting the relatively high proportion of implant use in Rwanda.

In the Discussion, we clarify that while the IUD was promoted in the context of the full range of method options, we dedicated more time to discussing the PPIUD because this method was less well known. We also discuss the importance of PPIUD provision in infant vaccination settings. Projet is spelled correctly (French spelling). Many thanks for the opportunity to further improve this manuscript.

See the authors' detailed response to the review by Aisha N.Z. Dasgupta

Introduction

Voluntary family planning (FP) is one of the most cost-effective public health interventions, reducing both maternal and child mortality and improving national economies¹. Postpartum FP in particular is critical to improve maternal-child health via birth limiting and spacing². However, there is high unmet need for family planning in the developing world, especially in postpartum periods. In postpartum periods, 61% of women across 21 low- and middle-income countries experienced unmet need³, while 95% of women across 5 countries desired to avoid pregnancy for at least 1 year after delivery⁴. In Rwanda, although only 2% of postpartum women report a desire for another child within 2 years of delivery, the unmet need in the postpartum period is 51%⁵.

To meet women’s postpartum fertility goals and improve maternal-child health via birth spacing or limiting⁶, the Rwandan government has made postpartum family planning a key objective of the Rwandan Family Planning 2020 Commitment (Objective 2: ‘Scale up the postpartum family planning (PPFP) in all health facilities in Rwanda to increase method choice including access to long term methods…’) with the goal of preventing 250,000 unintended pregnancies annually⁷.

Long-acting reversible contraceptive (LARC) methods (the hormonal and copper intrauterine device (IUD) and hormonal implant) are not only the most effective reversible methods (lasting 5–10 and 3–5 years, respectively, with typical use failure rates <1%/year), but are very cost-effective^8–12. A copper postpartum IUD (PPIUD) can be inserted immediately after delivery of the placenta, during a cesarean delivery, up to 48 hours after childbirth, or beginning at 4 weeks after delivery^13,14 (https://www.mcsprogram.org/resource/pathway-of-opportunities-for-postpartum-women-to-adopt-family-planning/). A postpartum (PP) implant can be inserted any time after delivery (https://www.mcsprogram.org/resource/pathway-of-opportunities-for-postpartum-women-to-adopt-family-planning/). and the WHO Medical Eligibility Criteria were recently revised for postpartum implants¹⁵. IUDs make up a relatively small share of method use in Rwanda (2.5% of the method mix), while implants make up 16.9% of the method mix (http://www.familyplanning2020.org/entities/81).

This relatively low uptake is thought to be related to lack of method promotions to both women and their male partners as well as limited provider comfort counseling on and delivering these methods^16–20. Because baseline knowledge about the LARC methods among potential users is lower than for other methods^21–25, demand creation strategies must include comprehensive information addressing method benefits, side-effects, and misconceptions^21,26,27. To address these issues, funding from a Bill and Melinda Gates Grand Challenge Award was received to improve PPIUD supply and demand in Kigali, Rwanda, with supplementary funding from Emory University to provide PP implant services. Briefly, in two large health centers (providing antenatal care (ANC), family planning, and infant vaccination services), their two adjoining referral hospitals (providing routine and complex labor and delivery), and two additional large health centers (providing ANC, family planning, routine labor and delivery, and infant vaccination services), Emory-based non-governmental organization Projet San Francisco (PSF) developed and implemented PPIUD and PP implant promotional counseling and service delivery procedures in August 2017. The PPIUD and PP implant were promoted during ANC and labor and delivery to target women prior to delivery. Promotions also occurred during infant vaccination visits which have been shown to be an acceptable and high-impact venue to reach postpartum women in Rwanda²⁸ and are considered a potentially high-impact target for integration since immunization services have broad reach²⁹. By July 2018, 9,073 pregnant women received PPIUD/PP implant promotions who later delivered in one of our selected facilities. Of those, 2,633 had PPIUDs inserted, and 955 had PP implants inserted. These published findings represented a significant increase in PPIUD and PP implant uptake versus the 6 months prior to our implementation (p<0.001)³⁰.

The goal of the present analysis is to detail expenditures during the implementation and estimate the incremental cost per PPIUD insertion, PP implant insertion, and couple years of protection (CYP) for PPIUD and PP implant users to inform decision-making by the Ministry of Health and to estimate the cost of scaling up activities. Importantly, in addition to the costs of labor and supplies, the costs of promotional activities are included when calculating the costs and cost-effectiveness estimates of this intervention because postpartum LARCs are still relatively unknown (this is especially true for the IUD for which baseline knowledge is low^21–25) and require a significant investment in demand creation.

Methods

PPIUD/PP Implant program development and operations

The PPIUD/PP implant intervention (described in detail previously³⁰) was developed with input from stakeholders, providers, community health workers (CHW), and couples/clients. Stakeholders included the Rwanda Ministry of Health, the District Mayors, the Rwandan Family Planning Technical Working Group, and clinic directors. Through formative work between May and July 2017, we evaluated knowledge, attitudes, and practices regarding PPIUD/PP implant services among community health workers and providers and clients/couples. This formative work led to the development of intervention operational procedures and a promotional counseling flipchart to be delivered to women or couples. Promotional counseling was conducted primarily by counselors during ANC, labor and delivery, and infant vaccination services or within the community by CHW. In addition, dedicated promoters were hired to administer promotions. In August of 2017, nurses and midwives working in labor and delivery and family planning departments began training in PPIUD insertions (implant insertion training had been previously provided). Clinic staff and CHWs were trained to promote the PPIUD/PP implant services. Follow-up appointments were scheduled for PPIUD clients within 6 weeks after PPIUD insertion (typically coinciding with the 6-week infant vaccination visit).

Pre-intervention postpartum LARC services were conducted by two national PPIUD trainers located at two of our selected district hospitals. One of these national PPIUD trainers was collecting PPIUD insertion and follow-up data in a logbook specifically for PPIUD services. In the 6-months prior to our intervention (from February-July 2017), n=46 PPIUDs were inserted (average of 7.7 insertions/month) and n=182 PP implants were inserted (average of 30.0 insertions/month) in the selected health facilities. The percent increase comparing monthly PPIUD insertions between February-July 2017 to our intervention period of August 2017-July 2018 was 2,687% for PPIUD and 169% for PP implant.

Incremental PPIUD/PP implant program costs

We used a standard, comprehensive micro-costing approach as recommended to calculate the incremental cost of the PPIUD/PP implant intervention from the health system perspective³¹. Using standardized data collection tools, resource use data was collected from expenditure records, study case report forms, and interviews with program implementers. Costs of labor, promotions, and supplies are included as detailed below, and no research costs are included. Thus, the costs included are the incremental costs required to implement the promotional counseling and service delivery intervention above the minimal existing pre-intervention postpartum LARC services described above. Study coordinators and the nurse counselor were responsible for arranging training activities, organizing PPIUD certifications, scheduling providers across the hospitals and health centers, and other implementation logistics. The data manager was responsible for extracting and recording the government logbook data to enable monitoring of PPIUD uptake and occurrence of PPIUD side-effects (e.g., infections) and expulsions. We envision that these would be regular activities required to implement and monitor a large-scale implementation. Part-time salaries and fringe were provided for three Emory staff and the PSF Director. PSF-based personnel included a dedicated physician with part-time support from two project physicians, two study coordinators, a senior nurse counselor, a data manager, and two promotions managers.

Per diems were provided for trainees during training activities. Training costs included the costs of training providers to insert PPIUDs during a 2-day didactic training and mentored practical certification process, and the costs of training PPIUD/PP implant promotional agents. Field travel included travel for Emory-based staff and transportation for local staff. Field travel was required to transport staff to trainings (which would be recurring during future implementation stages) and the implementation clinics. Other field expenses included wire transfer fees, transcription and translation services, and meals during trainings. Transcription and translation services were required to produce implementation tools in two of the main languages spoken in Rwanda (Kinyarwanda and French).

Recruitment/reimbursement expenses began in February/March 2018 and included: PPIUD client transport reimbursement for follow-up visits ($2.29 United States Dollars [USD]/client), reimbursements for CHW promoters ($0.57 USD/client presenting their referral when requesting a PPIUD or PP implant), reimbursements for providers ($1.20 USD/PPIUD and $0.57 USD/PP implant insertion), and reimbursements to the selected facilities for administrative costs associated with implementing the PPIUD/PP implant program ($57 USD/facility/month). CHW and clinic provider reimbursements used the Rwandan performance-based-financing (PBF) system as a guide³². Reimbursements for providers included the cost of providers’ time/labor to provide insertions. This was provided to them in addition to their regular salary (the average monthly salary for family planning or labor and delivery nurses is $124-364 USD, depending on their education). Communications expenses included internet and phone airtime for staff. Field consumables/office supplies included specula, forceps, batteries, logbooks, chargers for tablets, PPIUD kits and various office supplies. Tablets were used to collect data from logbooks for quality assurance/control.

We also included the cost of methods (estimated from the prices incurred by the United Nations Population Fund (UNFPA) in 2015 of $0.37 USD per copper T380 IUD and $8.93 USD per Jadelle levonorgestrel rod implant (http://mshpriceguide.org/en/home/), and converted to 2018 USD ($0.39 and $9.49 USD, respectively). Expenditures are reported by activity in 2018 USD.

Only implementation costs related to service provision were included (i.e., we did not include research costs for formative work conducted between May and July 2017). Thus, the expenses presented represent the frontline incremental costs required to implement the program between August 2017 and July 2018 from the health system perspective. No discounting of costs was performed given the short time horizon. We follow the Consolidated Health Economic Evaluation Reporting Standards³¹.

PPIUD/PP implant program outcomes

Outcomes of interest include the number of PPIUDs and PP implants inserted and the cumulative couple years of protection (CYP) for PPIUD and PP implant users. CYP is a commonly used estimate of the length of contraceptive protection against pregnancy provided per unit of that method and is estimated at 4.6 for the Copper T380 IUD and 3.8 CYP for Jadelle (5 year) implant³³ (https://www.usaid.gov/what-we-do/global-health/family-planning/couple-years-protection-cyp). Using the incremental cost measures and outcomes of interest, we calculated the cost per PPIUD inserted, cost per PP implant inserted, cost per CYP for PPIUD users, and cost per CYP for PP implant users. No discounting of outcomes was performed given the short time horizon of the 12-month implementation.

Ethical considerations and consent

The Emory University Institutional Review Board (IRB) and the Rwanda National Ethics Committee (RNEC) approved the research component of the project (IRB 00001497). Written informed consent was obtained from all participants prior to enrollment. The Emory University IRB determined the programmatic service delivery component of the project (PPIUD promotions and insertions performed in government clinics) was exempt from review.

Results

Raw data for this study are available in Dataset 1³⁴.

Incremental PPIUD/PP implant program costs

Program costs are summarized in Table 1. A total of $74,147 USD was spent on the implementation between August 2017 and July 2018. The largest expense (34% of total expenses) went toward personnel, including doctoral-level (MD and PhD) staff, and administrative, data management and nurse counseling staff. Trainings for PPIUD and implant promotional counselors and PPIUD providers comprised 8% of total expenses. Recruitment and reimbursements comprised 6% of expenses. Costs of implants to the government comprised 12% of the expenses, much higher than the cost of IUDs (1%).

Table 1. Allocation of costs for the PPIUD/PP implant implementation by activity (August 2017–July 2018).

Only direct costs included; all costs in 2018 USD.

Costs incurred by implementation team	USD	Percentage of total
Salaries and fringe: PSF and clinic staff	$25,051	34%
Salaries and fringe: Emory employees	$14,225	19%
Trainings	$6,099	8%
Field travel	$5,363	7%
Other field expenses	$5,820	8%
Recruitment/reimbursement	$4,510	6%
Communication	$1,427	2%
Field consumables/office supplies	$1,129	2%
Field facilities	$433	1%
Cost of methods
Cost of implants*	$9,063	12%
Cost of IUDs*	$1,027	1%
Total Expenses	$74,147

*$0.39/IUD and $9.49/implant (2018 USD). PPIUD, postpartum intrauterine device; PP, postpartum, IUD, intrauterine device; USD, United States Dollars.

PPIUD/PP implant program outcomes

Program outcomes are summarized in Table 2. Costs per insertion were $25/PPIUDs and $77/PP implant. Costs per CYP were $5/PPIUDs and $20/PP implant.

Table 2. Outcomes of interest for the PPIUD/PP implant implementation (August 2017–July 2018).

All costs in 2018 USD.

IUD outcomes	Value
PPIUDs inserted (N)	2,633
Cumulative CYP for PPIUD users*	12,112
Cost per PPIUD inserted	$25
Cost per CYP for PPIUD users	$5
Implant outcomes
PP Implants inserted (N)	955
Cumulative CYP for PP implant users*	3,629
Cost per PP implant inserted	$77
Cost per CYP for PP implant users	$20

*Assumes CYP for IUD is 4.6 and for the Jadelle implant is 3.8. PPIUD, postpartum intrauterine device; PP, postpartum; CYP, couple years of protection; USD, United States Dollars.

Discussion

Our implementation provided services at a cost per insertion of $25 and $77 for the PPIUD and PP implant, respectively, and CYP of $5 and $20 for the PPIUD and PP implant, respectively. Understanding the cost per PPIUD/PP implant inserted can help to inform decision-making by the Ministry of Health and to estimate the cost of scaling up PPIUD/PP implant service implementation activities. Since cost per CYP is a standard and commonly used measure, our estimates of cost of CYP also help the government to determine contraception funding priorities.

For comparison, in a previous study conducted in Rwanda, 478 PPIUDs were inserted over 15 months in 12 sites at an incremental cost of $95,004 USD. After amortization of training costs over three years, investigators estimated outcomes of $110/PPIUD inserted and $24/CYP for the PPIUD¹⁶.

Though few additional postpartum contraception studies exist for comparability, other studies (summarized in Table 3) have made estimates of method cost per CYP, though not specifically in postpartum periods. The World Bank estimated that the cost per CYP for reversible modern methods in Ethiopia, Uganda, Burkina Faso, and Cameroon was lowest for the IUD ($4.14-$23.35), while the costs per CYP for oral contraceptive pills (OCPs) ($17.00-$31.45) and implants and injectables ($19.84-$58.54) were much higher³⁵. Using data from 13 USAID tier one priority reproductive health countries and service delivery costs, researchers estimated that the cost per CYP was $1.37 for the copper IUD, $4.67 for Sino-Implant, $7.07 for DMPA, $6.88 for combined OCPs, and $4.06 for Jadelle³⁶. Finally, a study in Zambia estimated costs per CYP were $8.69 for the IUD and $15.15 for the implant³⁷.

Table 3. Comparison of CYP for different contraceptive methods (not specifically postpartum) from select studies.

Method	CYP	Reference
Copper IUD	$1.37-$23.35	35–37
Implant	$4.06-$15.15	36, 37
OCP	$6.88-$31.45	35, 36
DMPA injectables	$7.07	36
Implants and injectables (combined in four of the studies included)	$19.84-$58.54	35

CYP, couple years of protection; IUD, intrauterine device; OCP, oral contraceptive pill; DMPA, depot medroxyprogesterone acetate

The CYP for the PPIUD and PP implant in our study were within the range of these other non-postpartum focused studies. Although it is difficult to compare estimates of cost per CYP across studies because of different approaches to measuring and including costs and because of the different implementation models used (for example, Neukom et al.³⁷ used a dedicated provider model whereas in our study PPIUD and PP implant services were provided by existing providers in addition to their regular duties with promotions being conducted by those providers and dedicated promoters), these studies indicate that the IUD has the lowest cost per CYP versus other reversible methods, and that estimated costs per CYP are generally higher for the implant versus the IUD, largely because of difference in commodity costs (http://mshpriceguide.org/en/home/).

Importantly, these studies did not include the cost of demand creation activities. The cost of promotional counseling activities is important for implementers to consider when evaluating postpartum and LARC-focused interventions because postpartum LARCs are still relatively unknown and require a significant investment in demand creation. Studies support that such promotional activities should also educate men^38–41, as done in this study, which incurs additional costs above focusing promotional activities on women alone. Once social diffusion is achieved and the target population is knowledgeable about postpartum LARC methods, demand creation activities can decrease.

While the IUD was promoted in the context of the full range of method options, we dedicated more time to discussing the PPIUD because it is the least well-known method in sub-Saharan Africa, including in Rwanda^22,42–45, which explains the relatively high uptake of the IUD relative to the implant. Other LARC implementation studies have observed that the implant is more popular than the IUD^46,47 but that this trend shifts after focused IUD educational and counseling efforts, community-based and media efforts, and provider refresher IUD trainings^25,48. Thus, though the IUD is less well-known versus the implant in much of sub-Saharan Africa^{22,42,43,45,49} and providers may have lower baseline comfort promoting and inserting IUDs^18–20, concerted promotional counseling and training efforts can be successfully employed as was achieved in these examples and our study to increase IUD demand.

There is very limited literature on the cost of the PP implant, making our findings timely especially in light of the WHO Medical Eligibility Criteria (MEC) updates related to the postpartum implant¹⁵. Women who are <6 weeks postpartum and breastfeeding can use the implant with a MEC of 2 (meaning the method is generally recommended) while all other women can use the implant regardless of breastfeeding with a MEC of 1 (meaning no restrictions on use). Given the preference for the implant observed in some studies^46,47, if the commodity costs for implants were reduced this method could become even more affordable for health systems to scale-up.

Limitations

Similar to the other studies cited here, we included costs from the health system perspective only; however, we recognize that more detailed costing analyses including the societal perspective including women’s time and the value of their time would be informative and may strengthen evidence to increase LARC services (since women are saved time traveling to clinic for OCP refills or 3-monthly injectables). It would have also been informative to estimate the cost per promotional method employed (e.g., promotions occurring during ANC, labor and delivery, infant vaccination, or delivered in the community by CHW), but as many women received multiple promotions from several places and our promotional strategies evolved over time, this was not possible in the present study. Given our short time horizon, we did not amortize our training costs as in another PPIUD/PP implant in Rwanda¹⁶, though the education provided during trainings may translate into service provision over several years in the future; amortization would have decreased our estimated costs per insertion and CYP. We did not collect the data needed to divide the costs of consumables such as specula by their number of uses to arrive at per insertion costs. Additional supplies such as alcohol pads and gauze were among government supplies used and were not measured or included in our calculations. It is not certain whether the cost outcomes estimated here would apply directly larger scale-up activities. We hypothesize that economies of scale may be gained, for example when training a larger number of nurses simultaneously, but it remains to be seen whether quality services can be provided for the same (or reduced) CYP at scale. Finally, our results are most generalizable to sub-Saharan African countries.

Conclusions

There is consensus in the international community that greater investment in postpartum family planning, and the IUD in particular, is needed. We have developed a successful, multi-level intervention that increases PPIUD and PP implant uptake that has relatively low costs per insertion and CYP. Future analyses will explore whether the intervention is cost-effective (or potentially cost-saving).

Data availability

Underlying data are available from Harvard Dataverse. Dataset 1: Replication Data for an interim evaluation of a multi-level intervention to improve postpartum intrauterine device (PPIUD) services in Rwanda (https://doi.org/10.7910/DVN/WLZ7PC)³⁴.

Data are available under a Creative Commons Zero (“CC0”) Public Domain Dedication Waiver.

Grant information

This work was supported by the Bill & Melinda Gates Foundation [OPP1160661]. Additional support came from the Emory University Research Council Grant [URCGA16872456], Emory Global Field Experience Award, the Emory Center for AIDS Research [P30 AI050409], the National Institutes of Health [NIAID R01 AI51231; NIAID R01 AI64060; NIAID R37 AI51231], Emory AITRP Fogarty [5D43TW001042], and the International AIDS Vaccine Initiative (IAVI) [SOW2166]. The contents of this manuscript are the responsibility of the authors and do not necessarily reflect the views of the funders.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

F1000 recommended

References

1. Guttmacher Institute: Adding it up: Investing in Contraception and Maternal and Newborn Health, 2017. 2017; [cited 2018 June 15]. Reference Source
2. WHO: Report of a technical consultation on birth spacing. Geneva, Switzerland. 2005; Accessed 25 March 2019. Reference Source
3. Moore Z, Pfitzer A, Gubin R, et al.: Missed opportunities for family planning: an analysis of pregnancy risk and contraceptive method use among postpartum women in 21 low- and middle-income countries. Contraception. 2015; 92(1): 31–9. PubMed Abstract | Publisher Full Text
4. Pasha O, Goudar SS, Patel A, et al.: Postpartum contraceptive use and unmet need for family planning in five low-income countries. Reprod Health. 2015; 12 Suppl 2: S11. PubMed Abstract | Publisher Full Text | Free Full Text
5. USAID, MCHIP: Family planning needs during the first two years postpartum in Rwanda. 2010; [cited 2018 August 3]. Reference Source
6. Rutstein SO: Effects of preceding birth intervals on neonatal, infant and under-five years mortality and nutritional status in developing countries: evidence from the demographic and health surveys. Int J Gynaecol Obstet. 2005; 89 Suppl 1: S7–24. PubMed Abstract | Publisher Full Text
7. Government of Rwanda Ministry of Health: Family Planning 2020 Commitment. 2017; [cited June 15 2018]. Reference Source
8. NICE Clinical Guidelines, No. 30: Long-acting Reversible Contraception: The Effective and Appropriate Use of Long-Acting Reversible Contraception. Chapter 8: Economic evaluation. National Collaborating Centre for Women’s and Children’s Health (UK). London: RCOG Press; 2005. PubMed Abstract
9. Shoupe D: LARC methods: entering a new age of contraception and reproductive health. Contracept Reprod Med. 2016; 1: 4. PubMed Abstract | Publisher Full Text | Free Full Text
10. Lynch M, De Abreu Lourenco R, Flattery M, et al.: Reviewing the cost-effectiveness of long-acting reversible contraceptive methods in an Australian context. Aust N Z J Obstet Gynaecol. 2018. PubMed Abstract | Publisher Full Text
11. Mavranezouli I, LARC Guideline Development Group: The cost-effectiveness of long-acting reversible contraceptive methods in the UK: analysis based on a decision-analytic model developed for a National Institute for Health and Clinical Excellence (NICE) clinical practice guideline. Hum Reprod. 2008; 23(6): 1338–45. PubMed Abstract | Publisher Full Text
12. Family Health International: Addressing Unmet Need for Family Planning in Africa: Long-Acting and Permanent Methods. 2005; [cited 2017 April 18]. Reference Source
13. Lopez LM, Bernholc A, Hubacher D, et al.: Immediate postpartum insertion of intrauterine device for contraception. Cochrane Database Syst Rev. 2015; (6): CD003036. PubMed Abstract | Publisher Full Text
14. Sonalkar S, Kapp N: Intrauterine device insertion in the postpartum period: a systematic review. Eur J Contracept Reprod Health Care. 2015; 20(1): 4–18. PubMed Abstract | Publisher Full Text
15. Medical eligibility criteria for contraceptive use. Fifth Edition. World Health Organisation. 2015. Reference Source
16. FHI360: Assessing the Feasibility of Postpartum IUD Provision in Rwanda. 2013; [cited 2018 January 15]. Reference Source
17. Khu NH, Vwalika B, Karita E, et al.: Fertility goal-based counseling increases contraceptive implant and IUD use in HIV-discordant couples in Rwanda and Zambia. Contraception. 2013; 88(1): 74–82. PubMed Abstract | Publisher Full Text | Free Full Text
18. Robinson N, Moshabela M, Owusu-Ansah L, et al.: Barriers to Intrauterine Device Uptake in a Rural Setting in Ghana. Health Care Women Int. 2016; 37(2): 197–215. PubMed Abstract | Publisher Full Text | Free Full Text
19. Greene E, Stanback J: Old barriers need not apply: opening doors for new contraceptives in the developing world. Contraception. 2012; 85(1): 11–4. PubMed Abstract | Publisher Full Text
20. Osei I, Birungi H, Addico G, et al.: What happened to the IUD in Ghana? Afr J Reprod Health. 2005; 9(2): 76–91. PubMed Abstract | Publisher Full Text
21. Bryant AG, Kamanga G, Stuart GS, et al.: Immediate postpartum versus 6-week postpartum intrauterine device insertion: a feasibility study of a randomized controlled trial. Afr J Reprod Health. 2013; 17(2): 72–79. PubMed Abstract
22. Tibaijuka L, Odongo R, Welikhe E, et al.: Factors influencing use of long-acting versus short-acting contraceptive methods among reproductive-age women in a resource-limited setting. BMC Womens Health. 2017; 17(1): 25. Publisher Full Text
23. Grabbe K, Stephenson R, Vwalika B, et al.: Knowledge, use, and concerns about contraceptive methods among sero-discordant couples in Rwanda and Zambia. J Womens Health (Larchmt). 2009; 18(9): 1449–56. PubMed Abstract | Publisher Full Text | Free Full Text
24. Gutin SA, Mlobeli R, Moss M, et al.: Survey of knowledge, attitudes and practices surrounding the intrauterine device in South Africa. Contraception. 2011; 83(2): 145–50. PubMed Abstract | Publisher Full Text
25. Rattan J, Noznesky E, Curry DW, et al.: Rapid Contraceptive Uptake and Changing Method Mix With High Use of Long-Acting Reversible Contraceptives in Crisis-Affected Populations in Chad and the Democratic Republic of the Congo. Glob Health Sci Pract. 2016; 4 Suppl 2: S5–S20. PubMed Abstract | Publisher Full Text | Free Full Text
26. Brunie A, Tolley EE, Ngabo F, et al.: Getting to 70%: barriers to modern contraceptive use for women in Rwanda. Int J Gynaecol Obstet. 2013; 123 Suppl 1: e11–e15. PubMed Abstract | Publisher Full Text
27. Anguzu R, Tweheyo R, Sekandi JN, et al.: Knowledge and attitudes towards use of long acting reversible contraceptives among women of reproductive age in Lubaga division, Kampala district, Uganda. BMC Res Notes. 2014; 7: 153. PubMed Abstract | Publisher Full Text | Free Full Text
28. Dulli LS, Eichleay M, Rademacher K, et al.: Meeting Postpartum Women's Family Planning Needs Through Integrated Family Planning and Immunization Services: Results of a Cluster-Randomized Controlled Trial in Rwanda. Glob Health Sci Pract. 2016; 4(1): 73–86. PubMed Abstract | Publisher Full Text | Free Full Text
29. Family Planning and Immunization Integration: Reaching postpartum women with family planning services. 2019; Accessed March 25, 2019. Reference Source
30. Ingabire R, Nyombayire J, Hoagland A, et al.: Evaluation of a multi-level intervention to improve postpartum intrauterine device services in Rwanda [version 2; referees: 2 approved, 1 approved with reservations]. Gates Open Res. 2018; 2: 38. Publisher Full Text
31. Husereau D, Drummond M, Petrou S, et al.: Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Int J Technol Assess Health Care. 2013; 29(2): 117–22. PubMed Abstract | Publisher Full Text
32. Rusa L, Ngirabega Jde D, Janssen W, et al.: Performance-based financing for better quality of services in Rwandan health centres: 3-year experience. Trop Med Int Health. 2009; 14(7): 830–7. PubMed Abstract | Publisher Full Text
33. Stover J, Bertrand JT, Shelton JD: Empirically based conversion factors for calculating couple-years of protection. Eval Rev. 2000; 24(1): 3–46. PubMed Abstract | Publisher Full Text
34. Wall K: Replication Data for: an interim evaluation of a multi-level intervention to improve post-partum intrauterine device (PPIUD) services in Rwanda. Harvard Dataverse. 2018. http://www.doi.org/10.7910/DVN/WLZ7PC
35. Babigumira JB, Vlassoff M, Ahimbisibwe A, et al.: Surgery for Family Planning, Abortion, and Postabortion Care. In Essential Surgery: Disease Control Priorities. Third Edition, H.T. Debas, et al., Editors. The International Bank for Reconstruction and Development / The World Bank: Washington DS. p. Table 7.3: Annual Cost per CYP of Contraceptive Methods in Selected African Countries. 2015. PubMed Abstract | Publisher Full Text
36. Rademacher K, Solomon M, Brett T, et al.: Expanding Access to a New More Affordable Levonorgestrel Intrauterine System in Kenya: Service Delivery Costs Compared With Other Contraceptive Methods and Perspectives of Key Opinion Leaders. Glob Health Sci Pract. 2016; 4 Suppl 2: S83–S93. PubMed Abstract | Publisher Full Text | Free Full Text
37. Neukom J, Chilambwe J, Mkandawire J, et al.: Dedicated providers of long-acting reversible contraception: new approach in Zambia. Contraception. 2011; 83(5): 447–52. PubMed Abstract | Publisher Full Text
38. Saeed GA, Fakhar S, Rahim F, et al.: Change in trend of contraceptive uptake--effect of educational leaflets and counseling. Contraception. 2008; 77(5): 377–81. PubMed Abstract | Publisher Full Text
39. Vernon R: Meeting the family planning needs of postpartum women. Stud Fam Plann. 2009; 40(3): 235–45. PubMed Abstract | Publisher Full Text
40. Keogh SC, Urassa M, Kumogola Y, et al.: Postpartum Contraception in Northern Tanzania: Patterns of Use, Relationship to Antenatal Intentions, and Impact of Antenatal Counseling. Stud Fam Plann. 2015; 46(4): 405–422. PubMed Abstract | Publisher Full Text
41. Mullany LC, Lee TJ, Yone L, et al.: Impact of community-based maternal health workers on coverage of essential maternal health interventions among internally displaced communities in eastern Burma: the MOM project. PLoS Med. 2010; 7(8): e1000317. PubMed Abstract | Publisher Full Text | Free Full Text
42. Ayad M, Hong R: Further Analysis of the Rwanda Demographic and Health Surveys, 2000-2007/08: Levels and Trends of Contraceptive Prevalence and Estimate of Unmet Need for Family Planning in Rwanda. Accessed Nov 14, 2017. Reference Source
43. United Nations, Department of Economic and Social Affairs, Population Division:Trends in Contraceptive Use Worldwide 2015. ST/ESA/SER.A/349. 2015. Reference Source
44. National Institute of Statistics of Rwanda (NISR) [Rwanda], Ministry of Health (MOH) [Rwanda], ICF International: Rwanda Demographic and Health Survey. Accessed Nov 14, 2017. Reference Source
45. National Institute of Statistics of Rwanda (NISR) [Rwanda] MoHM, ], and ICF International: 2014-15 Rwanda Demographic Health Survey Key Findings. 2015. Reference Source
46. Duvall S, Thurston S, Weinberger M, et al.: Scaling up delivery of contraceptive implants in sub-Saharan Africa: operational experiences of Marie Stopes International. Glob Health Sci Pract. 2014; 2(1): 72–92. PubMed Abstract | Publisher Full Text | Free Full Text
47. Ngo TD, Nuccio O, Pereira SK, et al.: Evaluating a LARC Expansion Program in 14 Sub-Saharan African Countries: A Service Delivery Model for Meeting FP2020 Goals. Matern Child Health J. 2017; 21(9): 1734–1743. PubMed Abstract | Publisher Full Text | Free Full Text
48. Bellows B, Mackay A, Dingle A, et al.: Increasing Contraceptive Access for Hard-to-Reach Populations With Vouchers and Social Franchising in Uganda. Glob Health Sci Pract. 2017; 5(3): 446–455. PubMed Abstract | Publisher Full Text | Free Full Text
49. Rwanda FP2020 Core Indicator Summary Sheet: 2017. 2017. Reference Source

Comments on this article Comments (0)

Version 4

VERSION 4 PUBLISHED 31 Aug 2018

Author details Author details

Rosine Ingabire
Roles: Data Curation, Investigation, Methodology, Project Administration, Supervision, Writing – Review & Editing

Susan Allen
Roles: Conceptualization, Funding Acquisition, Methodology, Project Administration, Resources, Writing – Review & Editing

Etienne Karita
Roles: Conceptualization, Investigation, Methodology, Project Administration, Supervision, Writing – Review & Editing

Competing interests

No competing interests were disclosed.

Grant information

Article Versions (4)

version 4

Revised

Published: 28 Feb 2020, 2:39

https://doi.org/10.12688/gatesopenres.12858.4

version 3

Revised

Published: 29 Mar 2019, 2:39

https://doi.org/10.12688/gatesopenres.12858.3

version 2

Revised

Published: 08 Feb 2019, 2:39

https://doi.org/10.12688/gatesopenres.12858.2

version 1

Published: 31 Aug 2018, 2:39

https://doi.org/10.12688/gatesopenres.12858.1

© 2019 Wall KM et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Download

Export To

metrics

	Views	Downloads
Gates Open Research	-	-
PubMed Central Data from PMC are received and updated monthly.	-	-

Citations

SEE MORE DETAILS

CITE

how to cite this article

Wall KM, Ingabire R, Allen S and Karita E. Cost per insertion and couple year of protection for postpartum intrauterine devices and implants provided during service scale-up in Kigali, Rwanda [version 3; peer review: 3 approved with reservations]. Gates Open Res 2019, 2:39 (https://doi.org/10.12688/gatesopenres.12858.3)

NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.

track

receive updates on this article

Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?

Key to Reviewer Statuses VIEW HIDE

ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested

Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.

Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions

Version 3

VERSION 3

PUBLISHED 29 Mar 2019

Revised

Views

Reviewer Report 09 Sep 2019

Aisha N.Z. Dasgupta, United Nations Population Division, New York, NY, USA

Approved with Reservations

https://doi.org/10.21956/gatesopenres.14061.r27631

Thank you for the opportunity to review this paper, which provides useful insights into cost per method, and cost per CYP, for postpartum IUD/implants. It is a helpful contribution to the literature because of the evidence around value for money ... Continue reading

In the first paragraph, I was at times a little confused when you write about unmet need during the postpartum period. Is this about need at that particular point in time based on prospective fertility intentions, or were women determined to have unmet need based on their retrospective fertility intentions regarding their current pregnancy/most recent birth? For example, “In Rwanda, although only 2% of postpartum women report a desire for another child within 2 years of delivery, the unmet need in the postpartum period is 51%”. Is this 51% based on prospective fertility intentions which suggests a current unmet need? Or is some of this 51% based on the retrospective fertility intentions regarding the most recent birth? This is important to know as it influences how to interpret such a figure. If a notable portion of the 51% is based on retrospective fertility intentions, then it does not necessarily follow that postpartum family planning services is the answer to addressing high levels of unmet need, as these postpartum women might not be currently at risk of unintended pregnancy. Instead it could point to a general failure of services that lead to women having an unintended pregnancy (not necessarily during the postpartum period) who then appear in the unmet need estimate simply based on their retrospective reports of fertility intentions. I think it is important to know, because it helps us to understand exposure to unintended pregnancy during the postpartum period (I come back to this again later), and justifies the interest in the postpartum period and any related postpartum FP interventions.
Related to this, perhaps the authors could point to other reasons why there is interest in interventions during the postpartum period. E.g. an opportunity to engage with and target women as they are typically already in contact with the health care system for themselves and their infants (ANC, labor/delivery, vaccinations etc.).
A general comment for the paper: My main reservation is there is no mention of the risk of pregnancy in this population during the postpartum period, and the implications for the analysis. For example, I would like to know a little more information about any practice of postpartum abstinence, and how long is postpartum amenorrhea? What are the breastfeeding practices in this population? It would be possible to provide this type of information on duration of postpartum insusceptibility from the Demographic and Health Survey and perhaps other sources. I took a quick look at the 2014-2015 DHS and it looks like women are either still amenorrheic or still abstaining for around one year.
As the authors explain, a strength of LARCs is they can provide protection for 5-10 (IUD) and 3-5 (implant) years, and the CYP is 4.6 for IUD and 3.8 for implant. But, is it fair to claim full CYPs in this analysis, when it is known that the population being provided with IUDs and implants are on average at lower risk of pregnancy, at least for around the first year postpartum? This is a limitation of the analysis and should be acknowledged in the discussion.

Methods:

Could you comment on the reimbursements to promoters and providers and why it was different for the two methods? What kinds of incentives did this create and could it have influenced which method was being recommended to potential clients?

Results:

There is an impressive number of study participants. Could you give any information on number of refusals to participate in the study? Is there any information on IUD/implant removals/discontinuation, side-effects, dissatisfaction?
The results section seems a little thin. I was curious to know anything about the clients that were reached – is there any demographic information – age, marital status, education, wealth – anything? Were there any differences between implant/IUD users, in terms of background characteristics? This might help the reader to understand the value for money in terms of the two methods, particularly if one method was more popular with a hard-to-reach group.
Could you provide a little more understanding of why implants were more expensive? Is this only because the commodity is more expensive, or were there other factors as well? Would the cost per PP implant have been lower, if a larger number of clients had been reached?

Discussion:

I note in Table 3 such a wide range of estimates of cost per CYP for IUD, which is quite hard to interpret. In Table 3, should the title of the table and/or the column title be “cost per CYP”, rather than “CYP”? Perhaps you could also provide a column providing the CYP itself for each of these methods.
“The CYP for the PPIUD and PP implant in our study were within the range of these other non-postpartum focused studies.” Do you mean the “cost per CYP”?
I appreciate your second-to-last paragraph in the discussion, on the possibility of IUDs in sub-Saharan Africa.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Partly

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Demography, family planning

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

CITE

Report a concern

Author Response 28 Feb 2020

Kristin Wall, Department of Epidemiology, Rollins School of Public Health, Laney Graduate School, Emory University, Atlanta, 30322, USA

28 Feb 2020

Author Response

We appreciate these thoughtful comments which have further improved the manuscript.

In the introduction, we clarify that the estimate of 51% unmet need is based on a prospective assessment as a ... Continue reading We appreciate these thoughtful comments which have further improved the manuscript.

In the introduction, we clarify that the estimate of 51% unmet need is based on a prospective assessment as a less biased means to predict women’s family planning need in the postpartum period. We now highlight in the introduction the sizeable opportunity to provide PPFP counseling/services at timepoints when women are already engaged in the healthcare system. The CYP for the contraceptive methods are now calculated adjusting to remove any ‘double coverage’ caused by overlap with post-partum insusceptibility, and we discuss changes in postpartum pregnancy risk as well as frequency of breastfeeding, LAM, and periodic abstinence in this population. Reimbursements for providers were higher for the IUD versus the implant because IUD insertion required additional training and certification time and each IUD takes longer to insert versus an implant. For further context, we now describe (as reported previously and in an upcoming publication), of women to whom we promoted PPFP to who delivered at a study facility, 11% selected the implant and 29% the selected the IUD. The average age and parity of women selecting the IUD or implant, as well as frequency of removals, side-effects, pain/anxiety during insertion, and satisfaction are now reported. An improved understanding of differences in women who uptake the IUD versus implant (versus another method entirely) would be informative for future scale-up, as now mentioned. We clarify that the driver of the difference in implant versus IUD costs are commodity costs. The wide range of cost per CYP estimates from other studies are related to variation across countries in costs of trainings; consumable supplies; instruments; and labor for counseling, insertion, removal, and resupply.
We appreciate these thoughtful comments which have further improved the manuscript.

In the introduction, we clarify that the estimate of 51% unmet need is based on a prospective assessment as a less biased means to predict women’s family planning need in the postpartum period. We now highlight in the introduction the sizeable opportunity to provide PPFP counseling/services at timepoints when women are already engaged in the healthcare system. The CYP for the contraceptive methods are now calculated adjusting to remove any ‘double coverage’ caused by overlap with post-partum insusceptibility, and we discuss changes in postpartum pregnancy risk as well as frequency of breastfeeding, LAM, and periodic abstinence in this population. Reimbursements for providers were higher for the IUD versus the implant because IUD insertion required additional training and certification time and each IUD takes longer to insert versus an implant. For further context, we now describe (as reported previously and in an upcoming publication), of women to whom we promoted PPFP to who delivered at a study facility, 11% selected the implant and 29% the selected the IUD. The average age and parity of women selecting the IUD or implant, as well as frequency of removals, side-effects, pain/anxiety during insertion, and satisfaction are now reported. An improved understanding of differences in women who uptake the IUD versus implant (versus another method entirely) would be informative for future scale-up, as now mentioned. We clarify that the driver of the difference in implant versus IUD costs are commodity costs. The wide range of cost per CYP estimates from other studies are related to variation across countries in costs of trainings; consumable supplies; instruments; and labor for counseling, insertion, removal, and resupply.
Competing Interests: No competing interests were disclosed. Close
Report a concern
Respond or Comment

COMMENTS ON THIS REPORT

Author Response 28 Feb 2020

Kristin Wall, Department of Epidemiology, Rollins School of Public Health, Laney Graduate School, Emory University, Atlanta, 30322, USA

28 Feb 2020

Author Response

We appreciate these thoughtful comments which have further improved the manuscript.

In the introduction, we clarify that the estimate of 51% unmet need is based on a prospective assessment as a ... Continue reading We appreciate these thoughtful comments which have further improved the manuscript.

In the introduction, we clarify that the estimate of 51% unmet need is based on a prospective assessment as a less biased means to predict women’s family planning need in the postpartum period. We now highlight in the introduction the sizeable opportunity to provide PPFP counseling/services at timepoints when women are already engaged in the healthcare system. The CYP for the contraceptive methods are now calculated adjusting to remove any ‘double coverage’ caused by overlap with post-partum insusceptibility, and we discuss changes in postpartum pregnancy risk as well as frequency of breastfeeding, LAM, and periodic abstinence in this population. Reimbursements for providers were higher for the IUD versus the implant because IUD insertion required additional training and certification time and each IUD takes longer to insert versus an implant. For further context, we now describe (as reported previously and in an upcoming publication), of women to whom we promoted PPFP to who delivered at a study facility, 11% selected the implant and 29% the selected the IUD. The average age and parity of women selecting the IUD or implant, as well as frequency of removals, side-effects, pain/anxiety during insertion, and satisfaction are now reported. An improved understanding of differences in women who uptake the IUD versus implant (versus another method entirely) would be informative for future scale-up, as now mentioned. We clarify that the driver of the difference in implant versus IUD costs are commodity costs. The wide range of cost per CYP estimates from other studies are related to variation across countries in costs of trainings; consumable supplies; instruments; and labor for counseling, insertion, removal, and resupply.
We appreciate these thoughtful comments which have further improved the manuscript.

In the introduction, we clarify that the estimate of 51% unmet need is based on a prospective assessment as a less biased means to predict women’s family planning need in the postpartum period. We now highlight in the introduction the sizeable opportunity to provide PPFP counseling/services at timepoints when women are already engaged in the healthcare system. The CYP for the contraceptive methods are now calculated adjusting to remove any ‘double coverage’ caused by overlap with post-partum insusceptibility, and we discuss changes in postpartum pregnancy risk as well as frequency of breastfeeding, LAM, and periodic abstinence in this population. Reimbursements for providers were higher for the IUD versus the implant because IUD insertion required additional training and certification time and each IUD takes longer to insert versus an implant. For further context, we now describe (as reported previously and in an upcoming publication), of women to whom we promoted PPFP to who delivered at a study facility, 11% selected the implant and 29% the selected the IUD. The average age and parity of women selecting the IUD or implant, as well as frequency of removals, side-effects, pain/anxiety during insertion, and satisfaction are now reported. An improved understanding of differences in women who uptake the IUD versus implant (versus another method entirely) would be informative for future scale-up, as now mentioned. We clarify that the driver of the difference in implant versus IUD costs are commodity costs. The wide range of cost per CYP estimates from other studies are related to variation across countries in costs of trainings; consumable supplies; instruments; and labor for counseling, insertion, removal, and resupply.
Competing Interests: No competing interests were disclosed. Close
Report a concern

Version 2

VERSION 2

PUBLISHED 08 Feb 2019

Revised

Views

Reviewer Report 19 Mar 2019

Kate H. Rademacher, FHI 360, Durham, NC, USA

Approved with Reservations

https://doi.org/10.21956/gatesopenres.14020.r26919

The authors made substantial improvements in this version of the paper. Thank you for revising.

As part of this, thank you for clarifying that the cost analysis described in the paper did not include the costs of implementing the research. However, I am still confused why salaries for “study coordinators” and “data managers” were included – these sound like they were costs associated with research. Please clarify, and revise analysis if needed.

In addition, here are some other more minor comments:

Introduction – consider a transition sentence between the first two sentences – e.g. discuss the benefits of PPFP. Also, in the third sentence, please clarify that citation #3 refers to a study that took place in 5 countries (not the 21 that you referenced earlier in the sentence – citation #2).
Introduction – most hormonal IUD products are registered for 5 years duration. Please clarify in text.
Introduction – you state that IUDs and implants make up “a relatively small share of method use in Rwanda.” However, I’m not sure it’s fair to lump these two methods together as 17% for implants seems like a relatively high proportion. Rwanda was not included in the analysis in this recent paper by Jacobstein (2018¹), but still it would be good to more fully acknowledge the growing popularity and use of implants in SSA.
Note some minor typos – e.g. name of Project San Francisco – “project” is misspelled.
Discussion section – I would include mention of this study among PP women in Rwanda: Dulli et al. (2016²). Related to this suggestion, it sounds like promotion of PPIUD and PP implants in your intervention occurred in part in clinics which offer child immunization services. You may want to highlight this because FP-Immunization integration is considered a “promising” High Impact Practice by USAID, UFNPA and others. See here: https://www.fphighimpactpractices.org/briefs/family-planning-and-immunization-integration/.

Discussion – you noted that in your intervention you “focused your promotions on the IUD” – please clarify the meaning here, as it is important to clarify if the IUD was promoted in the context of full method choice.

References

1. Jacobstein R: Liftoff: The Blossoming of Contraceptive Implant Use in Africa. Global Health: Science and Practice. 2018. Reference Source
2. Dulli LS, Eichleay M, Rademacher K, Sortijas S, et al.: Meeting Postpartum Women's Family Planning Needs Through Integrated Family Planning and Immunization Services: Results of a Cluster-Randomized Controlled Trial in Rwanda.Glob Health Sci Pract. 2016; 4 (1): 73-86 PubMed Abstract | Publisher Full Text

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Family planning, health economics, long-acting reversible methods, postpartum family planning and immunization integration

CITE

Report a concern

Respond or Comment

Version 1

VERSION 1

PUBLISHED 31 Aug 2018

Views

Reviewer Report 17 Dec 2018

Kate H. Rademacher, FHI 360, Durham, NC, USA

Not Approved

https://doi.org/10.21956/gatesopenres.13941.r26758

Postpartum family planning is a very timely and important topic, and I appreciate the authors efforts to conduct a costing analysis of the PPIUD and PP-implant intervention described. However, I have substantial concerns about the methods described, and therefore am not recommending indexing of the article in its current format. I encourage the authors to consider re-doing the costing analysis to incorporate the feedback below.

A summary of my concerns about the methods are as follows:

The authors say that they use “a standard, comprehensive micro-costing approach as recommended to calculate the net cost of the PPIUD/PP implant intervention from the payer perspective.” They reference the CHEERS economic standards described in the paper by Husereau et al. However, in the paper by Husereau et al, there is no recommendation for calculating “net costs” which is what the authors say they did. Instead, in the CHEERS checklist in the Husereau et al. paper, they indicate that *incremental* costs should be calculated/reported. The reporting of "net costs" begs the question net of what? I encourage the authors to re-do the analysis and report incremental costs of the intervention (see comment #2 below for more on this).
The biggest concern I have about the methods is that it appears that research costs were included in the cost calculation. This is not typical in a micro-costing analysis like this. Typically, only the incremental costs of the intervention itself are included in a costing analysis (unless the authors expect the research component to continue as part of the standard way that the service is provided moving forward). As such, I would not include costs in your analysis such as salaries for researchers, salaries for study coordinators, travel for research staff, tablets (if used for data collection), transcription of research interviews, etc.
In addition to the issues noted above, the authors indicate that they are reporting from the “payer” perspective but they do not indicate who the “payer” is. The client? The health system? This is important because some costs that were included in the analysis should potentially be removed depending on who the payer is. For example, if you’re reporting costs from the health system perspective, then the “client transport reimbursement for follow-up visits” should not be included if that is a cost only incurred by the woman.
A smaller comment: please also indicate if costs of consumables/ supplies (such as specula, forceps) were divided by an estimated number of uses to get a per insertion cost.
Related to #2 above, the authors conclude that the results can “inform decision-making…to estimate the cost of scaling up activities.” But is unclear if/how the intervention costs would differ from scale-up costs. It would be helpful to know which components of the intervention, if any, were only included in the pilot phase vs. would be included in potential later scale-up phase(s).
The authors make the statement that “The PPIUD/PP implant service implementation provided services at a low cost per insertion and CYP.”. However, it not clear what comparison is used to draw this conclusion. Low compared to what? In the Discussion section, the authors compare the costs to another PPIUD study in Rwanda and indeed, the cost per insertion and cost per CYP of the PPIUD was lower in the intervention described in this paper than in the previous anlaysis. But what about the cost of the PP-implant described in this paper? That cost is relatively quite high compared to the PPIUD and the authors do not comment on that. Other data from the World Bank and another paper by Tumlinson et al also cited, but it is not clear which of these data are being used for the comparison to the results described in this paper. One potential take-away is that the cost of the PP-IUD is much lower the cost of PP-implants. There is not much in the literature about the cost of provision of PP-implants given that the WHO Medical Eligibility Criteria (MEC) was recently updated regarding PP provision of implant, so a discussion about this would be a valuable addition to the literature.

Additional smaller comments:

In the first paragraph of the introduction, the following statement is made: “In post-partum periods, 50–90% of women experience unmet need, while 95% of women desire to avoid pregnancy for at least 1 year after delivery.” However, the research that is cited (Pasha et al.) only includes data from five countries whereas the statement the authors make is very broad. Consider revising to clarify. Also, see paper with analysis of data from 21 countries by Moore Z et al. (2015)¹.
Introduction – authors should acknowledge that WHO MEC was recently updated regarding PP insertion of implants².
In the third paragraph of the Introduction– the category of LARCs also includes the hormonal IUD (the LNG-IUS). Suggest revision to acknowledge this; it could just be a footnote.
Introduction – citation 7 – This is a white paper form 2005. there are many more recent papers that document the effectiveness and cost-effectiveness of FP methods. Suggest replacing with a more recent citation.
Note that the analysis in the paper in citation #18 by Tumlinson et al was updated in a more recent paper. I encourage you replacing the data/citation here this this more recent work. See: Rademacher et al. (2016)³.
In the Ethics section, it was confusing how the focus group discussions and surveys related to the costing component, if at all. Consider revising to clarify.
I realize that you describe the intervention in-depth in another paper, but I suggest that you clarify in this article what the baseline service delivery model was for PPFP at the sites before the intervention was introduced. That will allow you describe and calculate the incremental costs of the new PPIUD and PP-implant intervention being evaluated.
The Neukom et al paper that is cited (Citation #18) used a dedicated provider model. Related to point above, it would be good to clarify if dedicated providers were employed as part of the intervention, or it PPIUD and PP-implant were added to the scope of work for existing providers at the facilities. If it was the latter, this would not be a fair comparison to the costs described in the Neukom et al paper as the models are different. And again, the key is to calculate the incremental costs of the intervention you described – so only the incremental costs of having providers add PPIUD/PP-implants to their service package.

Thank you for the chance to review. Again, this is an important topic, and I hope the authors will consider revising and re-submitting.

Is the work clearly and accurately presented and does it cite the current literature?

Partly
Is the study design appropriate and is the work technically sound?

No
Are sufficient details of methods and analysis provided to allow replication by others?

No
If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable
Are all the source data underlying the results available to ensure full reproducibility?

Partly
Are the conclusions drawn adequately supported by the results?

Partly

References

1. Moore Z, Pfitzer A, Gubin R, Charurat E, et al.: Missed opportunities for family planning: an analysis of pregnancy risk and contraceptive method use among postpartum women in 21 low- and middle-income countries.Contraception. 2015; 92 (1): 31-9 PubMed Abstract | Publisher Full Text
2. Medical eligibility criteria for contraceptive use: Fifth Edition. World Health Organisation. 2015.
3. Rademacher K, Solomon M, Brett T, Bratt J, et al.: Expanding Access to a New, More Affordable Levonorgestrel Intrauterine System in Kenya: Service Delivery Costs Compared With Other Contraceptive Methods and Perspectives of Key Opinion Leaders. Global Health: Science and Practice. 2016; 4 (Supplement 2): S83-S93 Publisher Full Text

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Family planning, health economics, long-acting reversible methods, postpartum family planning and immunization integration

I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.

CITE

Report a concern

Respond or Comment

Views

Reviewer Report 03 Sep 2018

Katherine Tumlinson, Department of Maternal and Child Health, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA

Approved with Reservations

https://doi.org/10.21956/gatesopenres.13941.r26628

Overall: This is a well-written paper that makes a valuable contribution to the current body of literature by describing the cost per couple year of protection of LARC methods in Rwanda, after factoring in the cost of activities/materials designed to increase demand for these methods.

I would encourage the authors to be more explicit about why such promotional activities are necessary for LARCs and why it is important to factor in the cost of promotional/demand-creation activities when calculating CYP for LARCs.

I would also encourage the authors to include the cost of labor and supplies required for LARC insertion in their calculation of LARC CYPs (or to make this more explicit if they have already done so).

Additionally, in the discussion section, I would encourage the authors to present the data comparing the CYP of other methods in a visual format so that readers can more easily interpret the results presented in this paper relative to the CYPs of shorter-acting methods or other LARC + promotion CYP calculations.

These recommendations are described in more detail below, along with more minor suggestions. Once these concerns are addressed, I strongly recommend indexing. Thank you for the opportunity to review this paper.

Abstract:

The introduction presents the results of the parent study/intervention which was designed to increase demand for LARCs within a small number of facilities in Kigali. I encourage the authors to re-write this paragraph to better lay the foundation for the specific goal of this current paper. The authors may want to consider a short statement of the high unmet need during the postpartum period and the low prevalence of LARCs and the value of better understanding CYP for LARCs after factoring in the cost of promotional/demand-creation activities.
Similarly, the methods section of the abstract falls a little bit short; it would be helpful to indicate that the authors utilized a standardized method for calculating net cost of the intervention.

Introduction:

Overall the introduction is very well written and pleasantly concise. However, I would recommend insertion of a short paragraph that helps the readers to understand a key challenge of LARCs: promotional or demand creation activities are often necessary to increase uptake. Few prior studies (to my knowledge) have been able to calculate a CYP for a LARC that includes the cost of these demand creation activities. This is an important strength of this paper and should be highlighted.
An additional recommendation for the introduction involves the description of the parent study/intervention. In the second sentence of paragraph four, the authors briefly describe the results of the parent study in terms of the enormous increase in uptake. This is important information; however, it feels as if the authors have cut and paste from the abstract of the prior paper and – on first glance – it was confusing as I didn’t realize the authors were describing the intervention study and I mistakenly thought the results of the current paper were being summarized in the introduction. I recommend revisions so that this paragraph does a better job of explaining that there was a parent study/intervention that was found to be enormously successful in increasing the uptake of LARCs in select Kigali facilities and now the authors are writing this paper with the goal of understanding the CYP of LARCs, factoring in the cost of these very effective promotional activities.

Methods:

I would consider moving the first paragraph (ethics) to the end of the methods section, if possible. I was confused to read about focus group discussions in the first sentence, since I didn’t yet understand that formative research was done prior to designing effective promotional activities, neither of which are the real focus of this paper.
Are there available data on the cost of the supplies needed for insertion and the cost of provider’s time for insertion? For example, in a paper I wrote (which the authors cite, reference #17) that included CYP of various methods, we included the cost of supplies ($1.24) and labor (2.91) when calculating CYP for Sino-Implant ($12.10 total direct cost). I see the authors include “reimbursements for providers” but it’s not clear if this is the cost of labor (and, if so, it seems low). I also see consumables and supplies which appear to include specula and forceps, but I imagine there may be other supplies needed, for example alcohol pads, gauze/bandage, etc. It should not be difficult to obtain this data if not currently in hand.

Results: Excellent and concise presentation of exciting results!

Discussion: Again, well written and compelling. I have just a few suggestions for improvement:

The authors discuss data from a prior study in Rwanda and also recent World Bank data collected across multiple countries. Is it possible to present any of these data in a visual format alongside the results of this paper? It appears that the promotional approach used in the intervention study represents an improvement over prior efforts to increase LARC uptake in Rwanda – 3500 LARCs were inserted within one year in just 6 facilities and the total cost was under $75k. Can the authors create a graph that compares CYP from this study to the CYP from the FHI study so that readers can quickly see/digest that the CYP in this study was about one-fifth of the prior FHI study?
Can the authors present their calculated CYP for LARCs in a graph alongside the current CYP for shorter-term methods in Rwanda? This could help to highlight important differences in CYP across methods and make the case for larger investment in LARCs (or, at least, IUDs) as well as scaling up of the promotional flip-chart and training activities incorporated in the parent intervention.
When discussing the World Bank and USAID data, the authors should also indicate whether these prior studies included the cost of any demand generation activities (probably not).
In the last paragraph, prior to discussing limitations, the authors discuss the overall finding that IUDs represent significant cost savings over implants, largely due to the difference in the cost of the commodities. Some may argue, however, that IUDs represent a more difficult “sell” because they are more invasive (and painful?) to insert. Yet numerous women in the current study opted for the IUD over the Implant. Could the authors include data that might explain the comparative popularity of the IUD over the Implant among women in this study and discuss any implications?

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests: No competing interests were disclosed.

CITE

Report a concern

Respond or Comment

Comments on this article Comments (0)

Version 4

VERSION 4 PUBLISHED 31 Aug 2018

Open Peer Review

Reviewer Status

Reviewer Reports

	Invited Reviewers
	1	2	3
Version 4 (revision) 28 Feb 20		read
Version 3 (revision) 29 Mar 19			read
Version 2 (revision) 08 Feb 19		read
Version 1 31 Aug 18	read	read

Katherine Tumlinson, University of North Carolina at Chapel Hill, Chapel Hill, USA
Kate H. Rademacher, FHI 360, Durham, USA
Aisha N.Z. Dasgupta, United Nations Population Division, New York, USA

Comments on this article

All Comments(0)

Add a comment

Back to all reports

Reviewer Report

7 Views

14 Apr 2020 | for Version 4

Kate H. Rademacher, FHI 360, Durham, NC, USA

7 Views Cite this report Responses(0)

Approved

Thank you for addressing these comments and for your thoughtful responses.

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Family planning, reproductive health, costing, LARCs, LNG IUS, PPFP, FP-Immunization-integration

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

14 Views

09 Sep 2019 | for Version 3

Aisha N.Z. Dasgupta, United Nations Population Division, New York, NY, USA

14 Views Cite this report Responses(1)

Approved With Reservations

In the first paragraph, I was at times a little confused when you write about unmet need during the postpartum period. Is this about need at that particular point in time based on prospective fertility intentions, or were women determined to have unmet need based on their retrospective fertility intentions regarding their current pregnancy/most recent birth? For example, “In Rwanda, although only 2% of postpartum women report a desire for another child within 2 years of delivery, the unmet need in the postpartum period is 51%”. Is this 51% based on prospective fertility intentions which suggests a current unmet need? Or is some of this 51% based on the retrospective fertility intentions regarding the most recent birth? This is important to know as it influences how to interpret such a figure. If a notable portion of the 51% is based on retrospective fertility intentions, then it does not necessarily follow that postpartum family planning services is the answer to addressing high levels of unmet need, as these postpartum women might not be currently at risk of unintended pregnancy. Instead it could point to a general failure of services that lead to women having an unintended pregnancy (not necessarily during the postpartum period) who then appear in the unmet need estimate simply based on their retrospective reports of fertility intentions. I think it is important to know, because it helps us to understand exposure to unintended pregnancy during the postpartum period (I come back to this again later), and justifies the interest in the postpartum period and any related postpartum FP interventions.
Related to this, perhaps the authors could point to other reasons why there is interest in interventions during the postpartum period. E.g. an opportunity to engage with and target women as they are typically already in contact with the health care system for themselves and their infants (ANC, labor/delivery, vaccinations etc.).
A general comment for the paper: My main reservation is there is no mention of the risk of pregnancy in this population during the postpartum period, and the implications for the analysis. For example, I would like to know a little more information about any practice of postpartum abstinence, and how long is postpartum amenorrhea? What are the breastfeeding practices in this population? It would be possible to provide this type of information on duration of postpartum insusceptibility from the Demographic and Health Survey and perhaps other sources. I took a quick look at the 2014-2015 DHS and it looks like women are either still amenorrheic or still abstaining for around one year.
As the authors explain, a strength of LARCs is they can provide protection for 5-10 (IUD) and 3-5 (implant) years, and the CYP is 4.6 for IUD and 3.8 for implant. But, is it fair to claim full CYPs in this analysis, when it is known that the population being provided with IUDs and implants are on average at lower risk of pregnancy, at least for around the first year postpartum? This is a limitation of the analysis and should be acknowledged in the discussion.

Methods:

Could you comment on the reimbursements to promoters and providers and why it was different for the two methods? What kinds of incentives did this create and could it have influenced which method was being recommended to potential clients?

Results:

There is an impressive number of study participants. Could you give any information on number of refusals to participate in the study? Is there any information on IUD/implant removals/discontinuation, side-effects, dissatisfaction?
The results section seems a little thin. I was curious to know anything about the clients that were reached – is there any demographic information – age, marital status, education, wealth – anything? Were there any differences between implant/IUD users, in terms of background characteristics? This might help the reader to understand the value for money in terms of the two methods, particularly if one method was more popular with a hard-to-reach group.
Could you provide a little more understanding of why implants were more expensive? Is this only because the commodity is more expensive, or were there other factors as well? Would the cost per PP implant have been lower, if a larger number of clients had been reached?

Discussion:

I note in Table 3 such a wide range of estimates of cost per CYP for IUD, which is quite hard to interpret. In Table 3, should the title of the table and/or the column title be “cost per CYP”, rather than “CYP”? Perhaps you could also provide a column providing the CYP itself for each of these methods.
“The CYP for the PPIUD and PP implant in our study were within the range of these other non-postpartum focused studies.” Do you mean the “cost per CYP”?
I appreciate your second-to-last paragraph in the discussion, on the possibility of IUDs in sub-Saharan Africa.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Partly

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Demography, family planning

Respond to this report

Responses (1)

Author Response

28 Feb 2020

Kristin Wall, Department of Epidemiology, Rollins School of Public Health, Laney Graduate School, Emory University, Atlanta, 30322, USA

We appreciate these thoughtful comments which have further improved the manuscript.

In the introduction, we clarify that the estimate of 51% unmet need is based on a prospective assessment as a less biased means to predict women’s family planning need in the postpartum period. We now highlight in the introduction the sizeable opportunity to provide PPFP counseling/services at timepoints when women are already engaged in the healthcare system. The CYP for the contraceptive methods are now calculated adjusting to remove any ‘double coverage’ caused by overlap with post-partum insusceptibility, and we discuss changes in postpartum pregnancy risk as well as frequency of breastfeeding, LAM, and periodic abstinence in this population. Reimbursements for providers were higher for the IUD versus the implant because IUD insertion required additional training and certification time and each IUD takes longer to insert versus an implant. For further context, we now describe (as reported previously and in an upcoming publication), of women to whom we promoted PPFP to who delivered at a study facility, 11% selected the implant and 29% the selected the IUD. The average age and parity of women selecting the IUD or implant, as well as frequency of removals, side-effects, pain/anxiety during insertion, and satisfaction are now reported. An improved understanding of differences in women who uptake the IUD versus implant (versus another method entirely) would be informative for future scale-up, as now mentioned. We clarify that the driver of the difference in implant versus IUD costs are commodity costs. The wide range of cost per CYP estimates from other studies are related to variation across countries in costs of trainings; consumable supplies; instruments; and labor for counseling, insertion, removal, and resupply.

View more View less

Competing Interests

No competing interests were disclosed.

Back to all reports

Reviewer Report

17 Views

19 Mar 2019 | for Version 2

Kate H. Rademacher, FHI 360, Durham, NC, USA

17 Views Cite this report Responses(0)

Approved With Reservations

Introduction – consider a transition sentence between the first two sentences – e.g. discuss the benefits of PPFP. Also, in the third sentence, please clarify that citation #3 refers to a study that took place in 5 countries (not the 21 that you referenced earlier in the sentence – citation #2).
Introduction – most hormonal IUD products are registered for 5 years duration. Please clarify in text.
Introduction – you state that IUDs and implants make up “a relatively small share of method use in Rwanda.” However, I’m not sure it’s fair to lump these two methods together as 17% for implants seems like a relatively high proportion. Rwanda was not included in the analysis in this recent paper by Jacobstein (2018¹), but still it would be good to more fully acknowledge the growing popularity and use of implants in SSA.
Note some minor typos – e.g. name of Project San Francisco – “project” is misspelled.
Discussion section – I would include mention of this study among PP women in Rwanda: Dulli et al. (2016²). Related to this suggestion, it sounds like promotion of PPIUD and PP implants in your intervention occurred in part in clinics which offer child immunization services. You may want to highlight this because FP-Immunization integration is considered a “promising” High Impact Practice by USAID, UFNPA and others. See here: https://www.fphighimpactpractices.org/briefs/family-planning-and-immunization-integration/.

Discussion – you noted that in your intervention you “focused your promotions on the IUD” – please clarify the meaning here, as it is important to clarify if the IUD was promoted in the context of full method choice.

References

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Family planning, health economics, long-acting reversible methods, postpartum family planning and immunization integration

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

25 Views

17 Dec 2018 | for Version 1

Kate H. Rademacher, FHI 360, Durham, NC, USA

25 Views Cite this report Responses(0)

Not Approved

The authors say that they use “a standard, comprehensive micro-costing approach as recommended to calculate the net cost of the PPIUD/PP implant intervention from the payer perspective.” They reference the CHEERS economic standards described in the paper by Husereau et al. However, in the paper by Husereau et al, there is no recommendation for calculating “net costs” which is what the authors say they did. Instead, in the CHEERS checklist in the Husereau et al. paper, they indicate that *incremental* costs should be calculated/reported. The reporting of "net costs" begs the question net of what? I encourage the authors to re-do the analysis and report incremental costs of the intervention (see comment #2 below for more on this).
The biggest concern I have about the methods is that it appears that research costs were included in the cost calculation. This is not typical in a micro-costing analysis like this. Typically, only the incremental costs of the intervention itself are included in a costing analysis (unless the authors expect the research component to continue as part of the standard way that the service is provided moving forward). As such, I would not include costs in your analysis such as salaries for researchers, salaries for study coordinators, travel for research staff, tablets (if used for data collection), transcription of research interviews, etc.
In addition to the issues noted above, the authors indicate that they are reporting from the “payer” perspective but they do not indicate who the “payer” is. The client? The health system? This is important because some costs that were included in the analysis should potentially be removed depending on who the payer is. For example, if you’re reporting costs from the health system perspective, then the “client transport reimbursement for follow-up visits” should not be included if that is a cost only incurred by the woman.
A smaller comment: please also indicate if costs of consumables/ supplies (such as specula, forceps) were divided by an estimated number of uses to get a per insertion cost.
Related to #2 above, the authors conclude that the results can “inform decision-making…to estimate the cost of scaling up activities.” But is unclear if/how the intervention costs would differ from scale-up costs. It would be helpful to know which components of the intervention, if any, were only included in the pilot phase vs. would be included in potential later scale-up phase(s).
The authors make the statement that “The PPIUD/PP implant service implementation provided services at a low cost per insertion and CYP.”. However, it not clear what comparison is used to draw this conclusion. Low compared to what? In the Discussion section, the authors compare the costs to another PPIUD study in Rwanda and indeed, the cost per insertion and cost per CYP of the PPIUD was lower in the intervention described in this paper than in the previous anlaysis. But what about the cost of the PP-implant described in this paper? That cost is relatively quite high compared to the PPIUD and the authors do not comment on that. Other data from the World Bank and another paper by Tumlinson et al also cited, but it is not clear which of these data are being used for the comparison to the results described in this paper. One potential take-away is that the cost of the PP-IUD is much lower the cost of PP-implants. There is not much in the literature about the cost of provision of PP-implants given that the WHO Medical Eligibility Criteria (MEC) was recently updated regarding PP provision of implant, so a discussion about this would be a valuable addition to the literature.

Additional smaller comments:

In the first paragraph of the introduction, the following statement is made: “In post-partum periods, 50–90% of women experience unmet need, while 95% of women desire to avoid pregnancy for at least 1 year after delivery.” However, the research that is cited (Pasha et al.) only includes data from five countries whereas the statement the authors make is very broad. Consider revising to clarify. Also, see paper with analysis of data from 21 countries by Moore Z et al. (2015)¹.
Introduction – authors should acknowledge that WHO MEC was recently updated regarding PP insertion of implants².
In the third paragraph of the Introduction– the category of LARCs also includes the hormonal IUD (the LNG-IUS). Suggest revision to acknowledge this; it could just be a footnote.
Introduction – citation 7 – This is a white paper form 2005. there are many more recent papers that document the effectiveness and cost-effectiveness of FP methods. Suggest replacing with a more recent citation.
Note that the analysis in the paper in citation #18 by Tumlinson et al was updated in a more recent paper. I encourage you replacing the data/citation here this this more recent work. See: Rademacher et al. (2016)³.
In the Ethics section, it was confusing how the focus group discussions and surveys related to the costing component, if at all. Consider revising to clarify.
I realize that you describe the intervention in-depth in another paper, but I suggest that you clarify in this article what the baseline service delivery model was for PPFP at the sites before the intervention was introduced. That will allow you describe and calculate the incremental costs of the new PPIUD and PP-implant intervention being evaluated.
The Neukom et al paper that is cited (Citation #18) used a dedicated provider model. Related to point above, it would be good to clarify if dedicated providers were employed as part of the intervention, or it PPIUD and PP-implant were added to the scope of work for existing providers at the facilities. If it was the latter, this would not be a fair comparison to the costs described in the Neukom et al paper as the models are different. And again, the key is to calculate the incremental costs of the intervention you described – so only the incremental costs of having providers add PPIUD/PP-implants to their service package.

Thank you for the chance to review. Again, this is an important topic, and I hope the authors will consider revising and re-submitting.

Is the work clearly and accurately presented and does it cite the current literature?

Partly
Is the study design appropriate and is the work technically sound?

No
Are sufficient details of methods and analysis provided to allow replication by others?

No
If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable
Are all the source data underlying the results available to ensure full reproducibility?

Partly
Are the conclusions drawn adequately supported by the results?

Partly

References

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Family planning, health economics, long-acting reversible methods, postpartum family planning and immunization integration

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

27 Views

03 Sep 2018 | for Version 1

Katherine Tumlinson, Department of Maternal and Child Health, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA

27 Views Cite this report Responses(0)

Approved With Reservations

The introduction presents the results of the parent study/intervention which was designed to increase demand for LARCs within a small number of facilities in Kigali. I encourage the authors to re-write this paragraph to better lay the foundation for the specific goal of this current paper. The authors may want to consider a short statement of the high unmet need during the postpartum period and the low prevalence of LARCs and the value of better understanding CYP for LARCs after factoring in the cost of promotional/demand-creation activities.
Similarly, the methods section of the abstract falls a little bit short; it would be helpful to indicate that the authors utilized a standardized method for calculating net cost of the intervention.

Introduction:

Overall the introduction is very well written and pleasantly concise. However, I would recommend insertion of a short paragraph that helps the readers to understand a key challenge of LARCs: promotional or demand creation activities are often necessary to increase uptake. Few prior studies (to my knowledge) have been able to calculate a CYP for a LARC that includes the cost of these demand creation activities. This is an important strength of this paper and should be highlighted.
An additional recommendation for the introduction involves the description of the parent study/intervention. In the second sentence of paragraph four, the authors briefly describe the results of the parent study in terms of the enormous increase in uptake. This is important information; however, it feels as if the authors have cut and paste from the abstract of the prior paper and – on first glance – it was confusing as I didn’t realize the authors were describing the intervention study and I mistakenly thought the results of the current paper were being summarized in the introduction. I recommend revisions so that this paragraph does a better job of explaining that there was a parent study/intervention that was found to be enormously successful in increasing the uptake of LARCs in select Kigali facilities and now the authors are writing this paper with the goal of understanding the CYP of LARCs, factoring in the cost of these very effective promotional activities.

Methods:

I would consider moving the first paragraph (ethics) to the end of the methods section, if possible. I was confused to read about focus group discussions in the first sentence, since I didn’t yet understand that formative research was done prior to designing effective promotional activities, neither of which are the real focus of this paper.
Are there available data on the cost of the supplies needed for insertion and the cost of provider’s time for insertion? For example, in a paper I wrote (which the authors cite, reference #17) that included CYP of various methods, we included the cost of supplies ($1.24) and labor (2.91) when calculating CYP for Sino-Implant ($12.10 total direct cost). I see the authors include “reimbursements for providers” but it’s not clear if this is the cost of labor (and, if so, it seems low). I also see consumables and supplies which appear to include specula and forceps, but I imagine there may be other supplies needed, for example alcohol pads, gauze/bandage, etc. It should not be difficult to obtain this data if not currently in hand.

Results: Excellent and concise presentation of exciting results!

Discussion: Again, well written and compelling. I have just a few suggestions for improvement:

The authors discuss data from a prior study in Rwanda and also recent World Bank data collected across multiple countries. Is it possible to present any of these data in a visual format alongside the results of this paper? It appears that the promotional approach used in the intervention study represents an improvement over prior efforts to increase LARC uptake in Rwanda – 3500 LARCs were inserted within one year in just 6 facilities and the total cost was under $75k. Can the authors create a graph that compares CYP from this study to the CYP from the FHI study so that readers can quickly see/digest that the CYP in this study was about one-fifth of the prior FHI study?
Can the authors present their calculated CYP for LARCs in a graph alongside the current CYP for shorter-term methods in Rwanda? This could help to highlight important differences in CYP across methods and make the case for larger investment in LARCs (or, at least, IUDs) as well as scaling up of the promotional flip-chart and training activities incorporated in the parent intervention.
When discussing the World Bank and USAID data, the authors should also indicate whether these prior studies included the cost of any demand generation activities (probably not).
In the last paragraph, prior to discussing limitations, the authors discuss the overall finding that IUDs represent significant cost savings over implants, largely due to the difference in the cost of the commodities. Some may argue, however, that IUDs represent a more difficult “sell” because they are more invasive (and painful?) to insert. Yet numerous women in the current study opted for the IUD over the Implant. Could the authors include data that might explain the comparative popularity of the IUD over the Implant among women in this study and discuss any implications?

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests

No competing interests were disclosed.

Respond to this report

Responses (0)

Alongside their report, reviewers assign a status to the article:

Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested

Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.

Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

[1] 1. Guttmacher Institute: Adding it up: Investing in Contraception and Maternal and Newborn Health, 2017. 2017; [cited 2018 June 15]. Reference Source

[2] 2. WHO: Report of a technical consultation on birth spacing. Geneva, Switzerland. 2005; Accessed 25 March 2019. Reference Source

[3] 3. Moore Z, Pfitzer A, Gubin R, et al.: Missed opportunities for family planning: an analysis of pregnancy risk and contraceptive method use among postpartum women in 21 low- and middle-income countries. Contraception. 2015; 92(1): 31–9. PubMed Abstract | Publisher Full Text

[4] 4. Pasha O, Goudar SS, Patel A, et al.: Postpartum contraceptive use and unmet need for family planning in five low-income countries. Reprod Health. 2015; 12 Suppl 2: S11. PubMed Abstract | Publisher Full Text | Free Full Text

[5] 5. USAID, MCHIP: Family planning needs during the first two years postpartum in Rwanda. 2010; [cited 2018 August 3]. Reference Source

[6] 6. Rutstein SO: Effects of preceding birth intervals on neonatal, infant and under-five years mortality and nutritional status in developing countries: evidence from the demographic and health surveys. Int J Gynaecol Obstet. 2005; 89 Suppl 1: S7–24. PubMed Abstract | Publisher Full Text

[7] 7. Government of Rwanda Ministry of Health: Family Planning 2020 Commitment. 2017; [cited June 15 2018]. Reference Source

[8] 8. NICE Clinical Guidelines, No. 30: Long-acting Reversible Contraception: The Effective and Appropriate Use of Long-Acting Reversible Contraception. Chapter 8: Economic evaluation. National Collaborating Centre for Women’s and Children’s Health (UK). London: RCOG Press; 2005. PubMed Abstract

[9] 9. Shoupe D: LARC methods: entering a new age of contraception and reproductive health. Contracept Reprod Med. 2016; 1: 4. PubMed Abstract | Publisher Full Text | Free Full Text

[10] 10. Lynch M, De Abreu Lourenco R, Flattery M, et al.: Reviewing the cost-effectiveness of long-acting reversible contraceptive methods in an Australian context. Aust N Z J Obstet Gynaecol. 2018. PubMed Abstract | Publisher Full Text

[11] 11. Mavranezouli I, LARC Guideline Development Group: The cost-effectiveness of long-acting reversible contraceptive methods in the UK: analysis based on a decision-analytic model developed for a National Institute for Health and Clinical Excellence (NICE) clinical practice guideline. Hum Reprod. 2008; 23(6): 1338–45. PubMed Abstract | Publisher Full Text

[12] 12. Family Health International: Addressing Unmet Need for Family Planning in Africa: Long-Acting and Permanent Methods. 2005; [cited 2017 April 18]. Reference Source

[13] 13. Lopez LM, Bernholc A, Hubacher D, et al.: Immediate postpartum insertion of intrauterine device for contraception. Cochrane Database Syst Rev. 2015; (6): CD003036. PubMed Abstract | Publisher Full Text

[14] 14. Sonalkar S, Kapp N: Intrauterine device insertion in the postpartum period: a systematic review. Eur J Contracept Reprod Health Care. 2015; 20(1): 4–18. PubMed Abstract | Publisher Full Text

[15] 15. Medical eligibility criteria for contraceptive use. Fifth Edition. World Health Organisation. 2015. Reference Source

[16] 16. FHI360: Assessing the Feasibility of Postpartum IUD Provision in Rwanda. 2013; [cited 2018 January 15]. Reference Source

[17] 17. Khu NH, Vwalika B, Karita E, et al.: Fertility goal-based counseling increases contraceptive implant and IUD use in HIV-discordant couples in Rwanda and Zambia. Contraception. 2013; 88(1): 74–82. PubMed Abstract | Publisher Full Text | Free Full Text

[18] 18. Robinson N, Moshabela M, Owusu-Ansah L, et al.: Barriers to Intrauterine Device Uptake in a Rural Setting in Ghana. Health Care Women Int. 2016; 37(2): 197–215. PubMed Abstract | Publisher Full Text | Free Full Text

[19] 19. Greene E, Stanback J: Old barriers need not apply: opening doors for new contraceptives in the developing world. Contraception. 2012; 85(1): 11–4. PubMed Abstract | Publisher Full Text

[20] 20. Osei I, Birungi H, Addico G, et al.: What happened to the IUD in Ghana? Afr J Reprod Health. 2005; 9(2): 76–91. PubMed Abstract | Publisher Full Text

[21] 21. Bryant AG, Kamanga G, Stuart GS, et al.: Immediate postpartum versus 6-week postpartum intrauterine device insertion: a feasibility study of a randomized controlled trial. Afr J Reprod Health. 2013; 17(2): 72–79. PubMed Abstract

[22] 22. Tibaijuka L, Odongo R, Welikhe E, et al.: Factors influencing use of long-acting versus short-acting contraceptive methods among reproductive-age women in a resource-limited setting. BMC Womens Health. 2017; 17(1): 25. Publisher Full Text

[23] 23. Grabbe K, Stephenson R, Vwalika B, et al.: Knowledge, use, and concerns about contraceptive methods among sero-discordant couples in Rwanda and Zambia. J Womens Health (Larchmt). 2009; 18(9): 1449–56. PubMed Abstract | Publisher Full Text | Free Full Text

[24] 24. Gutin SA, Mlobeli R, Moss M, et al.: Survey of knowledge, attitudes and practices surrounding the intrauterine device in South Africa. Contraception. 2011; 83(2): 145–50. PubMed Abstract | Publisher Full Text

[25] 25. Rattan J, Noznesky E, Curry DW, et al.: Rapid Contraceptive Uptake and Changing Method Mix With High Use of Long-Acting Reversible Contraceptives in Crisis-Affected Populations in Chad and the Democratic Republic of the Congo. Glob Health Sci Pract. 2016; 4 Suppl 2: S5–S20. PubMed Abstract | Publisher Full Text | Free Full Text

[26] 26. Brunie A, Tolley EE, Ngabo F, et al.: Getting to 70%: barriers to modern contraceptive use for women in Rwanda. Int J Gynaecol Obstet. 2013; 123 Suppl 1: e11–e15. PubMed Abstract | Publisher Full Text

[27] 27. Anguzu R, Tweheyo R, Sekandi JN, et al.: Knowledge and attitudes towards use of long acting reversible contraceptives among women of reproductive age in Lubaga division, Kampala district, Uganda. BMC Res Notes. 2014; 7: 153. PubMed Abstract | Publisher Full Text | Free Full Text

[28] 28. Dulli LS, Eichleay M, Rademacher K, et al.: Meeting Postpartum Women's Family Planning Needs Through Integrated Family Planning and Immunization Services: Results of a Cluster-Randomized Controlled Trial in Rwanda. Glob Health Sci Pract. 2016; 4(1): 73–86. PubMed Abstract | Publisher Full Text | Free Full Text

[29] 29. Family Planning and Immunization Integration: Reaching postpartum women with family planning services. 2019; Accessed March 25, 2019. Reference Source

[30] 30. Ingabire R, Nyombayire J, Hoagland A, et al.: Evaluation of a multi-level intervention to improve postpartum intrauterine device services in Rwanda [version 2; referees: 2 approved, 1 approved with reservations]. Gates Open Res. 2018; 2: 38. Publisher Full Text

[31] 31. Husereau D, Drummond M, Petrou S, et al.: Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Int J Technol Assess Health Care. 2013; 29(2): 117–22. PubMed Abstract | Publisher Full Text

[32] 32. Rusa L, Ngirabega Jde D, Janssen W, et al.: Performance-based financing for better quality of services in Rwandan health centres: 3-year experience. Trop Med Int Health. 2009; 14(7): 830–7. PubMed Abstract | Publisher Full Text

[33] 33. Stover J, Bertrand JT, Shelton JD: Empirically based conversion factors for calculating couple-years of protection. Eval Rev. 2000; 24(1): 3–46. PubMed Abstract | Publisher Full Text

[34] 34. Wall K: Replication Data for: an interim evaluation of a multi-level intervention to improve post-partum intrauterine device (PPIUD) services in Rwanda. Harvard Dataverse. 2018. http://www.doi.org/10.7910/DVN/WLZ7PC

[35] 35. Babigumira JB, Vlassoff M, Ahimbisibwe A, et al.: Surgery for Family Planning, Abortion, and Postabortion Care. In Essential Surgery: Disease Control Priorities. Third Edition, H.T. Debas, et al., Editors. The International Bank for Reconstruction and Development / The World Bank: Washington DS. p. Table 7.3: Annual Cost per CYP of Contraceptive Methods in Selected African Countries. 2015. PubMed Abstract | Publisher Full Text

[36] 36. Rademacher K, Solomon M, Brett T, et al.: Expanding Access to a New More Affordable Levonorgestrel Intrauterine System in Kenya: Service Delivery Costs Compared With Other Contraceptive Methods and Perspectives of Key Opinion Leaders. Glob Health Sci Pract. 2016; 4 Suppl 2: S83–S93. PubMed Abstract | Publisher Full Text | Free Full Text

[37] 37. Neukom J, Chilambwe J, Mkandawire J, et al.: Dedicated providers of long-acting reversible contraception: new approach in Zambia. Contraception. 2011; 83(5): 447–52. PubMed Abstract | Publisher Full Text

[38] 38. Saeed GA, Fakhar S, Rahim F, et al.: Change in trend of contraceptive uptake--effect of educational leaflets and counseling. Contraception. 2008; 77(5): 377–81. PubMed Abstract | Publisher Full Text

[39] 39. Vernon R: Meeting the family planning needs of postpartum women. Stud Fam Plann. 2009; 40(3): 235–45. PubMed Abstract | Publisher Full Text

[40] 40. Keogh SC, Urassa M, Kumogola Y, et al.: Postpartum Contraception in Northern Tanzania: Patterns of Use, Relationship to Antenatal Intentions, and Impact of Antenatal Counseling. Stud Fam Plann. 2015; 46(4): 405–422. PubMed Abstract | Publisher Full Text

[41] 41. Mullany LC, Lee TJ, Yone L, et al.: Impact of community-based maternal health workers on coverage of essential maternal health interventions among internally displaced communities in eastern Burma: the MOM project. PLoS Med. 2010; 7(8): e1000317. PubMed Abstract | Publisher Full Text | Free Full Text

[42] 42. Ayad M, Hong R: Further Analysis of the Rwanda Demographic and Health Surveys, 2000-2007/08: Levels and Trends of Contraceptive Prevalence and Estimate of Unmet Need for Family Planning in Rwanda. Accessed Nov 14, 2017. Reference Source

[43] 43. United Nations, Department of Economic and Social Affairs, Population Division:Trends in Contraceptive Use Worldwide 2015. ST/ESA/SER.A/349. 2015. Reference Source

[44] 44. National Institute of Statistics of Rwanda (NISR) [Rwanda], Ministry of Health (MOH) [Rwanda], ICF International: Rwanda Demographic and Health Survey. Accessed Nov 14, 2017. Reference Source

[45] 45. National Institute of Statistics of Rwanda (NISR) [Rwanda] MoHM, ], and ICF International: 2014-15 Rwanda Demographic Health Survey Key Findings. 2015. Reference Source

[46] 46. Duvall S, Thurston S, Weinberger M, et al.: Scaling up delivery of contraceptive implants in sub-Saharan Africa: operational experiences of Marie Stopes International. Glob Health Sci Pract. 2014; 2(1): 72–92. PubMed Abstract | Publisher Full Text | Free Full Text

[47] 47. Ngo TD, Nuccio O, Pereira SK, et al.: Evaluating a LARC Expansion Program in 14 Sub-Saharan African Countries: A Service Delivery Model for Meeting FP2020 Goals. Matern Child Health J. 2017; 21(9): 1734–1743. PubMed Abstract | Publisher Full Text | Free Full Text

[48] 48. Bellows B, Mackay A, Dingle A, et al.: Increasing Contraceptive Access for Hard-to-Reach Populations With Vouchers and Social Franchising in Uganda. Glob Health Sci Pract. 2017; 5(3): 446–455. PubMed Abstract | Publisher Full Text | Free Full Text

[49] 49. Rwanda FP2020 Core Indicator Summary Sheet: 2017. 2017. Reference Source

Cost per insertion and couple year of protection for postpartum intrauterine devices and implants provided during service scale-up in Kigali, Rwanda

Abstract

Keywords

Revised Amendments from Version 2

Introduction

Methods

PPIUD/PP Implant program development and operations

Incremental PPIUD/PP implant program costs

PPIUD/PP implant program outcomes

Ethical considerations and consent

Results

Incremental PPIUD/PP implant program costs

Table 1. Allocation of costs for the PPIUD/PP implant implementation by activity (August 2017–July 2018).

PPIUD/PP implant program outcomes

Table 2. Outcomes of interest for the PPIUD/PP implant implementation (August 2017–July 2018).

Discussion

Table 3. Comparison of CYP for different contraceptive methods (not specifically postpartum) from select studies.

Limitations

Conclusions

Data availability

Grant information

References

Comments on this article Comments (0)

Open Peer Review

Comments on this article Comments (0)

Open Peer Review

Reviewer Status

Reviewer Reports

Comments on this article

Are you a Gates-funded researcher?

Thank you!

Cost per insertion and couple year of protection for postpartum intrauterine devices and implants provided during service scale-up in Kigali, Rwanda

Abstract

Keywords

Revised Amendments from Version 2

Introduction

Methods

PPIUD/PP Implant program development and operations

Incremental PPIUD/PP implant program costs

PPIUD/PP implant program outcomes

Ethical considerations and consent

Results

Incremental PPIUD/PP implant program costs

Table 1. Allocation of costs for the PPIUD/PP implant implementation by activity (August 2017–July 2018).

PPIUD/PP implant program outcomes

Table 2. Outcomes of interest for the PPIUD/PP implant implementation (August 2017–July 2018).

Discussion

Table 3. Comparison of CYP for different contraceptive methods (not specifically postpartum) from select studies.

Limitations

Conclusions

Data availability

Grant information

References

Comments on this article Comments (0)

Open Peer Review

Comments on this article Comments (0)

Open Peer Review

Reviewer Status

Reviewer Reports

Comments on this article

Competing Interests Policy

Stay Updated

Are you a Gates-funded researcher?

Thank you!