Keywords
checklists, maternal health services, quality improvement, in-service training, provider education, coaching, supportive supervision
checklists, maternal health services, quality improvement, in-service training, provider education, coaching, supportive supervision
Coaching is a successful strategy for changing individuals' performance and behaviors within industries such as sports1, business2, and health care3–5. Coaching, which differs from clinical training, focuses on strategically supporting someone as they determine how to put knowledge into practice. Among clinicians, there is often a disconnect between theoretical knowledge and practical application of clinical skills3. Employing a coaching-based approach can be a critical method to support clinicians’ progress from beginner to expert in assessment and intervention decisions6–8.
Although the literature demonstrates that coaching is an effective method for promoting behavior change, little is known about which coach attributes are effective. This post hoc, sub-analysis of the BetterBirth trial used observational data to explore whether specific coaches’ and team leaders’ characteristics were associated with improved adherence by birth attendants to essential birth practices (EBPs) listed on the WHO Safe Childbirth Checklist (SCC)9.
The BetterBirth Trial, a large cluster-randomized controlled trial conducted in Uttar Pradesh, India, demonstrated that a coaching-based implementation of the SCC increased birth attendants’ adherence to EBPs, but had no effect on maternal/perinatal health outcomes9. The original trial took place in 120 facilities across 24 districts of Uttar Pradesh9. At each intervention facility (n=60) and its matched control site (n=60), patients were enrolled two months after the launch of the coaching intervention; health outcomes of women and their newborns were collected at 7 days postpartum9.
Intervention sites were assigned coaches for 8 months to empower birth attendants to identify and resolve the barriers they faced while using the SCC4. Team leaders attended every other visit with coaches to provide supportive supervision. In a sub-set of 30 facilities, independent observers (neither coaches nor staff) documented birth attendant’s adherence to practices. Observers recorded data on all practices within a specific time frame (from admission, just before delivery, within 1 minute of delivery, and within 1 hour of delivery); deliveries were observed for 1 or more pause points. Observation of practices was limited to practical and observable interactions between provider and patient or provider actions to ready supplies9. Data collection took place 2 months and 6 months after coaching. Only independent observer data from intervention facilities (15 facilities) are included in this analysis, as control facilities did not receive coaching.
Using data collected during the main trial, we conducted a descriptive analysis on the coach characteristics and the relationship of those attributes and adherence to the behaviors on the WHO Safe Childbirth Checklist. We included information from the 50 BetterBirth coaches and team leaders; a subset of which (n=17 coaches or team leaders) provided coaching at facilities where independent observation was completed. Using data from the study hiring database, the variables on coaches/team leaders’ gender, age, professional degree, years of clinical training and years of experience were used in the analysis. The roles of coach and team leaders for the analysis were based on the individual’s initial role when the trial started as some coaches graduated to team leader roles throughout the trial. All coaches and team leaders were included in the descriptive analysis; only the coaches and team leaders in the subset of facilities with independent observer data were included in the subsequent models. STROBE reporting guidelines were used in the submission of this study10.
Generalized linear models were constructed, accounting for clustering of births within site, to examine the association between coach characteristics and birth attendants’ adherence to EBPs. The models were estimated using generalized estimating equations11. Separate models were created for coaches and team leaders. Practice adherence data was collected by independent observers. Practice adherence was calculated as a summary score of the 18 EBPs for each birth and each practice was weighted equally. The EBP score was then assigned to each coach who visited the facility where the observation took place, as coaches attempted to provide at least one coaching session to every birth attendant at a facility. The parameter estimates for the model can be interpreted as the difference in mean EBP scores between the different levels of demographic characteristics in the study. All statistical analyses were performed in SAS version 9.4 (SAS Institute, Cary, NC, USA).
All coaches were female and the majority were nurses. Team leaders were comprised of both males and females; half of which had clinical backgrounds (Table 112). The full complement of coaches and team leaders were relatively similar to the subset of coaches working at facilities where independent observations occurred. The only difference is the proportion of males in the team leader group (63%) and males in the team leader analytic dataset (29%).
There was no association between coach’s or team leaders’ gender, type of degree, or years of clinical training and providers’ adherence to EBPs. However, a significant inverse relationship was detected between the coach’s or team leader’s age as well as years of experience and the birth attendants’ adherence to the checklist (Table 212). As the coach’s age increased by 10 years, the mean summary score of the 18 EBP adherence decreased by almost one checklist item (ϐ = -0.93). Similarly, as the coach’s years of experience increased the number of EBP decreased slightly (ϐ = -0.13). Similar effects were found for team leaders.
The inverse relationship between the coaches’ age and experience and adherence to EBPs suggests that younger, less experienced coaches were more successful in promoting practice adherence. Younger coaches may have been less directive, especially when coaching birth attendants who were older and/or more experienced. Additionally, coaches and team leaders possess various learning styles; the coach foundation training may have been absorbed differently by each.
A potential limitation is the introduction of bias by independent observers. To mitigate bias, observers completed standardized training (with six-month refreshers), which included procedures for using the observation tool in practice and definitions for analyzing EBP adherence. For practical reasons, these observations were performed at nonrandomly selected sites during daytime hours, which potentially limits generalizability to unobserved births4. While the number of coaches included in the analytic dataset is small, the total number of observations of care was substantial.
The notion that coaching has positive effects on individual behavior change outcomes is well-supported in the literature. However, a paucity of studies explore the various dynamics between coach and coachee relationships suggests that more information is needed to fully understand the relationship between coaches and birth attendants13. One survey of nearly 300 individuals in 34 different countries conducted by the Institute for Employment Studies found that factors such as age and gender of their coach were less important to coachees14. The most important quality of a coach to a coachee was that the coach displayed acceptance of the individual14. This matches our broader experience at Ariadne Labs, where we have often seen that softer skills (i.e., established relationships between the coach and the coachee, the coach’s disposition and personal style) produce higher rates of sustained behavior change, but these factors are difficult to measure. Future research should include a mixed methods approach to explore how factors like personal styles, cultural dynamics, and hierarchy affect coaching content uptake.
At trial initiation, birth attendants and facility staff provided written consent to participate. Before an independent observer collected data, the birth attendant verbally reconfirmed agreement; laboring women who were observed provided written consent. Electronic data were deidentified and stored in a Health Insurance Portability and Accountability Act–compliant database to ensure participant privacy. In directly observed births, women or their surrogates provided written consent for observation. The study protocol was approved by the Community Empowerment Lab (CEL) Ethics Review Committee (Ref no: 2014006), Jawaharlal Nehru Medical College Ethical Review Committee (Ref no: MDC/IECHSR/2015-16/A-53), the Institutional Review Board of the Harvard T.H. Chan School of Public Health (Protocol 21975-102), the Population Services International Research Ethics Board (Protocol ID: 47.2012), and the Ethical Review Committee of the World Health Organization (Protocol ID: RPC 501), and the Indian Council of Medical Research. The protocol was reviewed and reapproved on an annual basis.
Harvard Dataverse: Who's Your Coach? The relationship between coach characteristics and birth attendants' adherence to the WHO Safe Childbirth Checklist. https://doi.org/10.7910/DVN/BCMETW12
This project contains the following underlying data:
▪ coachtl_chars.sas7bdat (SAS dataset with demographic characteristics of coach team leaders)
▪ coachtl_checklist.sas7bdat (SAS dataset with adherence to checklist behaviors in coach team leader facilities)
▪ Coach_characteristics_DataDictionary.tab (Data Dictionary for the demographic characteristics datasets for Coaches and Coach Team Leaders with variable names, type, length, format, informat and label)
▪ coach_chars.sas7bdat (SAS dataset with demographic characteristics of coaches)
▪ coach_checklist.sas7bdat (SAS dataset with adherence to checklist behaviors in coached facilities)
▪ Coach_CoachTL_Checklist_DataDictionary.tab (Data dictionary for the datasets on adherence to Checklist behaviors listed above with variable names, type, length, format, informat and label)
Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).
Views | Downloads | |
---|---|---|
Gates Open Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Partly
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Reproductive, Maternal, Neonatal Health; Women's Cancers; Health Systems/Quality of Care
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Yes
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
References
1. WHO Safe Childbirth Checklist Implementation Guide: improving the quality of facility-based delivery for mothers and newborns. http://www.who.int/patientsafety/implementation/checklists/childbirth-checklist_implementation-guide/en/. 2015.Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Maternal Health
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
I cannot comment. A qualified statistician is required.
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Global health, Quality improvement, Maternal Health, Anesthesia, and Medical Education.
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | |||
---|---|---|---|
1 | 2 | 3 | |
Version 1 20 Jul 20 |
read | read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with Gates Open Research
Already registered? Sign in
If you are a previous or current Gates grant holder, sign up for information about developments, publishing and publications from Gates Open Research.
We'll keep you updated on any major new updates to Gates Open Research
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)