Skip to content
ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Method Article

WhatsApp as a medium to collect qualitative data among adolescents: lessons learned and considerations for future use

[version 1; peer review: 1 approved with reservations, 1 not approved]
PUBLISHED 14 Sep 2020
Author details Author details

Abstract

In the field of adolescent sexual and reproductive health (ASRH), candid youth perspectives are necessary for understanding the nuances surrounding contraceptive access and use. Methods of data collection leveraging technological solutions may provide avenues for increased privacy for adolescents. With the use of WhatsApp and other smartphone-based messaging applications as platforms for qualitative methodologies, public health researchers may find increased access to adolescents through utilizing mediums that adolescents already engage with in their daily lives. This article describes the use of WhatsApp as a data collection methodology with adolescents in Malawi.
In June 2018, VillageReach used WhatsApp to conduct focus group discussions (FGD) to collect qualitative data on contraceptive use from Malawian youth. WhatsApp FGD participants were male and female adolescents, aged 15-19 representing rural and urban populations across three geographic regions of Malawi (northern, central and southern). Youth researchers (YR), aged 22-25, were trained and facilitated fifteen WhatsApp FGDs, as in-person (12) and remote (3) sessions. WhatsApp FGDs consisted of a YR sharing fictitious but contextually realistic ASRH scenarios, and managing the virtual discussion with questions and probing. Youth indicated comfort using WhatsApp to express their opinions and experiences related to contraceptive use and preferences. Based on the data collected, the researchers felt that use of the technology may increase willingness to provide additional levels of information during anonymized WhatsApp FGDs vis à vis traditional, in-person FGDs.
Using WhatsApp as a methodological tool to facilitate FGDs has practical implications for data collection, data quality and data analysis. This paper reports lessons learned as well as the advantages and disadvantages of using WhatsApp to conduct FGDs in a low-resource setting. It also calls for developing guidelines and an ethical code of conduct for the future use of mobile applications for conducting qualitative research with vulnerable populations.

Keywords

adolescents, sexual health, WhatsApp, Malawi, contraception, qualitative methods, focus groups

Introduction

In the field of adolescent sexual and reproductive health (ASRH), candid youth perspectives are necessary to understanding the nuances of contraceptive access and use. In Malawi, where 22% of married and 52% of unmarried sexually active women between the ages of 15–19 report an unmet need for family planning (National Statistical Office/Malawi and ICF, 2017), more precise data on adolescents’ contraceptive barriers, needs and preferences is needed to bridge the gap between adolescents who want to prevent pregnancies but do not use contraception. Technology may provide an avenue for collecting this ASRH data and with added privacy.

WhatsApp is a mobile messaging technology popular across the world, allowing users to send images, text, video and voice messages; and conduct individual or group conversations1 (Kumar & Sharma, 2017). As WhatsApp has become a popular medium for communication (Rosenfeld et al., 2018), examples have emerged of the platform being used in health care and public health2. WhatsApp has been employed to conduct supportive supervision with community health care workers, reduce rural health worker feelings of isolation and recent nursing graduates’ fears about transitioning to professional life, improve communication between consulting and emergency physicians, support delivery of out-of-hours pharmacy services, and bolster medical education programs (Ajuwon et al., 2018; Copestake et al., 2020; Gulacti et al., 2016; Henry et al., 2016; Pimmer et al., 2017; Pimmer et al., 2019; Pimmer, 2015; Raiman et al., 2017; Rathbone et al., 2020; Willemse, 2015; Willemse et al., 2019). WhatsApp has also been utilized to help deliver public health interventions, including a bed net campaign in Mozambique, HIV counseling for men who have sex with men in Peru, and for sending health information to new parents in South Africa3 (Arroz et al., 2019; Bayona et al., 2017). However, there are few recorded examples of WhatsApp being used for research in public health (Chen & Neo, 2019; Fardousi et al., 2019). The use of WhatsApp focus group discussions (FGDs) for a 2019 waste management study in Singapore indicated the potential for using the platform for health research, while underscoring the need to further develop mobile messaging as a qualitative research method (Chen & Neo, 2019). Another study published in 2019 utilized WhatsApp to conduct remote interviews exploring health workers’ perceptions in a conflict zone. The study commented on issues such as internet connectivity and confidentiality concerns as factors that impacted the ability to conduct interviews via WhatsApp (Fardousi et al., 2019).

In June 2018, VillageReach used WhatsApp FGDs to collect qualitative data from Malawian youth on contraceptive needs and preferences, as part of a larger study funded by the Bill & Melinda Gates Foundation entitled Youth-led Contraceptive Knowledge Generation and Design. WhatsApp was selected as a tool for eliciting information from adolescents because the mobile messaging application is popular among sub-populations of Malawian youth4 (Matto & Kazungu, 2018), thereby offering researchers a chance to test whether or not the platform could offer an innovative approach to obtaining sensitive information from young people who may be uncomfortable sharing such information in traditional face-to-face FGDs.

Approach

Fifteen WhatsApp FGDs were conducted, either as in-person (12) or remote (3) sessions. In-person WhatsApp FGDs were conducted at a specific time and location, such as youth clubs, sports facilities, schools or health centers, for approximately one hour. Remote FGDs convened several times each week over the period of one month, ranging from discussions totaling three hours to 10 hours each week. Participants were male and female Malawian adolescents, aged 15–19 (n=134). Sessions occurred in three target geographic regions across Malawi (northern, central and southern). The study was approved by the Malawi National Health Sciences Research Committee (Protocol Number: 17/05/1813).

To recruit WhatsApp FGD participants the study team met with youth network community leaders and district youth officers to describe the research and target group. These community contacts then reached out to local youth groups, purposively selecting potential participants who fit the age and geographic sampling criteria. In-person WhatsApp FGD participants (n=96) were loaned a WhatsApp-enabled phone for one hour to allow for their participation in the FGD. In-person participants were mixed gender, stratified by marital status, urban/rural locality, and geographic region (or district); there were eight participants per FDG Remote WhatsApp FGD participants (n=38) did not gather at a central location; rather they used their own WhatsApp-enabled smartphones to respond to the weekly facilitated scenarios as they continued with their daily activities. Remote groups were mixed with regard to participant gender, marital status, and urban/rural locality, and were only stratified by geographic region. Northern, central and southern region remote sessions had 9, 11, and 16 participants, respectively.

Six Malawian youth researchers (YRs), aged 22-to 25 and native to the target districts, were recruited to facilitate the WhatsApp FGDs. The YR position was posted on local job boards and newspapers and resulted in over 500 applications, of which 23 applicants were interviewed. The interviews covered past experience and how applicants would handle hypothetical data quality and research ethics scenarios. A scoring rubric was completed by the interview panel and scores were used to select the six YRs for hire. Facilitation training for the YRs lasted four days and included study background, research ethics, FGD logistics, and role as moderator. Just prior to WhatsApp data collection we hosted a four hour refresher training devoted to the WhatsApp technology and how to moderate in that context. Following the training, YR’s worked with VillageReach staff to finalize eight scenarios depicting context-relevant ASRH situations to generate discussion in the FGD sessions.

Participants provided written informed consent and those participating in the in-person FGDs with study phones were given transport reimbursement, while those in the remote FGDs and using personal phones were compensated with 500MB of airtime data. Participants were given an additional 500MB of data as needed during the course of the remote sessions. WhatsApp FGDs consisted of a YR sharing an ASRH scenario, and then managing the virtual discussion with posed questions and probing. Participants were able to message directly with the YR if they did not want to share something with the full group. A VillageReach staff member was present at each in-person session and was included in each remote group to provide support to the YRs if needed.

Debriefing sessions were held either in-person or by phone following each FGD in which VillageReach staff and YRs iteratively discussed their observations and experiences and built consensus on what worked, what did not work and lessons learned for future use of WhatsApp FGDs; these findings were documented as debriefing summaries and approved by all debriefing session participants.

Lessons learned

Applying WhatsApp mobile messaging technology to facilitate FGDs yielded learnings about use of this methodology related to data collection, data quality and data analysis.

Data collection

Using an application reliant on mobile data or internet connectivity led to challenges in data collection. For example, in some areas with limited mobile network coverage there were delays in the ‘chat’ causing messages to appear long after they were written. This resulted in disorganized conversations which were challenging for YRs and participants to follow. For some of the rural in-person sessions, unavailable or unstable electricity led to phones losing battery charge during sessions, resulting in participants dropping in and out of the group while YRs made alternate power sources available. In some cases, participants had to move from one area to another in search of a location with strong enough mobile data network coverage, causing delays in data collection. Despite these challenges, using WhatsApp technology enhanced the quantity of data collected in several ways. For example, with remote FGDs, the use of WhatsApp allowed for ongoing discussion over longer periods of time and distance. Although participation did taper off toward the end of the four-week period, in general the elongated timeframe allowed for increased quantity of data. The difference is attributable to remote groups responding to more scenarios than the in-person groups, as well as having increased time to reflect and share their thoughts. Additionally, remote participants shared that as they could access improved internet connectivity throughout the month, and this allowed them the opportunity to further comment on scenarios. This option offered increased time and flexibility for discussion in comparison to the in-person FGDs but also required increased effort to effectively moderate and supervise.

Data quality

When compared to data collected using traditional FGDs earlier in the study, WhatsApp FGDs elicited similar findings. Participants in the WhatsApp FGDs shared detailed examples and engaged in extended discussions about their experiences and preferences. In some cases, this led to language or discussions that the YRs felt were too explicit, and they redirected the discussion per their training. In remote-FGDs, transferability of results to other low-income groups may be impacted since access to a smartphone inherently meant participants in remote FGDs were likely from a higher income demographic. In-person session participants were loaned smartphones; those who had never used one before were not able to use the technology as quickly or as effectively to communicate, although they were able to utilize the voice memo function to clearly express themselves.

Data analysis

Challenges encountered during data collection affected our ability to analyze WhatsApp FGD data. Choppy discussion threads due to limited network coverage in some areas led to difficulty trying to piece together narratives during transcription. One unanticipated issue was that participants favored using the voice memo feature over typing. Despite an intensive search, no efficient way to export the incoming text and voice memos into one file compatible with both text and audio, in chronological order, was identified. Thus, both audio recording and text messages had to be manually woven together to construct a complete transcript. In the end, this additional work resulted in use of discussion summary rather than verbatim transcription for analysis, and delayed the overall analysis process.

Considerations for future use

While there are benefits to the WhatsApp FGD methodology, there are considerations that may complicate data collection in comparison to other qualitative methods. The approach requires certain logistics such as access to power sources to keep phones charged as well as WIFI or stable mobile data network connection to ensure FGDs run smoothly, and ensuring these pre-conditions exist requires planning. Additionally, the methodology may not be conducive to every demographic and as elaborated elsewhere, requires target populations to have some level of smartphone literacy, which should be considered when sampling populations with low rates of smart phone ownership (Chen & Neo, 2019).

Costs associated with WhatsApp FGDs (providing devices, data) may prohibit use of the platform for research in health. However, with a projected increase in smartphone ownership5 paired with introduction of low-cost WhatsApp bundles by some sub-Saharan mobile network operators, more people have access to this platform and other social media than ever before6. WhatsApp may also be a more cost-effective option in some circumstances, as it allows researchers to collect data on an ongoing basis without traditional costs such as hall rentals, transportation reimbursement to participants, etc.

Regardless of cost, this methodology may be more convenient for researchers and participants in some cases, particularly if aiming to engage the same cohort over time. The method may also be better positioned to reach the adolescent audience due to the technology’s flexibility, convenience and portability, and expanding familiarity of the WhatsApp platform (and of smartphones, generally) in adolescent sub-populations across Africa7. Further, our research indicates that the anonymity and privacy offered by WhatsApp FGDs may be an important factor in youth feeling comfortable to share sensitive information, especially in social environments like Malawi where adolescents place a high value on keeping sexual behavior hidden from elders, parents and peers (Limaye et al., 2012; Munthali et al., 2006).

Conclusions/discussion

WhatsApp provides an alternative platform for researchers when eliciting information from adolescents on sensitive topics. The tool has both advantages and disadvantages associated with data collection, data quality and analysis, which should be considered prior to using WhatsApp for FGDs. The potential of this methodology is to allow researchers to collect in-depth and granular qualitative data and is a strength of the approach when working with challenging topics or stigmatized populations, who may be particularly concerned participating in more visible forms of data collection such as in person FGDs or in-depth interviews. Adolescents indicated feeling comfort using WhatsApp to share their perspectives on sensitive topics. Additionally, the opportunity to collect qualitative data over a longer period of time allows researchers to collect a great quantity of data as well as offers the potential for in-depth nuanced data as participants have more time to gain confidence and trust with the researchers and fellow participants.

By utilizing mobile messaging technologies, such as WhatsApp, health researchers may be better able to connect to adolescent experiences in ways reflecting contemporary youth culture and communication preferences. This in turn, could enhance the visibility of youth perspectives in health research and help improve the effectiveness of youth-targeted public health interventions.

As the use of WhatsApp grows to support health sector projects, there is a need to elevate more examples of lessons learned to drive technology to address the challenges faced using the tool. It will also be important to promote successes so researchers can consider whether it is a suitable platform for their work. As technology is applied in new ways in research, it is critical that the research community establishes guidelines for addressing ethical considerations, such as recruitment of diverse perspectives and considerations around data security and privacy.

Data availability

All data underlying the results are available as part of the article and no additional source data are required.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 14 Sep 2020
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
Gates Open Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Singer B, Walsh CM, Gondwe L et al. WhatsApp as a medium to collect qualitative data among adolescents: lessons learned and considerations for future use [version 1; peer review: 1 approved with reservations, 1 not approved]. Gates Open Res 2020, 4:130 (https://doi.org/10.12688/gatesopenres.13169.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 14 Sep 2020
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

Are you a Gates-funded researcher?

If you are a previous or current Gates grant holder, sign up for information about developments, publishing and publications from Gates Open Research.

You must provide your first name
You must provide your last name
You must provide a valid email address
You must provide an institution.

Thank you!

We'll keep you updated on any major new updates to Gates Open Research

Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.