Gates Open Res Gates Open Research 2572-4754 F1000 Research Limited London, UK 10.12688/gatesopenres.14896.1 Open Letter Articles Demystifying physiologically based pharmacokinetic modelling among non-modelers towards model-informed medicine use in under-served populations.

[version 1; peer review: 4 approved, 2 approved with reservations]

 Freriksen Jolien Conceptualization Data Curation Formal Analysis Investigation Methodology Project Administration Writing – Original Draft Preparation Writing – Review & Editing a 1 Heijden Joyce van der Data Curation Formal Analysis Investigation Methodology Writing – Original Draft Preparation Writing – Review & Editing 1 de Hoop-Sommen Marika Data Curation Formal Analysis Methodology Writing – Original Draft Preparation Writing – Review & Editing 1 Johnson Trevor Data Curation Formal Analysis Investigation Methodology Software Writing – Original Draft Preparation Writing – Review & Editing 2 Yeo Karen R Data Curation Investigation Methodology Resources Software Supervision Writing – Original Draft Preparation Writing – Review & Editing 2 Kerwash Essam Data Curation Formal Analysis Investigation Methodology Writing – Original Draft Preparation Writing – Review & Editing https://orcid.org/0000-0003-4368-8565 3 Cole Susan Conceptualization Data Curation Formal Analysis Funding Acquisition Investigation Methodology Project Administration Supervision Writing – Original Draft Preparation Writing – Review & Editing 3 Nooney Janet Conceptualization Data Curation Formal Analysis Investigation Supervision Writing – Original Draft Preparation Writing – Review & Editing 2 Greupink Rick Data Curation Formal Analysis Funding Acquisition Investigation Methodology Writing – Original Draft Preparation Writing – Review & Editing 1 Zhao Ping Conceptualization Data Curation Formal Analysis Investigation Methodology Project Administration Resources Writing – Original Draft Preparation Writing – Review & Editing https://orcid.org/0009-0009-6335-3464 b 4 Wildt Saskia de Conceptualization Data Curation Formal Analysis Funding Acquisition Investigation Project Administration Supervision Writing – Original Draft Preparation Writing – Review & Editing 1 5 Radboud University, Nijmegen, Gelderland, The Netherlands Certara UK Limited, Sheffield, UK Medicines and Healthcare Products Regulatory Agency, London, UK Bill & Melinda Gates Foundation, Seattle, Washington, USA Erasmus MC-Sophia Children's Hospital, Rotterdam, The Netherlands Jolien.Freriksen@radboudumc.nl ping.zhao@gatesfoundation.org

Competing interests: T.N.J. and K.R.Y. are employees of Certara UK Limited (Simcyp Division). The authors declared no competing interests for this work. All other authors declare that they have no conflict of interest.

 26 10 2023 2023 7 128 29 9 2023 Copyright: © 2023 Freriksen J et al. 2023 This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Physiologically based pharmacokinetic (PBPK) models represent computational technology to characterize drug behavior within the context of detailed human physiology. Today, PBPK is routinely used in drug development and regulatory approval to support decisions on how a medicine can be used under certain clinical conditions. As such, PBPK has the potential to enhance medicine use for populations that are often under-served globally in drug development and clinical care, namely pediatric patients, pregnant and lactating women. To facilitate broader applications of PBPK for these populations, we joined force and organized five hands-on workshops primarily to non-modelers on the principles of PBPK and its potential applications in pediatric and obstetric pharmacology in 2021 and 2022. In this open letter, we report learning objectives and content of such workshops and to highlight the significant value of these educational efforts.

 Dosing Under-served Populations Model-informed Drug Development Pediatrics Pharmacokinetics Pregnancy Gates Foundation INV-009383 This work is supported by the Gates Foundation (INV-001822, INV-009383, and INV-040110). Disclaimer

The views expressed in this article are those of the author(s). Publication in Gates Open Research does not imply endorsement by the Bill & Melinda Gates Foundation. The views may not be understood or quoted as being made on behalf of or reflecting the position of the Medicines and Healthcare products Regulatory Agency, UK.

 Ethics statement

As it is not a medical/health research, no otherwise sensitive information was collected, participation was voluntarily and data were processed anonymously, explicit written informed consent was not sought.

 Value of physiologically based pharmacokinetic modeling for under-served populations

There is a general lack of on-label drug dosing information for pediatric patients, pregnant and lactating women 1, 2 . Historically, these populations have hardly been evaluated in clinical programs during the development of drug products. Even when clinical studies are conducted, the generalizability of such studies can be limited because the effect of relevant age and/or pregnancy-related physiological and anatomical variations can significantly complicate a drug’s pharmacology in a specific subgroup of these populations, calling for different dosage adjustments in different subgroups. To this end, computational tools such as physiologically based pharmacokinetic (PBPK) modeling which characterize the physiological changes can be used to support dosing decisions 3– 5 .

A PBPK model consists of several compartments representing organs and tissues. Maturational effects of physiology can be described using (gestational) age-dependent equations. This allows the creation of a set of virtual subjects, each representing anatomical and physiological characteristics of pediatric subjects or pregnant and lactating women at a specific developmental stage (the system model). In parallel, one can compile drug-dependent parameters to construct a drug model, and couple it with the system model through relevant physiological processes concerning the absorption and disposition of the drug. A user-defined virtual trial then can be conducted to simulate pharmacokinetic (PK) characteristics in a specific virtual subject or sub-population. Such PK information can then form the basis for dosing decisions 6 .

In the last two decades, advancements in computation and pharmacological sciences fueled the industrialization of PBPK. Today, PBPK is a platform technology used routinely by drug developers and regulatory agencies to inform dosing recommendations for a wide range of applications 7 . Interest in PBPK modeling to predict PK in pediatric and pregnant subjects has increased dramatically over the past few years 6, 8 . Of all regulatory submissions involving PBPK modeling received by the US Food and Drug Administration (FDA) in 2018 – 2019, 9% were related to pediatric population 7 . Application of pediatric PBPK models also increased in clinical and research settings, for both biologics and small molecules 9 . While in silico PBPK modeling is generally conducted to inform clinical trial design in pediatric and pregnant populations, it can also be applied in the post marketing stage to inform drug dosing 10 .

 Demystifying PBPK among non-modelers towards broader application in under-served populations

PBPK is ideal to investigate and predict effects of dynamic physiological changes on a drug’s pharmacology. Although the FDA reported emerging use of PBPK in pediatrics, no application was recorded to inform drug dosing in pregnant and lactating women 7 . This gap can be attributed to the low confidence in PBPK for these intended uses, and/or the lack of understanding of today’s PBPK as a platform technology by broader medical communities. While the former can be continuously improved through increased PBPK research in the space of pediatric and obstetric pharmacology 6, 8 , the latter requires introduction of PBPK to stakeholders who have little or no experience in pharmacology modeling. As such, we joined force and conducted five workshops in 2021 and 2022 primarily targeting these non-modeler audiences ( Table 1).

Five PBPK modeling workshops held in 2021 – 2022.

aRadboud Summer School of 2021 also included exercises related to applying PBPK modeling to evaluate in vitro-to-in vivo extrapolation and drug-drug interactions in healthy subjects. b MHRA workshop aimed at those primarily interested in PK changes in pregnancy, rather than PBPK modeling specifically. (Supplemental file 1)

Workshop Date, location and duration Attendees Populations discussed Number (% total) attendees participated in survey before the workshop Number (% total) attendees participated in survey after the workshop
Part of the Radboud Summer School “Introduction to Pharmacokinetic and Pharmacodynamic Analysis” July 2021 Online Half day 26 delegates a (global) 5 tutors Pediatric and pregnant population 22 (85%) 12 (46%)
Pre-congress course of the 19th European Society for Developmental Perinatal and Paediatric Pharmacology (ESDPPP) meeting June 2022 In-person Liverpool (UK) One day 37 delegates (mostly European) 11 tutors Pediatric and pregnant population 18 (49%) 9 (24%)
Part of the Radboud Summer School “Introduction to Pharmacokinetic and Pharmacodynamic Analysis” July 2022 Online Half day 29 delegates a (global) 5 tutors Pediatric and pregnant population 28 (97%) 21 (72%)
Satellite Session of the American Society for Clinical Pharmacology & Therapeutics (ASCPT) meeting September 2022 Online One day 45 delegates (global) 14 tutors Pediatric and pregnant population 33 (73%) 12 (27%)
Medicines and Healthcare products Regulatory Agency (MHRA) workshop October 2022 In-person London (UK) One day + two (1hr) online pre-event sessions 32 delegates b (mostly UK) 7 tutors Pregnant population Not applicable as all feedback was collected after the workshop 20 (63%

These workshops target clinicians, pharmacists, academic researchers and scientists from non-governmental organizations, ranging from the (PhD) student to senior fellows, as well as clinical assessors from regulatory agencies, with an interest in pediatrics and/or obstetrics pharmacology. Recruitment of participants were by targeted advertising and selection for MHRA workshop, and through announcement by Radboud Summer School, European Society for Developmental Perinatal and Paediatric Pharmacology (ESDPPP), and American Society for Clinical Pharmacology & Therapeutics (ASCPT). No inclusion/exclusion criterion was specified. No prior knowledge of PBPK modeling and accessibility to PBPK modeling software was required for Radboud Summer School, ESDPPP, and ASCPT events.

All workshops shared similar features by including theoretical and hands-on sessions. The theoretical sessions were designed to

Disseminate the basics of PK and PBPK modeling.

Demonstrate the utility and impact of PBPK modeling in drug development and clinical practice.

Raise awareness of the impact of pregnancy and age-related changes on drug disposition.

Discuss key regulatory and clinical considerations when applying these models to inform drug dosing.

The hands-on sessions employed a PBPK platform technology (Simcyp ® v21, Certara UK Limited, Simcyp Division, Sheffield, UK) to help attendees to

Become familiar with basics of PK and PBPK modeling.

Visualize the impact of anatomical and physiological changes on drug disposition.

Understand the implications of dose modification in children and pregnant women.

Presentations of theoretical sessions were tailored according to the specific audience in a particular workshop and hands-on sessions were optimized with clinical cases that are generally familiar to the audience. The hands-on sessions were led by tutors in small groups each including 5 to 8 participants. Attendees accessed the Simcyp software via Amazon WorkSpaces. A mix of tutors from academia, industry or regulatory agencies enabled diverse discussions within each group. The technological requirement of a proprietary software such as Simcyp and the need to have tutors who are experienced users of the software for our workshops can be replicated using other PBPK software platforms, such as GastroPlus ® ( https://www.simulations-plus.com/software/gastroplus/) and PKSim ®/Mobi ® ( https://www.open-systems-pharmacology.org/). A hands-on exercise was followed by a plenary session, in which results and perspectives by each group were shared with other groups to stimulate interactive discussions. In one case study of a typical workshop (e.g., ESDPPP), delegates first simulated PK of anti-HIV drug efavirenz after a typical dose in the adult population, followed by simulating different doses in the pediatric population according to different pediatric dosing guidelines (e.g., those from US Food and Drug Administration and World Health Organization). The groups then explored the impact of either ethnicity, a weekends-off treatment regimen, or varying assumptions on CYP2B6 ontogeny on efavirenz pharmacokinetics. Results were presented in the plenary, and delegates reported their findings and related real life clinical experiences to the simulation results.

Final agendas including speakers, presentations, and hands-on case studies for these five workshops can be found in Supplementary File 1.

 Effectiveness of our workshops

To understand the impact of our workshops, we conducted online surveys before and after the workshops (Supplementary file 2). Because the surveys are voluntary, not all participants responded ( Table 1). It was more challenging to obtain complete feedback after the workshop (for example, 36–75% of original responders before each workshop responded to the same question after the workshop at Radboud Summer School, ESDPPP and ASCPT events, Table 1), which limits the assessment of the impact of the workshop on changing attendees’ perspectives. As such, caution should be made when interpreting the survey results, especially when using percentage of responders to evaluate change in perspectives before and after the workshops.

Some general findings from the surveys were:

The majority of responders across all five workshops were considered ‘non-modelers’ because they were not familiar with PBPK (Figures S4–S6, S23, Supplementary file 2). For Radboud, ESDPPP, and ASCPT workshops, many of the respondents were PhD students, followed by postdoctoral researchers and pharmacists, mostly working in the field of pediatrics. Most delegates had only heard and read about PBPK modeling prior to the workshop, did not read PBPK modeling papers frequently, and had the impression that PBPK studies are difficult to interpret. Participants at the MHRA workshop were mostly pharmacists or clinicians working in obstetrics, and none of the responders were confident in PBPK before the workshop.

The workshops appeared to be effective in leveling the ground for attendees to (i) understand state of science and technology and (ii) confidently apply PBPK. When asked ‘do you have sufficient knowledge and skills at this moment to conduct PBPK model simulations?’, most of the responders answered no before the workshops, yet they felt more capable of doing so after the workshop (Figure S7 of supplemental file 2). There was an increased percentage of responders after the workshop considering that ‘possessing mathematical and programming skills’ (Figure S10, supplemental file 2) is not necessarily essential. Similarly, responders at MHRA workshop tended to feel more confident in PBPK after the event (Figure S23–24, Supplemental file 2). The increased confidence and updated perspectives in attendees can be attributed to easy access to PBPK as a technology platform during the workshop, instead of modeling in the form of differential equations. With technology at hand, attendees can explore various modules constructed within the PBPK platform to visualize relevant physiology changes and pharmacological processes, execute simulations, and discuss simulation results within 30–45 minutes of a hands-on session. The experience of efficiently applying PBPK to answer clinical questions helped attendees to have updated views of PBPK.

The attendees appeared to appreciate the value of PBPK in optimizing medicine use in under-served populations. For example, responders’ answer to the question 'are we at the point of using PBPK model output to inform drug labelling' tended to transition from being split to being confident that the field is ready to apply PBPK output to inform drug labels (Figure S15, Supplemental file 2). Responders also acknowledged the capability of PBPK to simulate drug exposure in fetuses upon maternal administration, as well as drug exposure in preterm and term neonates after the workshops (Figure S15, Supplemental file 2).

All participants indicated the practical examples on dose adjustments with hands-on modeling as the most useful aspects. Many were interested in simulating dosing scenarios for specific drugs in tailored virtual patient populations, fostering follow-up discussions on research collaborations.

Clinically oriented users asked for a simpler interface for the PBPK modeling software and expressed an interest in more real-world examples, particularly related to the top 10 frequently used medicines in clinical practice. Whilst some expressed the desire to have access to more user-friendly dosing tools based on contemporary PBPK technology, others however indicated that they still wanted to understand the science behind the software.

 Final thoughts

An adequate understanding of the concept and the state-of-the-technology of PBPK by healthcare providers is a critical step towards successful application of the tool to optimize pharmacotherapy in specific patient populations. Through these workshops, we effectively raised awareness of the relevance of PBPK in the context of clinical care, which reduces the barrier to implement PBPK modeling in informing drug dosing in children and pregnant women. We continue to collaborate in this space.

 Data availability

Figshare. Supplemental files for "Demystifying Physiologically Based Pharmacokinetic Modeling among Non-Modelers towards Model-informed Medicine Use in Under-served Populations" (Submitted to Gates Open Research). DOI: 10.6084/m9.figshare.24153456

This project contains the following underlying data:

Supplemental file 1 (Workshop agendas)

Supplemental file 2 (survey results)

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

 Schrier L Hadjipanayis A Stiris T : Off-label use of medicines in neonates, infants, children, and adolescents: a joint policy statement by the European Academy of Paediatrics and the European society for Developmental Perinatal and Pediatric Pharmacology. Eur J Pediatr. 2020;179(5):839–47. 31897842 10.1007/s00431-019-03556-9 Wisner KL Stika CS Watson K : Pregnant women are still therapeutic orphans. World Psychiatry. 2020;19(3):329–30. 32931103 10.1002/wps.20776 7491609 Perry C Davis G Conner TM : Utilization of Physiologically Based Pharmacokinetic Modeling in Clinical Pharmacology and Therapeutics: an Overview. Curr Pharmacol Rep. 2020;6(3):71–84. 32399388 10.1007/s40495-020-00212-x 7214223 Koren G Pariente G : Pregnancy- Associated Changes in Pharmacokinetics and their Clinical Implications. Pharm Res. 2018;35(3): 61. 29435666 10.1007/s11095-018-2352-2 Kearns GL Abdel-Rahman SM Alander SW : Developmental pharmacology--drug disposition, action, and therapy in infants and children. N Engl J Med. 2003;349(12):1157–67. 13679531 10.1056/NEJMra035092 Verscheijden LFM Koenderink JB Johnson TN : Physiologically-based pharmacokinetic models for children: Starting to reach maturation? Pharmacol Ther. 2020;211: 107541. 32246949 10.1016/j.pharmthera.2020.107541 Zhang X Yang Y Grimstein M : Application of PBPK Modeling and Simulation for Regulatory Decision Making and Its Impact on US Prescribing Information: An Update on the 2018-2019 Submissions to the US FDA's Office of Clinical Pharmacology. J Clin Pharmacol. 2020;60 Suppl 1:S160–S78. 33205429 10.1002/jcph.1767 Chaphekar N Dodeja P Shaik IH : Maternal-Fetal Pharmacology of Drugs: A Review of Current Status of the Application of Physiologically Based Pharmacokinetic Models. Front Pediatr. 2021;9: 733823. 34805038 10.3389/fped.2021.733823 8596611 Johnson TN Small BG Rowland Yeo K : Increasing application of pediatric physiologically based pharmacokinetic models across academic and industry organizations. CPT Pharmacometrics Syst Pharmacol. 2022;11(3):373–83. 35174656 10.1002/psp4.12764 8923731 Freriksen JJM van der Heijden JEM de Hoop-Sommen MA : Physiologically Based Pharmacokinetic (PBPK) Model-Informed Dosing Guidelines for Pediatric Clinical Care: A Pragmatic Approach for a Special Population. Paediatr Drugs. 2023;25(1):5–11. 36201128 10.1007/s40272-022-00535-w 9534738 10.21956/gatesopenres.16225.r36314 Reviewer response for version 1 Brooks Kristina M. 1 Referee University of Colorado Anschutz Medical Campus, Aurora, USA

Competing interests: No competing interests were disclosed.

 22 7 2024 Copyright: © 2024 Brooks KM 2024 This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. recommendation approve

Freriksen et al. report on their experiences with providing workshops focused on educating non-modelers on the principles and potential applications of PBPK, with a more specific focus on pediatric, pregnant, and lactating populations. These educational initiatives are important for helping demonstrate the utility of this modeling approach to clinicians and researchers. General feedback from attendees appeared to confirm that these workshops did help “demystify” attendees’ understanding and ability to use/apply PBPK, and general findings from these trainings are helpful as a starting point for figuring out how to educate people on a larger scale.

Please consider the following suggestions:

Pg. 4, Table 1: consider providing a breakdown of the amount of time spent listening to didactic sessions vs. hands-on learning activities alongside the total duration of the workshops

Pg. 4: The statement on “The technological requirement of a proprietary software…” felt a bit out of place and it did feel like some brief commentary on this aspect could also be helpful for readers. I would consider pulling this out into a separate paragraph/subheading on the ability to apply this to other software, but I do think explicitly noting open-source options and some of the pros/cons with this approach would be helpful if the authors are familiar with these other programs. Cost and ability to access software seem like important points to consider in addition to educating non-modelers in this space to ensure that these programs are used after the training.

Pg. 5: There is a statement on “We continue to collaborate in this space.” However, I do think some high-level commentary on future directions and ways to potentially increase access would be helpful to give readers a sense of how this educational space will continue to evolve.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Clinical pharmacology, infectious diseases, pediatrics, pregnancy

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

 10.21956/gatesopenres.16225.r36765 Reviewer response for version 1 Kammala Ananth Kumar 1 Referee https://orcid.org/0000-0001-5300-2083 The University of Texas Medical Branch at Galveston, Texas, USA

Competing interests: No competing interests were disclosed.

 19 7 2024 Copyright: © 2024 Kammala AK 2024 This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. recommendation approve

The manuscript, “Demystifying physiologically based pharmacokinetic modelling among non-modelers towards model-informed medicine use in underserved populations,” highlights the success of workshops designed to demystify physiologically based pharmacokinetic (PBPK) modeling for non-modelers. These workshops have effectively raised awareness and understanding among clinicians, pharmacists, and academic researchers about using PBPK to optimize drug dosing in underserved populations.

The workshops engaged diverse participants, including PhD students, postdoctoral researchers, pharmacists, and clinical assessors from regulatory agencies. This wide range of attendees indicates the broad relevance and applicability of PBPK modeling in different fields.

Although it has several advantages but there are few limitations of the manuscript to be addressed.

The workshops relied on the proprietary software Simcyp®, which may not be accessible to all scientists. Although the manuscript suggests similar workshops could be conducted using other PBPK software platforms, such as GastroPlus® and PKSim®, the lack of direct experience with these alternatives is a limitation.

The manuscript notes that interpreting survey results, particularly when comparing percentages to absolute numbers, can be challenging. This complexity may introduce bias in understanding the true impact of the workshops.

By addressing these strengths and limitations, the manuscript provides a comprehensive overview of the value and challenges of using PBPK modeling to inform drug dosing in underserved populations.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Reproductive pharmacology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

 10.21956/gatesopenres.16225.r36766 Reviewer response for version 1 Maharaj Anil 1 Referee University of British Columbia, Vancouver, Canada

Competing interests: No competing interests were disclosed.

 19 7 2024 Copyright: © 2024 Maharaj A 2024 This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. recommendation approve-with-reservations

The submitted open letter summarizes 5 educational workshops on fostering an understanding of PBPK modeling to non-modelers and provides an analysis of feedback received from attendees. As PBPK modeling is commonly inferred to be an inherently complex process, the submitted letter, which details how educational workshops can be used to bridge the knowledge gap among non-modelers, is of contemporary interest. A key strength of this letter is the collection and analysis of quantitative survey data from workshop attendees as it serves to substantiate assertions/positions discussed by the authors. The following comments are focused on improving the clarity of the submitted letter:

1.    Abstract: “As such, PBPK has the potential to enhance medicine use for populations that are often under-served globally in drug development and clinical care, namely pediatric patients, pregnant and lactating women.”

Logical flaw - The opening sentences of the abstract do not provide an appropriate context/rationale as to why PBPK modeling is suitable for examining PK in underserved populations.

2.    “To this end, computational tools such as physiologically based pharmacokinetic (PBPK) modeling which characterize the physiological changes can be used to support dosing decisions (3–5)”

References (particularly ref 4 and 5) do not discuss the use of PBPK modeling to support drug dosing decisions.

3.    “In parallel, one can compile drug-dependent parameters to construct a drug model, and couple it with the system model through relevant physiological processes concerning the absorption and dis- position of the drug.”

Confusing sentence – unclear as to what is the output from combining drug- and system-specific parameters. Consider revising to indicate that combining drug- and system-specific parameters allows models to generate PK estimates that are developmentally specific.

4.    Suggest defining the acronym MHRA in the body of the letter. 

5.    Suggest indicating how many (of the 5) workshops were online and how many were in-person within the body of the letter.

6.    Why were MHRA survey results not integrated with the rest of the workshops in supplementary document 2? Were the survey questions for this workshop unique or different?

7.    Consider including dialogue on how future workshops could be improved (or separating the ‘Effectiveness of our workshops’ section between strengths and areas for improvement).

8.    “The increased confidence and updated perspectives in attendees can be attributed to easy access to PBPK as a technology platform during the workshop, instead of modeling in the form of differential equations.”

Do survey results directly support this statement? If so, please include dialogue that links this proposition to quantitative results from the survey.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Pharmacokinetic modeling, pediatrics, pregnancy, and lactation.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

 10.21956/gatesopenres.16225.r36760 Reviewer response for version 1 Guo-Fu Li 1 2 Referee https://orcid.org/0000-0002-4628-9941 Subei People's Hospital, Yangzhou, China China Pharmaceutical University,, Nanjing, China

Competing interests: No competing interests were disclosed.

 19 7 2024 Copyright: © 2024 Guo-Fu L 2024 This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. recommendation approve

I find this open letter written by renowned and experienced experts in the field of PBPK modeling to be both interesting and informative. I have one suggestion: should the authors emphasize the best practice strategy in the use of PBPK modeling to address specific medicine use questions in underserved populations? Highlighting the best practice, particularly regarding the differing levels of quantification or verification of PBPK, could enhance the confidence of non-modeler attendees in using their PBPK models to address their intended questions.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Physiologically-based pharmacokinetic modeling; clinical pharmacology; clinical pharmacy; biostatistics

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

 10.21956/gatesopenres.16225.r36318 Reviewer response for version 1 Amaeze Ogochukwu Ukamaka 1 2 Referee https://orcid.org/0000-0003-3348-7700 University of Washington, Washington, USA Clinical Pharmacy and Biopharmacy, University of Lagos, Yaba, Federal Capital Territory, Nigeria

Competing interests: No competing interests were disclosed.

 19 7 2024 Copyright: © 2024 Amaeze OU 2024 This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. recommendation approve-with-reservations

The paper “Demystifying physiologically based pharmacokinetic modelling among non-modelers towards model-informed medicine use in under-served populations” outlines the details and outcomes of five workshops designed for non-modelers. These workshops aimed to impart knowledge of the science and technology behind PBPK modeling and foster confidence in its application to enhance drug therapy in underserved populations, including children and pregnant women. The paper highlights the benefits of the workshops in equipping participants with the necessary understanding and confidence to potentially harness PBPK modeling effectively in clinical practice.

Please find my comments below for the author’s consideration.

While the abstract effectively defines under-served populations, the paper omits a definition of the term “non-modelers”. It would be beneficial for the authors to incorporate a clear explanation of what constitutes a non-modeler in the second section, titled "Demystifying PBPK among non-modelers for wider use in under-served populations." This addition will provide valuable context for the workshop target audience - non-modelers.

Page 3 - In the statement, "The workshops appeared to be effective in leveling the ground for attendees to (i) understand the state of science and technology and (ii) confidently apply PBPK," consider adding "PBPK" before "science" in (i) to specify the domain. Additionally, for (ii), consider expanding on the applications, such as applying PBPK in clinical practice, research, and related contexts.

It would be helpful for the authors to include a discussion on the challenges encountered during the workshops and any inherent limitations. Drawing from their experiences and insights from organizing these workshops, offering recommendations for effectively organizing similar events worldwide would be invaluable. These recommendations could encompass considerations such as the mode of delivery (online versus in-person), optimal duration, software technologies, and other pertinent factors. This guidance would assist individuals interested in organizing similar workshops in the future.

A minor point – the text in the final row and column in the table is missing a closing bracket.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Partly

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Clinical Pharmacology, Maternal and Pediatric Pharmacology, PBPK Modeling.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

 10.21956/gatesopenres.16225.r35428 Reviewer response for version 1 Chan Eric 1 Referee https://orcid.org/0000-0001-6107-9072 National University of Singapore, Singapore, Singapore

Competing interests: No competing interests were disclosed.

 14 11 2023 Copyright: © 2023 Chan E 2023 This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. recommendation approve

The reviewer concurs that an understanding of the concepts of PBPK by healthcare providers is crucial for the successful application of PBPK modeling to optimize pharmacotherapy in specific patient populations. Through the workshops, the authors effectively raised awareness of the relevance of PBPK in optimizing clinical pharmacotherapy. The workshops also help to reduce the barrier clinical practitioners in implementing PBPK modeling to informing drug dosing in children and pregnant women. Similar workshops should be conducted in other parts of the world.

Below are comments for the authors to consider.

Abstract. It is stated that ‘As such, PBPK has the potential to enhance medicine use for populations that are often under-served globally in drug development and clinical care, namely pediatric patients, pregnant and lactating women’. Perhaps the authors should consider including geriatric patients in this statement even though their focus is on pediatric and obstetric pharmacology subsequently. As geriatric patients are often excluded from clinical trials just like the pediatric patients, pregnant and lactating women, citing them may create the awareness of urgent work needed in the geriatric areas as well.

Page 4. It is mentioned that ‘The technological requirement of a proprietary software such as Simcyp and the need to have tutors who are experienced users of the software for our workshops can be replicated using other PBPK software platforms, such as GastroPlus ® ( https://www.simulations-plus.com/software/gastroplus/) and PKSim®/Mobi® ( https://www.open-systems-pharmacology.org/)’. The reviewer is wondering if such alternative software platforms have been tested before in similar workshops conducted by the authors? If yes, sharing their experiences in this paper briefly may be important as not all scientists have access to the Simcyp software.

Using Figure S12 as an example, it is relatively difficult to interpret the bar graph. For example, under ‘no’ as a response, the percentage before workshop was about 10% while the percentage after the workshop was about 20% (2-fold higher). But if we examine the absolute number of responders, they are comparable. The reviewer understands the nuances between percentage versus absolute number, but the interpretation of the results can be biased depending on which read-outs the authors select to present and discuss. Please clarify.

The paper discusses many benefits of the workshops. Are there any limitations, challenges and considerations? Please discuss.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Physiologically based pharmacokinetic modeling

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Zhao Ping Integrated Development, Bill & Melinda Gates Foundation, Seattle, Washington, USA

Competing interests: NA

 16 12 2023

The authors greatly appreciate comments provided by this reviewer.  Below are the responses to reviewer's comments:

1. Abstract. It is stated that ‘As such, PBPK has the potential to enhance medicine use for populations that are often under-served globally in drug development and clinical care, namely pediatric patients, pregnant and lactating women’. Perhaps the authors should consider including geriatric patients in this statement even though their focus is on pediatric and obstetric pharmacology subsequently. As geriatric patients are often excluded from clinical trials just like the pediatric patients, pregnant and lactating women, citing them may create the awareness of urgent work needed in the geriatric areas as well.

Response: We agree and will add the special population ‘geriatric patients’ to this list, with the notification that this specific population was not included in our workshops.  

2. Page 4. It is mentioned that ‘The technological requirement of a proprietary software such as Simcyp and the need to have tutors who are experienced users of the software for our workshops can be replicated using other PBPK software platforms, such as GastroPlus ® (https://www.simulations-plus.com/software/gastroplus/) and PKSim®/Mobi® (https://www.open-systems-pharmacology.org/)’. The reviewer is wondering if such alternative software platforms have been tested before in similar workshops conducted by the authors? If yes, sharing their experiences in this paper briefly may be important as not all scientists have access to the Simcyp software.

Response: No, we do not have experience with workshops using other software, we merely suggest that these workshops can also be conducted with other software platforms like PK-Sim and Gastroplus.

Using Figure S12 as an example, it is relatively difficult to interpret the bar graph. For example, under ‘no’ as a response, the percentage before workshop was about 10% while the percentage after the workshop was about 20% (2-fold higher). But if we examine the absolute number of responders, they are comparable. The reviewer understands the nuances between percentage versus absolute number, but the interpretation of the results can be biased depending on which read-outs the authors select to present and discuss. Please clarify.

Response: We appreciate that the reviewer addresses this. We had already the discussion internally on how to present the data in the supplementary file as we felt that both were important, i.e., percentages as well as absolute numbers, as the absolute numbers differ between the before and after workshops while percentages are more easier for interpretation. Hence, we decided to present both in the supplementary materials to be as comprehensive as possible and unbiased.

The paper discusses many benefits of the workshops. Are there any limitations, challenges and considerations? Please discuss.

Response: There indeed are limitations and challenges with the workshops as well. We now discuss some limitations and challenges as well, see the addition below.

‘Limitations and challenges of the workshops

While the workshops have demonstrated significant value, we acknowledge certain limitations. First, these events have been conducted either in person or online, each possessing its own set of advantages and drawbacks. Online workshops, for instance, are more time-efficient, globally accessible, and cost-effective due to the elimination of travel requirements. However, in-person workshops foster more interactive discussions among delegates, albeit posing challenges in reaching stakeholders on a larger global scale.  Second, the workshops have primarily focused on infectious diseases affecting children and pregnant women in low and middle-income countries. While this focus has been beneficial, recent advancements in PBPK offer a broader learning experience. Consequently, discussions regarding the successes and challenges of applying PBPK to support dosing in other underserved populations, such as lactating women and geriatric populations, should be integrated into these workshops.'