Operational research capacity building using ‘The Union/MSF’ model: adapting as we go along

Abstract

Background

We have conducted 23 operational research (OR) courses since 2009, based on ‘The Union/ Médecins Sans Frontières (MSF)’ model, now popularly known as SORT-IT (Structured Operational Research and Training Initiative) model - wherein participants are mentored through the whole research process from protocol development (module 1) to data analysis (module 2) to publication (module 3) over a period of 9–12 months. We have faced a number of challenges including shortage of time, especially for data analysis and interpretation, and a heavy mentorship burden on limited numbers of experienced facilitators. To address these challenges, we have made several modifications to the structure of the OR course. In this article, we describe the revised structure and our experience (successes and challenges) of implementing it in Asia in 2013.

Findings

The key changes introduced included extending the duration of the course modules (by a day each in module 1 and 2 and by three days in module 3), increasing the numbers of facilitators and standardizing milestones related to data entry and analysis. We successfully implemented this revised structure in the second Asian OR Course held in Nepal in 2013. Eleven of twelve participants successfully completed all the milestones and submitted 13 scientific manuscripts (two participants completed two projects) to international peer-reviewed journals. Though, this posed two challenges – increased costs and increased time away for faculty and participants.

Conclusions

The revised structure of ‘The Union/MSF’ model of OR capacity building addressed previous issues of insufficient time and overburdened mentors and we intend to continue with this model for future courses.

Background

Since 2009, the International Union Against Tuberculosis and Lung Disease (The Union) and Médecins Sans Frontières (MSF) have been involved in building capacity of health professionals in low- and middle-income countries to conduct and publish operational research (OR). We use a practical and output-based approach with hands-on mentorship and has been described in detail elsewhere [1–3]. In brief, this model is implemented over a period of 9–12 months and consists of three modules – Module 1 on ‘research protocol development’, Module 2 on ‘data entry and analysis’ and Module 3 on ‘scientific paper writing’. To be successful, participants have to design and conduct an OR project and at the end of the course submit a scientific manuscript to a peer-reviewed journal. We have achieved excellent results with this model, with more than 85% of participants completing the course and more than 80% of submitted manuscripts being published. The Special Programme for Research and Training in Tropical Diseases (TDR) at the World Health Organization (WHO) has adopted this model as “The Structured Operational Research and Training InitiaTive (SORT IT)” and is committed to its global expansion [3].

To date, we have conducted 23 courses (17 courses completed and six on-going) based on The Union/MSF model. Over the years, we have faced a number of challenges in implementation of these courses, including shortage of time for data analysis, data interpretation and manuscript drafting, and a high mentorship burden on a limited pool of facilitators [4]. To address these challenges, we have introduced several changes to the structure of the OR course. In this article, we summarize these changes and share our experience of implementing a revised OR course structure in Asia.

Findings: Contents of the adapted course

The changes made to the course structure are summarized in the Table 1. They include an increase in the number of days for each module, an increase in the number of facilitators and strengthened milestones related to Module 2. In Module 1, an additional day was used to introduce new sessions on how to systematically search for published literature and organize references. In Module 2, an added day was dedicated entirely to data analysis. Module 3 was extended by three days in order to a) provide more intensive and tailored support to participants for analysing their data, b) give participants more time to conduct a thorough on-line literature review and c) include a new plenary session on manuscript ‘titles and abstracts’. The number of facilitators was increased and standardised for each module, in order to ensure similar standard mentor-participant pairings in Modules 1 and 3, and to allow junior facilitators the opportunity to be trained by senior facilitators within each pairing group. The milestones relating to Module 2 were strengthened and standardized (Table 1).

Table 1 Comparison of the initial and revised structure of the Union-MSF model of operational research course

We implemented this revised structure in the second Asian OR Course held in Nepal in 2013. We had twelve participants, mostly health professionals working in programmes from India, China, Nepal, Bhutan, Bangladesh, Pakistan and Sri Lanka. Eleven of twelve participants successfully completed all the milestones with two of them completing two research projects each. Thus a total of 13 scientific manuscripts were submitted to international peer-review journals. One participant was not able to complete the research project in time due to changing her place and institution of work. The key advantages and challenges of the revised structure, as mentioned in the end-of–module feedback of participants and facilitators are summarized in the Table 2.

Table 2 Advantages and disadvantages of the revised structure of ‘The Union-MSF model’ in Asia, 2013

Discussion

There were two main problems in our courses - shortage of time for data analysis and interpretation and high mentorship load. The problem of time shortage for data analysis was addressed in several ways. First, the additional days in Module 2 and 3 were primarily used to provide tailored data analysis support for research projects. Second, the number of facilitators for Module 2 was increased to six so that each facilitator supported only two participants in data analysis. Third, the strengthened milestone focusing on data analysis just before Module 3 increased the priority level and attention accorded to data analysis by participants and their mentors.

To reduce the high mentorship load, the module duration was extended which took pressure off both facilitators and participants, who on previous courses often worked late into the night and way beyond the course timetable. In the revised structure, participants had sufficient time to develop the first drafts of their protocols, carry out the data analysis and draft their manuscript before facilitators provided their inputs, thus enhancing the iterative learning experience. The revised structure also demonstrated the increased emphasis on reviewing published literature and organizing references, which had a limited focus in previous courses. This led to increased familiarity with previously published literature and improvements to both the introduction and discussion sections of the final papers. With the perspective of decentralizing OR courses to settings with relatively inexperienced and junior facilitators, and with growing diversification of the research portfolio beyond the current focus of HIV and tuberculosis, additional days have proved necessary to ensure the quality of outputs.

The two key challenges in implementing the revised structure were the associated increased costs (primarily for hotel and per-diem on additional days) and faculty having to commit to being away from duty stations for a longer period of time. The increased costs need to be included in future funding proposals to donors. Faculty commitment will be an ongoing challenge but will be partly solved by developing and nurturing a pool of senior and junior facilitators. It will be important to encourage facilitators who attend Module 1 to also attend Module 3 so that there is continuity and familiarity of faculty with the OR protocols.

In conclusion, the revised structure of ‘The Union/MSF’ model of OR capacity building addressed previous issues of insufficient time and overburdened mentors and we intend to continue with this model for future courses. We will continue to evaluate the revised model of capacity building using the standard SORT-IT indicators [3].