- Case study
- Open Access
- Open Peer Review
A public health e-learning master’s programme with a focus on health workforce development targeting francophone Africa: the University of Geneva experience
© Chastonay et al. 2015
- Received: 10 April 2015
- Accepted: 28 July 2015
- Published: 13 August 2015
Shortage of a competent public health workforce is as a worldwide problem. The situation is especially bad in sub-Saharan Africa. In 2008, the World Health Organization and the Global Health Workforce Alliance launched a call for proposals for a public health training programme with an emphasis on health workforce development specifically targeting Africa. Our article presents the development, implementation and evaluation of an e-learning Master of Advanced Studies in Public Health on Workforce Development. The project was developed in collaboration with academic partner institutions of 10 French-speaking African countries and local/regional/HQ WHO offices.
A five-step approach was adopted. First, a needs assessment study was done in the target countries, with identification of priority health issues. Second, student and tutor selection was done in collaboration with local WHO offices, health authorities and partner universities. Third, the e-platform was developed and a training workshop for tutors was organized. Fourth, the learning objectives were derived from the needs assessment study and an interactive educational approach was adopted. Fifth, the participation of students, their perception of the programme, their performance on assignments and community outcomes were monitored.
The needs assessment allowed the identification of 12 priority health issues (trauma related to road accidents, maternal and child health, HIV/AIDS, mental heath, food and malnutrition, health resource management, infectious diseases, access to essential drugs, chronic diseases, health promotion, ageing and violence/conflicts) of which 10 were studied through the lens of the key public health disciplines (epidemiology, human resources, health project/service planning, health policy, communication, health economics/management, informatics and ethics/human rights), each validated through a certifying examination. Student participation, measured through connection hits (total: 58 256; mean: 168/student/module) and posted messages (total: 5994; mean: 18/student/module), was good, and global satisfaction was high (7.7/10). Twenty-nine students out of 37 obtained their master’s degree from the University of Geneva. Outcomes reported include career development, strengthening of inter-country networks and common projects.
Keys to the success of the programme were the enthusiasm and commitment of students, the availability of the coordination team, the simplicity of the electronic platform and the support of local/regional/WHO offices. Yet, the sustainability of the programme is not assured.
- Health Workforce
- Central African Republic
- Partner Institution
- Coordination Team
- Public Health Workforce
The World Health Organization has identified the shortage of competent health workforce as a major and worldwide problem . Data from Africa show that the situation is especially bad in sub-Saharan Africa and that, though efforts have been made, more is needed . One might especially mention the CARTA Initiative, which stands for the Consortium for Advanced Research Training in Africa. It is a south–south partnership with south–north collaboration having two main objectives: first, to strengthen research infrastructure and management capacity at African universities; second, to support doctoral training through a model collaborative PhD programme in population and public health. The Initiative has achieved some remarkable successes, having enrolled more than 100 fellows in its PhD programme supported by over 90 facilitators from 22 countries . Yet, the situation remains critical in many countries further aggravated by an important brain drain . Since out-of-country-training increases the risk of brain drain, new training methods especially via Internet technologies have been suggested . Furthermore, in order to strengthen the public health workforce, core competencies of public health personnel have been proposed by international bodies, which may help solve health problems at various levels (regional, national, local) . Yet, some authors have challenged the relevance of such globally defined core competencies and insist on local needs assessment prior to any training programme .
In 2008, the World Health Organization and the Global Health Workforce Alliance launched a call for proposals for a public health training programme with an emphasis on health workforce development specifically targeting Africa. Two proposals were accepted and funded in 2010, one from the University Western Cape (English) and one from the University of Geneva (French). The latter proposal had been developed in partnership with universities and ministries of health of 10 French-speaking African countries (Burkina Faso, Burundi, Cameroon, Chad, Central African Republic, Congo, DR Congo, Ivory Coast, Mali and Senegal) and in close collaboration with local/regional/HQ WHO offices [8, 9].
Our article presents the development, the implementation and the evaluation of the Geneva e-module in Public Health GEMPH – a distance-learning Master of Advanced Studies (MAS) in Public Health programme via an electronic platform coupled with specific workshops, based on a long-running residential MAS in Public Health of the University of Geneva .
Curriculum development, implementation and evaluation
The project started with a needs assessment in spring 2010 through country visits (Senegal, Ivory Coast, Mali, Burkina Faso, Cameroon, Central African Republic, Congo, Democratic Republic of Congo) by one of the principal investigators (EKM). Chad was visited later on; the Central African Republic and Burundi were accepted at the request of WHO though they were not in the initial project. Needs assessment was done according to standard procedures, that is, through semi-structured interviews and focus groups with key informants in partner countries [11–13]. The needs assessment was complimented with a survey among the students (see below).
During the above-mentioned country visits, local educational institutions as potential partners were identified: their possible role was discussed; furthermore, the support of health and education ministries was asked as well as the collaboration of WHO country offices.
The project moved forward with the student selection in fall 2010. It was a multiple-step selection. First, WHO country offices and ministries of health gave a short list of potential candidates per country. The University of Geneva coordination team developed a test that the candidates took in fall 2010 including an essay on the public health situation of their country (identification of priority public health problems in their respective countries) and a self-evaluation of their public health competencies and training needs in public health . The Geneva-based coordination team independently assessed the individual copies. The partner institutions proposed the local tutors.
In fall 2010, an electronic platform was adopted upon the recommendations of the e-experts of the University of Geneva: the Moodle platform .
In December 2010, an educational workshop for local tutors was organized in Bamako, Mali, with the aim to motivate local tutors and make them familiar with the project and its educational approach.
The main learning objectives were derived from the above-mentioned training needs assessment and from the educational needs as identified by the candidates based on the priority health problems they were confronted with in their respective countries, taking also into account international recommendations.
Each priority health issue was treated over a 2-month period, including reading assignments, exercises and group work.
The participation of students, their perception of the programme, their performance on assignments (formative and certifying examinations) and possible community outcomes were monitored throughout the curriculum with various techniques (automatic monitoring of connection to the platform ; strengths, weaknesses, opportunities and threats (SWOT) technique evaluation ; learning objective achievement ; outcome measurements ).
Students completed a final individual examination and a collaborative report on specific transnational health issues with a focus on health workforce development as a final topic.
Step 1: Needs assessment (spring–summer 2010)
Identified training needs by key informants in partner countries
Public health function
Public health tasks
Set public health objectives and priorities
Develop public health projects
Define public health strategies
Define human resources policies
Mobilize and coordinate resources
Put results into practice
Identify public health problems
Collect public health data
Draft public health research reports
Inform community and deciders on results
Design and use appropriate information systems
Analyse the social and political environment
Be familiar with conflict management
Ensure the provision of public health training
Organize health services
Manage public health archives
Draft administrative reports
Step 2: Identification of country partner institutions, student and tutor selection, country priority health issues and specific expected competencies (summer–fall 2010)
Identification of country partner institutions
Educational institutions agreed to participate in the project by helping students through logistic support and providing local tutors.1 The ministries of health and the ministries of education of the partner countries also agreed to support the project, mainly in allowing some of their staff to take the programme. Furthermore, the local WHO Offices, with the support of the regional WHO office and the WHO HQ, played a key role in initially establishing a short list of potential students and in providing educational and logistic support during the implementation phase of the project (co-organizing the educational workshop for tutors, supporting logistically the selection process, co-organizing the final examinations). Eventually, the regional WHO office co-organized the final workshop at the end of the programme and the graduation ceremony.
Student selection and tutor selection
The coordination team reviewed the tests taken by the candidates according to a specific grid. Eventually, 34 students out of 55 candidates were selected with balanced country representation. In March 2011, three students from Burundi joined the programme upon the request from WHO increasing the total number of students to 37. Male/female ratio 3:1; 45% physicians, 24% managers and administrators and 31% health workers, teachers and social workers.
Each collaborating academic institution proposed a local tutor with an academic degree and proven competencies in public health ready to supervise the local students in their case studies: mainly senior public health academics were proposed.
Priority health issues
- Infectious diseases
- Chronic diseases
- Mental heath
- Maternal and child health
- Food and malnutrition
- Trauma related to road accidents
- Access to essential drugs
- Health promotion
- Health resource management
Specific public health competencies
Learning objectives based on competency needs expressed by candidates of the programme
Each student should be able at the end of the programme to:
Implement health prevention and health promotion activities
- Develop health prevention and promotion strategies and action plans
- Implement health prevention and promotion programmes
- Support at the technical level health authorities
Collaborate and communicate
- Communicate with the population, with health authorities and with NGOs
- Collaborate with health professionals and coordinate common actions
- Council health authorities on the health of the population
Manage public health activities and structures
- Identify health priorities according to urgency and economic constraints
- Prepare public health projects including budget and legal aspects
- Analyse and formulate public health objectives (at local and national levels)
- Plan and manage health workforce development including life-long training
Develop and implement research activities
- Establish the health profile of the population at local and national levels
- Organize an information system to collect health data
- Analyse the financial impact of health promotion programmes
- Evaluate the efficacy and efficiency of public health programmes
- Design a public health research project
Train health personal
- Develop, implement and evaluate training programmes for health professionals
- Evaluate one’s activities in order to better perform
Step 3: Tutor training and choice/development of the electronic platform (summer–fall 2010)
The electronic platform (Moodle) adopted allowed easy interactions between educators, learners and learning resources, offering asynchronous discussion forums and adaptability to the needs and demands of teachers and students. Furthermore, this choice gave access to the informatics back office of the University of Geneva, which supported the use of the platform throughout the programme and allowed smooth functioning.
An educational workshop for local tutors and WHO focal points was held in Bamako, Mali. The participants were academics and health managers (nine countries), WHO focal points (five countries), a representative of the Consortium RAS (one person), WHO Geneva representatives (two persons) and University of Geneva teachers (two representatives of the coordination team). The aim was to motivate local tutors and make them familiar with the project and its educational approach. It was also an opportunity to promote the programme locally and regionally and to initiate a network among local tutors and local/regional WHO representatives as well as the Geneva-based coordination team .
Step 4: Content development and educational approach (fall 2010–fall 2012)
The main learning objectives were derived from the above-mentioned training needs assessment and from the educational needs as identified by the candidates based on the priority health problems they confronted within their respective countries (Table 2), taking also into account international recommendations .
As a consequence of the interactive educational approach adopted [16, 17], 10 priority health issues were identified: trauma related to traffic accidents, mother and child care, HIV/AIDS, mental health, food and malnutrition, human resources for health, infectious diseases, essential medicines, chronic diseases and health promotion. The 10 priority health issues were studied through the lens of the key public health disciplines: epidemiology, human resources, health project/service planning, health policy, communication, health economics and management, informatics and ethics and human rights. Ageing and violence/conflicts, two issues that had been identified, could not be treated as specific modules due to time and logistic constraints. Yet, considering their importance, ageing issues were mainly discussed during the modules mental health and non-communicable chronic diseases, whereas violence and conflict issues were mainly discussed during the modules HIV/AIDS, mental health and food–malnutrition. Specific educational tools were developed in order to explore the different priority health issues with focus on the acquisition of broad competencies in the various disciplines (readings, individual exercises, case studies, discussion forums, group work, community assignments with project implementation, data collection, data analyses, report writing, press release, etc.), based on tools developed in the MAS in public health of the University of Geneva .
Step 5: Programme implementation, monitoring and evaluation (winter 2011 through spring 2014)
The programme was comprised of ten 2-month modules on the priority health issues identified, an individual final certifying examination and a final group work.
Students’ participation (connections to the electronic platform and messages sent)
Trauma related to accidents
Food and malnutrition I
Human resources for health
health indicators, such as life expectancy, mortality and morbidity rates;
health services, such as the number of community health services, mental health institutions or intense health care units;
the active human health workforce, such as the number of trained nurses, midwifes or physicians, but also more specific details such as wage practices, working hours, requirements of continued education or the carrier opportunities;
the traditional medicine practices; and
the role of international non-governmental organizations in the health sector.
Second, students (in inter-country groups) were assigned to write a 10- to 20-page essay using the collected data with the intention of editing a collective booklet.
This final assignment was only partially successfully achieved. In retrospect, the requirement was considered as too demanding by the coordination team. The decision was taken to validate the essays though they were not publishable at that stage.
Students’ satisfaction according to module and discipline (1 to 10 scale: 1: very dissatisfied; 10: very satisfied)
Mat and child
Health econ and management
Ethics and human rights
Global evaluation of the programme (SWOT technique at the final workshop with students and teaching staff)
Rapid feedback on assignments handed in
Globally non-functioning local tutorship with little local support (to students)
Exchange of experiences among students (andragogy approach)
Difficulties with Internet connections
Availability of relevant documents on the platform
No electronic material support (no computers offered to students by the programme coordination)
High participation rates and enthusiasm of students
Suppression of two modules initially planned (ageing and violence)
Low dropout rate (3/37) despite some political instability and limited Internet access
Difficulties to implement well-functioning group work, especially “writing a scientific report together”
Increase of UNIGE visibility at country levels in French-speaking Africa
Low student participation at the wiki assignment
Reliability of the Internet platform and the UNIGE-based IT back office
Development of local and regional collaborations and networking
Use of new Internet technology as a training support
Local political insecurity
Possibility to extend the programme to other contexts
Workload for coordination and teaching staff
Twenty-nine students out of 37 achieved the educational objectives. Three students dropped out due to the unstable local political situation in their country, and five failed at least two modules and the final examination. The 29 students who fulfilled all programme requirements obtained a Master in Advanced Studies in Public Health from the University of Geneva with focus on Health Workforce Development (MPH equivalent free of charge, which might have provided an incentive for students to complete the course).
The weakly use of newly acquired competencies during the programme is reported by two thirds of the students.
Several students (12) achieved a professional promotion, mostly at ministries of health, in the year following their graduation.
Several projects (6) developed throughout the course had been initiated and implemented locally at the time of this publication.
A collaborative network among students has been established and is functioning on a regional basis.
A shortage of competent clinical and public health professionals, with knowledge and skills in health workforce development, has been a long-standing issue in most of sub-Saharan Africa, bearing 25 % of the global burden of disease and having only 3 % of the health workforce .This was the driving factor behind the development of an e-learning master’s programme with focus on health workforce development coordinated by the University of Geneva with technical and financial support of the World Health Organization and the Global Health Workforce Alliance .
An initial assessment of needed public health competencies was completed through a survey of 106 representatives of health authorities of the participating countries (Table 1) . The initial survey was complemented by an assessment of expressed training needs among the candidates during the selection process. This allowed defining more precisely learning objectives relevant to the students’ training expectations/needs (Table 2), as recommended in the literature [16, 24]; it proved useful in our case because it appeared to be very motivating.
The chosen distance-learning approach, while part of the call for proposals, was also an opportunity to test Ruiz’s statement, “the integration of e-learning into medical education can catalyze the shift toward applying adult learning theory, where educators will no longer serve mainly as the distributors of content, but will become more involved as facilitators of learning and assessors of competency” : indeed, the reality of connectivity problems in many of the partner countries kept us from seriously considering real-time synchronous lectures as a viable teaching model. Therefore, asynchronous case studies with online readings, exercises, chats and wikis around priority health issues appeared as the only realistic teaching modality, which in turn allowed interactivity among students, course facilitators, collaborative work and exchange of experiences, thus being in tune with modern adult learning strategy recommendations [16, 17].
The e-learning approach also made the programme available to candidates that could not have taken the residential course at the University of Geneva : this is certainly one of the advantages of distance-learning programmes among a long list of possible benefits if principles of effective learning are integrated , which was done as mentioned above. Furthermore, the priority-health-issue approach with case studies relating to realities of the working and community environments of students contributed to the motivation of students and was certainly an asset of the programme design, though motivation might also have been influenced by the perspective of a free-of-charge diploma. The local tutoring, which seemed initially as an important feature of the programme, also advocated by many authors [25, 27], neither responded to the students’ nor to the coordination team’s expectations, though a specific workshop had been organized for the local tutors : close-distance tutoring from the Geneva-based coordination team became therefore a major activity. A lack of availability of local tutors was put forward by the students, mainly related to professional obligations of tutors who were senior academics/professionals with international mandates. Midlevel professionals more readily accessible to students yet competent in the field of public health might have been a better choice, as experienced in another distance-learning programme of the University of Geneva . Yet, more drastic measures might be necessary to improve the commitment of local tutors, such as a clear decision of the University authorities putting tutorship high on the academic agenda, which at present is not the most frequent situation .
The selection of students was a complex procedure. It was greatly facilitated through the close collaboration of the WHO HQ, regional and country offices. Being a competitive, multiple-step procedure, it eventually allowed selecting of students as a self-assessment process and a personal essay showing their knowledge of public health problems and challenges their respective country of origin were facing, thus insuring a certain degree of “knowledge homogeneity”, as recommended by some authors . It further allowed reducing the risk of favouritism and nepotism which make a rather common problem in such contexts , as the final decision of acceptance was the sole responsibility of the Geneva-based coordination team. The dropout rate was low (<10 %): similar dropout rates have been reported in the literature for degree-granting distance-learning courses in sub-Saharan Africa, while dropout rates up to 70 % are mentioned for MOOCs .
The electronic platform Moodle was easy handling for the teaching staff, benefited from the IT back office of the University of Geneva, and did not represent a major difficulty for most of the students. The difficulty for students was to connect from their office, and several had to connect via the local Internet Cafés at their expense. The Moodle platform also allowed many different educational approaches as mentioned above, which is also reported as one of its strengths in the literature .
The systematic monitoring of the programme allowed measuring student participation and satisfaction as mentioned in the “Results” section. The participation estimated via log-ins and messages posted varied from one module to another, with maximal interest shown for modules “Trauma post Accidents”, “HIV/AIDS” and “Mother and Child health” followed by “Infectious Diseases” and “Food/Malnutrition”, issues that rank high among health priorities in sub-Saharan Africa as reported in the Kaiser/Pew Global Health Survey . The globally high participation rate of most students despite sometimes difficult local situations might also be related to the observed team spirit that emerged over the months among “building sense of community at distance” as some authors have stated . Satisfaction of students as measured on a 10-point scale (10: very satisfied) lies in the mean between 7 and 8 for all the modules and all the disciplines: this can be considered as a high approval rate, which in turn might have some impact on the motivation and performance of students . Yet, one might consider that students’ satisfaction evaluation is of limited relevance when done at the end of the teaching sessions: it could be more informative after the students had the opportunity to put their learning into practice as suggested in a study among alumni of a MPH programme .
Type of certifying examination of each module
Trauma related to accidents
Production of a glossary (group work)
Planning of a public health intervention
Writing a report on the qualitative survey
Food and malnutrition
Planning of a public health intervention
Human resources for health
Presentation of websites on human resources for health
Identification of hospital human resources economic indicators
Planning of a public health intervention
Communication (prevention campaign)
Data analysis and interpretation
Evaluation report of a local health project
Evaluation report of a local health project
The global evaluation (Table 3) of the programme highlighted strengths such as “exchange of experiences among students”, “quality of the feedback on assignments” and “commitment of students despite difficult local situations”. It also highlighted weaknesses, such as little support from local tutors, difficulties in access to Internet and little material support. Development of collaborations and strengthening of networks were considered as opportunities, while lack of long-lasting financial support of the master’s programme and local political instability were considered as principal threats to the programme, and indeed, we experienced three dropouts because of local insecurity/war, a phenomenon reported by others . These observations, not very different from evaluation results of online, distance-learning programmes reported in the literature [39, 40], gave valuable information in order to adapt the curriculum and improve the programme: integrating monitoring and evaluation mechanisms early on the planning of any training programme, as recommended [41, 42], should be a priority to any curriculum designer.
Observed outcomes such as the use of newly acquired skills in professional life, career development and initiated collaborative projects suggest that the master’s programme had some impact “beyond the classroom”, which should ultimately be the aim of any training programme in public health .
Summing up: what are the lessons learned?
First, interactive training methods integrating the students’ experience and their professional/community realities contributed to the motivation of students and set the basis for collaborative work among them.
Second, though the Internet platform was easy to use and no major malfunction occurred, there were local connection difficulties, which had some negative impact keeping at times the programme from smoothly functioning.
Third, local tutoring did not respond to expectations, perhaps because the tutors selected were overbooked senior public health academics. Careful attention should be given to defining terms of reference of tutors, the criteria for their selection and incentives to encourage performance. But above all, such programmes should be identified as priorities in the strategic plans of the collaborating universities, thus allowing to reward in academic terms (career) serious commitment of tutors in such programmes.
Fourth, long-term financial support could so far not be ensured, which might compromise the sustainability of the programme, though partner institutions would welcome it, despite several financial requests to various agencies working in development and international cooperation. Perhaps a different financing approach should be considered, that is, a financing mechanism based on funding scholarships to students rather than funding the teaching institution. One might also argue that international organizations should take the leadership in funding such programmes in close collaboration with higher education institutions.
Fifth, the master’s programme was a very enriching experience for the University of Geneva, especially for the coordination team of the project, who is at present developing public health projects with partner institutions and former students. It also indirectly contributed to a strategic decision at the University of Geneva: the development of an African Studies track.
1List of partner institutions : Unité de Formation et Recherche en Sciences Médicales, Université de Bouaké, Abidjan, Côte d’Ivoire; Faculté des Sciences de la Santé, Université Marien NGouabi, Congo Brazzaville; Faculté de Médecine, Université de Mbuji-Mayi, République Démocratique du Congo; Faculté des Sciences de la santé, Université de Ndjaména, Tchad; Faculté de Médecine, Pharmacie et Odontostomatologie, Université de Bamako, Mali; Faculté de Médecine, Université Cheik Anta Diop, Dakar, Sénégal; Unité de Formation et Recherche en Sciences de la santé, Université de Ougadougou, Burkina Faso; Faculté des sciences biomédicales, Yaoundé, Cameroun; Faculté des Sciences de la santé, Université de Bangui, Centre Afrique
2A wiki is a collection of collaboratively authored web documents. Basically, a wiki page is a web page everyone in a class can create together with his/her colleagues. Consensus emerges from the work of the students themselves. Wikis can be a powerful tool for collaborative work: an entire class can edit a document together, creating a class product, or each student can have his/her own wiki and occasionally share it with classmates.
The authors acknowledge the support of the Global Health Workforce Alliance (rb/rg/MPHHWD/2010) and the commitment of the partner institutions in Africa.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- WHO. World Health Report 2006. Working together for health. Geneva: WHO-HG; 2006. http://www.who.int/whr/2006/en/index.html (accessed on August 4th 2014).Google Scholar
- IJsselmuiden CB, Nchinda TC, Duale S, Tumwesigye NM, Serwadda D. Mapping Africa’s advanced public health education capacity: the AfriHealth project. Bull World Health Organ. 2007;85(12):914–22.View ArticlePubMedPubMed CentralGoogle Scholar
- Consortium for Advanced Research Training in Africa (CARTA). http://www.cartafrica.org (accessed on July 19th 2015)
- Martineau T, Decker K, Bundred P. Brain drain of health professionals: from rhetoric to responsible action. Health Policy. 2004;70:1–10.View ArticlePubMedGoogle Scholar
- Gebbie K, Rosenstock L, Hernandez L (Eds). Committee on Educating Public Health Professionals for the 21st Century. Who will keep the public healthy: educating public health professionals for the 21st century. Institute of Medicine of the National Academies,2003 http://www.nap.edu/openbook.php?record_id=10542 (accessed on August 1st 2015)
- Pruitt S, Epping-Jordan J. Preparing the 21st century global healthcare workforce. BMJ. 2005;330:637.View ArticlePubMedPubMed CentralGoogle Scholar
- Mutungi A, Harvey S, Kibaru J, Lugina H, Jennings L, Bornstein T, et al. Kenya: assessment of health workforce competency and facility readiness to provide quality maternal health services. USAID, Bethesda: Operation Research Series; 2008.Google Scholar
- Anonymous. Masters degree programme with a focus on health workforce development in francophone Africa http://www.who.int/workforcealliance/media/events/2010/mastersfrancophone/en/ (accessed on November 12th 2014)
- The Geneva-e-module in public health http://gemph.unige.ch/accueil.html (accessed on November 2nd 2014).
- Chastonay P, Bastard B. Apprendre la Santé publique. L’expérience pédagogique du Diplôme-MAS en santé publique de l’Université de Genève. Genève: Médecine & Hygiène; 2009. p. 279.Google Scholar
- Petersen DJ, Alexander GR. Needs assessment in public health. New York: A practical Guide, Kluwer Academic / Plenum; 2001. p. 138.Google Scholar
- Barbour R. Doing focus groups. London: Sage; 2008. p. 168.Google Scholar
- Rabie F. Focus group interview and data analysis. Proc Nutr Soc. 2004;63:655–60.View ArticleGoogle Scholar
- Chastonay P, Moretti R, Zesiger V, Cremaschini M, Bailey R, Pariyo G, et al. Health workforce development: a needs assessment study in French-speaking African countries. Adv Health Sci Educ. 2012. doi:10.1007/s10459-012-9369-9.
- Université de Genève. Plate-forme moodle https://moodle.unige.ch (accessed on November 15th 2014)
- Guilbert JJ. Educational handbook for health personnel. Who Offset Publications. 35th ed. Geneva: WHO; 1987. p. 360.Google Scholar
- Knowles M, Holton E, Swanson A. The adult learner. The definitive classic in adult education and human resource development. 7th ed. New York: Taylor & Francis; 2011.Google Scholar
- Goodrich R. SWOT analysis: examples, templates & definition. BusinessNewsDaily, 2015 http://www.businessnewsdaily.com/4245-swot-analysis.html (accessed on January 29th 2015)
- Arizona Department of Education. The student learning objective handbook. The student learning objective process. 2013. http://www.azed.gov/teacherprincipal-evaluation/files/2013/06/slo-handbook.pdf (accessed on November 22nd 2014).Google Scholar
- Faupel-Badger J, Nelson DE, Marcus S, Kudura A, Nghiem E. Evaluating postgraduate public health and biomedical training program outcomes: lost opportunities and renewed interest. J Cancer Educ. 2013;28:18–26.View ArticlePubMedGoogle Scholar
- Council on Linkages between Academia and Public Health Practice. Core competencies for public health professionals 2011 (accessed on July 2nd 2015)Google Scholar
- Bileckot R, Keita M, Mpinga EK. Rapport de l’Atelier des Tuteurs du Projet GEMPH, Bamako 13–15 décembre 2010, IMSP. Geneva: Université de Genève; 2011.Google Scholar
- Mpinga EK. Rapport de l’Atelier Final du Projet GEMPH, Brazzaville 4–6 juin 2014. ISG. Geneva: Université de Genève; 2014.Google Scholar
- Potter MA, Pistella CL, Fertman CI, Dato VM. Needs assessment and a model agenda for training the public health workforce. AJPH. 2000;90(8):1294–6.View ArticleGoogle Scholar
- Ruiz G, Mintzer MJ, Leibzig R. The impact of e-learning in medical education. Acad Med. 2006;81(3):207–2012.View ArticlePubMedGoogle Scholar
- Cook DA. Web-based learning: pros, cons and controversies. Clin Med. 2007;7(1):37–42.View ArticleGoogle Scholar
- Maes A. Le nouveau paradigm de la formation à distance: apprentissage actif et collaborative. Actes du Colloque TICE Méditerranée. 2007. p. 1–11.Google Scholar
- Klohn A, Petrakova A, Zesiger V, Kabengele E, Chastonay P. Enseignement à distance “Santé et Droits humains, une collaboration en réseau. Rev Med Suisse. 2009;5:S12–6.Google Scholar
- Daroux G. L’exercice du tutorat académique. Synthèse des pratiques observées en Allemagne Autriche, Espagne, France, Pologne, Suède. 2009th ed. St-Etienne: PROCERTU-ISTP; 2009. http://www.adam-europe.eu/prj/3681/prd/2/3/pratiques%20du%20tutorat%20acad%C3%A9mique%20dans%206%20pays%20europ%C3%A9ens.pdf (accessed on July 12th 2015).Google Scholar
- Blowers P. Using student skill self-assessments to get balanced groups for group projects. CollegeTeaching. 2003;51(3):106–10.Google Scholar
- Van Den Bergh P. Power and privilege at an African university. Cambridge: Schenkman Publishing Company Inc; 1973.Google Scholar
- Dogbe-Semanou D. Persévérance et abandon des apprenants à distance en Afrique subsaharienne francophone : cas du Togo. Thèse de Master en Sciences de l’Education: Université de Lomé. 2012.Google Scholar
- Aydin C, Tirkes G. Open source learning management systems in e-learning and Moodle. Education Engineering (EDUCON) 2010; IEEE :593 – 600Google Scholar
- Kaiser/Pew Global Health Survey. Global look at public perceptions of health problems, priorities and donors 2007 http://www.pewglobal.org/files/pdf/259.pdf (accessed on November 22nd 2014)
- Rovai A. Building sense of community at a distance. IRRODL 2002; 3 (1) http://www.irrodl.org/index.php/irrodl/article/view/79 (accessed on July 4th 2015)
- Shin N, Chan J. Direct and indirect effects of online learning on distance education. Br J Educ Tech. 2004;35(3):275–88.View ArticleGoogle Scholar
- Jeannot E, Stoll B, Chastonay P. Alumni evaluation of a community-oriented master of public health program. J Community Health. 2013;38(2):357–9.View ArticlePubMedGoogle Scholar
- Ikynia G, Okoth O. To investigate factors affecting the performance of students on distance learning mode. J Information Engineering Application. 2013;3(10):70–7.Google Scholar
- Chumley H, Dobbie A, Alford C. Web-based learning: sound educational method or hype: a review of the evaluation literature. Acad Med. 2002;77(10):S86–93.View ArticleGoogle Scholar
- Cannon M, Umble K, Steckler A, Shay S. We’re living with what we’re learning: student perspective in distance learning degree and certificate in public health. J Public Health management Practice. 2001;7(1):49–59.View ArticleGoogle Scholar
- Koplan J, Milstein R, Wetterhall S. CDC recommendations and reports. Framework for program evaluation in public health. MMWR. 1999;48(RR-11):1–5.Google Scholar
- Tavakol M, Gruppen LD, Torabi S. Using evaluation research to improve medical education. Clin Teach. 2010;7:192–6.View ArticlePubMedGoogle Scholar
- Campell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–6.View ArticleGoogle Scholar