From: 02/12/2017 to: 04/12/2017 ESO-ESMO-RCE Clinical Update on Rare Adult Solid Cancers, Milan, Italy                                        From: 15/12/2017 to: 18/12/2017 6th Arab and Southern European Countries Masterclass in Clinical Oncology, Limassol, Cyprus                                        From: 22/01/2018 to: 26/01/2018 University Post-graduate Course - Clinical Oncology: Sarcomas, Milan, Italy                                        From: 05/02/2018 to: 09/02/2018 University Post-graduate Course - Clinical Oncology: Head & neck cancers, Milan, Italy                                        From: 23/02/2018 to: 25/02/2018 3rd ESO Masterclass in Cancer Patient Advocacy , Lisbon, Portugal                                        From: 24/03/2018 to: 29/03/2018 17th ESO-ESMO Masterclass in Clinical Oncology, Nauen OT Groß Behnitz (Berlin area), Germany                                        From: 24/03/2018 to: 29/03/2018 11th ESO-EONS Masterclass in Oncology Nursing , Nauen OT Groß Behnitz (Berlin area), Germany                                        From: 18/04/2018 to: 22/04/2018 4th ESO-ESMO Latin-American Masterclass in Clinical Oncology, Mexico City, Mexico                                        From: 17/05/2018 to: 18/05/2018 8th ESO-CNIO Conference on Familial Cancer, Madrid, Spain                                        From: 18/05/2018 to: 22/05/2018 3rd Masterclass on Systematic Reviews in Cancer Care, Guidelines and Research, Belfast, United Kingdom                                        From: 15/06/2018 to: 20/06/2018 5th ESO-ESMO Eastern Europe and Balkan Region Masterclass in Medical Oncology, Belgrade, Republic of Serbia                                        From: 16/06/2018 to: 21/06/2018 7th ESO-SIOP Europe Masterclass in Paediatric Oncology, Nauen OT Groß Behnitz (Berlin area), Germany                                        From: 19/07/2018 to: 25/07/2018 ESMO-ESO Course on Medical Oncology for Medical Students, Valencia, Spain                                        From: 27/08/2018 to: 07/09/2018 ESO-ESSO-ESTRO Multidisciplinary Course in Oncology for Medical Students, Poznan, Poland                                        From: 20/09/2018 to: 22/09/2018 1st ESO-EONS Eastern Europe and Balkan Region Masterclass in Oncology Nursing, Budapest, Hungary                                        From: 27/09/2018 to: 29/09/2018 Update Skills in Head and Neck Surgery and Oncology, Leipzig, Germany                                        From: 6/10/2018 to: 8/10/2018 4th ESO-ESMO Breast Cancer in Young Women International Conference, Lugano, Switzerland                                        From: 30/10/2018 to: 31/10/2018 10th Clinical Oncology Update - Onkologia 2018, Krakow, Poland                                        From: 10/11/2018 to: 13/11/2018 ESO-ASCO Masterclass in Clinical Oncology, Yerevan, Armenia

Quality assurance


Programme - requirements and guidelines

The concept and curriculum adhere to the following formal requirements and guidelines:

   
1.  European Credit Transfer and Accumulation System ECTS of the European Commission- User´s Guide 2009
 2. Formal Requirements and Regulations of Ulm University
 3. The Mission of the European School of Oncology, Bellinzona/Milano
 4. European Society for Medical Oncology ESMO Clinical Practice Guidelines
 5. Accreditation Council of Oncology in Europe ACOE, Belgium: Guidelines for CME providers (e-learning materials and live events) on 04/22/2010
 6. Swissuni: Recommendations for quality development in university continuing education programmes, approved by the General Assembly on 10/02/2009
 7. Qualifikationsrahmen für den schweizerischen Hochschulbereich nqf.ch-HS vom gemeinsamen Leitungsausschuss der drei Rektorenkonferenzen vom 23.11.2009
   


Quality of Learning Outcomes

The formative and summative programme evaluation considers different aspects to define if the programme achieved the learning outcomes (Kirkpatrick 1993, 2011):

   
1.  Reaction and satisfaction: to what degree participants react favourably to the Programme
 2. Learning: to what degree participants acquire the intended knowledge, skills, attitudes, confidence and commitment based on their participation
 3. Behaviour: to what degree participants apply what they learned during the Programme in their own professional field
 4. Result: to what degree targeted outcomes occur as a result of the Programme and subsequent reinforcement


The achievement of the different levels includes a comprehensive analysis of the following aspects:

Level 1 and 2:

1. Self-evaluation by the participants (existing and acquired knowledge, skills, competences)
 2. Structured evaluation of the modules and courses (content, lectures, presentation, structure, usability)
 3. Online tests at the end of each e-learning module and a certificate exam at the seminar concluding the Programme


Level 3 and 4:

4.  Online presentation (e.g. case-presentations, videoconferences)
 5. Workshops in the seminars
 6. The Programme Chairmen will regularly review the structure and the programme and continue to develop the curriculum
   


Quality of the Content

To ensure a formative and summative review process of the content quality, a scientific board was established. The board is composed of renowned, internationally recognised oncologists and scientists, approved by the chairmen of the programme. The positions of the chairmen, scientific directors and lecturers are characterised by different duties.

Lecturers will be asked to:

   
-
 Define the goals and learning objectives of their materials, which will be reviewed and approved by the scientific director. 
-
 Refer to evidence-based medicine and the corresponding state-of-the-art guidelines, such as the Clinical Practice Guidelines from the European Society of Medical Oncology ESMO.
-
 Provide evidence-based contents, with notes on the level of evidence (where applicable) and suitable references, to the standard required for a publication in a scientific journal.
-
 Provide contents that are suitable for an international audience. Reference is made to the use of international terminology for procedures and therapeutic agents.
-
 Provide reading materials. Ulm University will assure that the publications are available at the University e-library.
-
 Adhere to ethical, medico-legal and legal requirements.
   


Regular annual reviews

The processes and activities in the Programme will be reviewed by the scientific directors and the chairmen once a year. This includes the timeliness and validity of the lectures and accompanying material.


Quality of Transfer

Upon completion of all Modules and Units, participants will have to complete an online evaluation by answering a structured questionnaire. The results of the questionnaire will be reviewed by the Chairmen.

The following criteria will be reviewed:

•  Course topics (quality, preparation, timeliness, relevance for practical work)
•  Theory-practice transfer
•  Course documentation
•  References
•  Lecturers’ competence
•  Individual needs


Quality of Mentoring

Participants will be supported by a two-level tutoring support:

   
1.
 Scientific-related support will be provided by the lecturer within a discussion forum. On the demand of the participants, lecturers will be asked to participate in a live webcast “meet-the-expert” session.
 2. Technical-related support will be provided by e-mail by the IT-provider Soon-Systems GmbH
   


Quality of Media

Media quality will be assured by an e-Learning Style Guide, providing the standards to be followed when developing computer-based learning contents for the Programme. The guide focuses on the following areas:

   
1.  Global Module Architecture
 2. Instructional Design Standards
 3. Graphical User Interface – Menu and Navigation
 4. Media Standards
 5. Writing Standards
 6. Evaluation Standards
 7. Quality Assurance
   


Learning Platform and SCORM Considerations (Shareable Content Object Reference Model)

The learning system launches learning content, keeps track of the learner’s progress, figures out in what order learning objects are to be delivered, and reports participants mastery through the e-learning units and modules. To standardise the learning contents and the tracking of the progress, the SCORM-standard is used by all methods within the Programme platform. The SCORM-standard consists of three parts: Overview, content aggregation model and run time environment.

Upon completion of each Unit and Module, learners will have to complete an online evaluation according to the learning system by answering a structured questionnaire.

The following criteria will be reviewed:

•  Tutoring and support
•  Interactivity
•  Attractiveness
•  Navigation


Quality of Lecturers

The lecturers are selected by the scientific directors under the supervision of the chairmen. To teach as lecturer in the Programme, oncologists and scientists have to fulfil the criteria of Ulm University, representing the academic demand. According to the demand of Ulm University, the Programme chairmen ascertain the accreditation, authorisation, professorship, scientific and research activities, publications and/or the venia legendi of each lecturer.


Conflict of Interests

All faculty members will be required to disclose financial interests that might influence their presentation or participation.
The list of disclosed conflict of interests, or their absence, will be published in the learning platform.