Go to the content. | Move to the navigation | Go to the site search | Go to the menu | Contacts | Accessibility

| Create Account

Callegaro, Silvia (2008) Quality assurance della formazione medica specialistica: applicazione della norma IS0 9001 e gestione della valutazione nella scuola di specializzazione in pediatria di Padova. [Ph.D. thesis]

Full text disponibile come:

Documento PDF

Abstract (english)

Introduction - The issues of quality assurance and quality improvement are betweeen the leading points in guiding the European political process for the development of common strategies in higher education, known like Bologna Process, from the end of years '90.
In post-graduate medical education there is an increasing interest in such issues, reflecting the imminent scene of a common European sanitary system, characterized from the circulation of the sanitary professionals in the European Countries, and the growing demand for excellence in the medical performances.
Quality assurance in medical education has meant to develop standards and guidelines for the university and post-graduate education, and to promote the mutual acknowledgment of the curricula and degrees. Moreover, promotion of cooperation in quality assurance is also a “culture of quality”, that it should permeate each individual post-graduate medical education programs.
The ISO 9001:2000 Standard outlines requirements for quality management systems, offering a support for quality assurance strategies. The objective of these standards is to provide an effective system reflecting a company’s practices for producing goods and services that conform to requirements and enhance customer satisfaction. The peculiarity of a quality system based on the ISO 9001:2000 standards is the fact that it focuses on process rather than on product quality or on content, and that it can be applied to any type of organization.
The Resident Affair Commettee of the postgraduate pediatric training program of the University of Padova has decided to apply ISO 9001 Standards of Quality, not only for the organizational and administrative aspects, but above all for the management of the educational processes (learning and practice activities).
Between ISO 9001 principles, the continuous improvement (based on the monitoring of processes) and the customer focused organisation are of paramount importance in the quality management for the postgraduate medical education. In this context, “continuous monitoring” can be translated in “evaluation of the residents in terms of medical competency, professional attitudes, level of autonomy, in relationship to the learning outcomes“, and the “customer satisfaction” concept can be translated in “the appraisal on the programs of formation supplied by the residents (the main customers of the School)”.

Purpose of the thesis is to describe the experience of application of the ISO 9001:2000 Standard for the management of internal quality assurance and quality improvement within the pediatric training program of the Univeristy of Padova, and to evaluate some results, limits and perspectives that this experience can suggest for the improvement of the quality in the higher medical education. Another objective of the thesis is to discuss the implementation of a comprehensive evaluation system, in order to satisfy ISO 9001:2000 requirements, and the strategic meaning of the evaluation like source for the development of indicators for the continuous quality improvement.
Methods - The postgraduate pediatric training program of the University of Padua is a Ministerial accredited five-year program that provides a Diploma of Specialization in Pediatrics. Approximately 80% of learning activities take place in the setting of clinical practice, under supervision, with increasing levels of responsibilities throughout the five-year period. The remainder of the learning activities include formal lectures, seminars, workshops and personal studies. 92 residents were in training in 2007/2008 academic year.
In order to build a quality management system based on the ISO 9001:2000 standard, the Direction of the School has established a Quality Policy, defining Mission and quality goals of the School; therefore it has identified the interlinked processes on which the training program is based, using a a “process management approach”. The Quality Management System has been documented by a Quality Manual, organizational procedures, work instructions and records. A system to record, monitor and produce objective data regarding some of the activities of the postgraduate pediatric training program was introduced.
The entire process of creation and implementation of this system took almost 18 months.
During this period three internal audits of the ISO 9001:2000 standards were conducted by an expert group. After the three internal audits, an accredited third-party registrar audited the quality system and certified that the postgraduate pediatric training program of the Padua University met the ISO 9001:2000 requirements.
Between the main quality system processes, the one relative to the evaluation of the residents and the activities has been submitted to a substantial review. First of all, specific formative objectives, for every year of school and every period of training, have been defined, to which the appraisal of the single residents should be referred. Then, questionnaries of evaluation have been developed. The inner coherence of questionnaries has been validated by measurement of ? of Cronbach (mean value > 0,9). The appraisal process has thus become source of results for monitoring customer satisfaction and the impact of the certification.
Results - By adoption of a quality management system through ISO 9001:2000 Standard, for the first time the pediatric postgraduate training program formalized its Policy for Quality Assurance, declaring Mission and values, and defined the main processes the School, that are overall summarized in one macro-process, which is to make a specialist in Pediatrics out of a graduate in Medicine. Then, a wide corpus of documents has been produced, constituted by a Handbook of the Quality, a Document of Process, 10 organizational procedures and 23 operating instructions.
The overall process was fragmented in a series of interlinked processes, that were clustered into three categories (the “main processes”, meaning the ones intimately related to the training activities; the “supportive processes”, which, even if not contributing directly to the training itself, are essential for the appropriate realization of the main
processes; the “general processes”, the ones offering general support to all the others in order to meet all the ISO 9001:2000 requirements). All this material was written and made publicly available. Furthermore a system for governing and periodically reviewing the teaching activities as well as for assessing the residents and the teaching staff was implemented. All this permitted to develop objective indicators to continuously monitor the functioning of the training program and to set improvement actions.
The results obtained by the evaluation of the activities of the School allowed the comparison between the period before the certification of the School and the period after (March-October 2008). Residents answered to 43 questionnaires on the activity of the School and 213 questionnaires on the training periods lead in the previous academic year (71% responses); moreover, 98 questionnaires on the training periods, post-certification (65.3% responses). The results of the retrospective evaluation on the training show a total level of satisfaction (defined like good/optimal judgments) to 63%, but less than 30% for the effectiveness of the frontal lessons, the planning of the activities of clinical training, the systems of evaluation, the communication of the outcomes of the evaluation and the availability of the teachers.
From this analysis, the Residents Affair Committee has left for the definition of the objectives of improvement for the next three years (planning and organization of the theoretical didactics, improvement of the clinical training and practice, introduction of a new system of residents’ evaluation and feed back of the result of the judgment).
After the certification of the School, the evaluation on the activities of the School (“customer satisfaction”) is not changed, even if there is a positive trend for two items: better definition of the formative objectives and better organization of the job (from 38% to 50%), and improvement on respect of the times of job (from 51% to 57%). In both cases the result goes toward the goal of 60% satisfaction. Both the retrospective judgments and the post-certification ones show that the worst aspects of the clinical training are the paucity of didactic meeting during clinial training, and the insufficient possibility to learn invasive procedures (levels of satisfaction are inferior to 25% both in the pre than in the post-certification period).
After the introduction of the quality management system, the Responsibles of the Clinical Wards expressed 73 questionnaires of evaluation on the activity of the residents (cover to 48%); similarly, using the same questionnaires, the residents evaluated themselves (84 questionnaires on 150, equal cover to 56%). The agreement between external appraisals and self-made evaluation (calculated by means of k of Cohen on 33 joined questionnaires) is equal to 0,067: the residents critically judge their level of autonomy and their medical knowledges and give themselves worst evaluation than theirs tutors.
Conclusions - The process of application of ISO 9001:2000 Standard to the management of the Pediatric post-graduate program of University of Padova represents an innovative approach toward the quality improvement, to met the action lines derived from the Bologna Process.
The ISO 9001 requirements allowed to identify, to make explicit and to declare the intimate processes and their interactions underlying professional post-graduate pediatric training in Padua and provided a system to control, monitor and improve them. All this, in brief, meant a better governance. In our experience, this approach has contributed to a diffuse culture for recognising the importace of the quality in everybody’s work, supported from an analogous quality management system, adopted by the clinical Services of the Children’s Hospitals where residents work. By adopting the concepts of monitoring and measurement of prefixed objectives, this quality management system lead the School to identify points of force and areas of weakness, and to set up concrete actions of improvement.
The planning of a new system of evaluation through computer science support has been crucial, because it has allowed to obtain results of customer satisfaction. They have identified a good degree of satisfaction on regard of the formative activities (already before the introduction of the quality management), and put in light criticities (low effectiveness of the frontal lessons, of the planning of the trainings anf of the modality of evaluation); these items became new objective of improvement for the next three years.
This experience has some important limits: to plan a system of management in compliance with ISO 9001:200 requirements has been really expensive in terms of human resources and of hours of job, so as the implementation of this system and its successive maintenance, that needs continuous reiforces for its manteinance. Moreover, the first results of the monitoring of the indicators demonstrate that changes are slow and still little perceived, for which these first elaboration of customer satisfaction must be judged like a preliminary matter, and indeed it is premature for being able to express a realistic judgment on the impact of the certification ISO on the quality of the School.
In conclusion, for the first time in the post graduate medical education, ISO 9001 requirements have been introduced like tool of planning, control and improvement of the processes of formation, adapting them to the peculiarities and the requirements of the formative medical process. This experience of quality assurance and quality improvement is not proposed as a gold standard to apply to similar programs of formation, but as a possible referring example for developing the action lines of the Bologna Process. At last, this project of the pediatric training program of Padova remembers that the responsibility for quality assurance in higher medical education lies with each single institution, whatever are the strategies of quality adopted.

Statistiche Download - Aggiungi a RefWorks
EPrint type:Ph.D. thesis
Tutor:Da Dalt, Liviana and Fabbris, Luigi
Data di deposito della tesi:09 January 2009
Anno di Pubblicazione:December 2008
Key Words:quality assurance, quality improvement, ISO 9001:2000 Standard, higher medical education
Settori scientifico-disciplinari MIUR:Area 06 - Scienze mediche > MED/38 Pediatria generale e specialistica
Struttura di riferimento:Dipartimenti > pre 2012 - Dipartimento di Pediatria
Codice ID:1318
Depositato il:09 Jan 2009
Simple Metadata
Full Metadata
EndNote Format


I riferimenti della bibliografia possono essere cercati con Cerca la citazione di AIRE, copiando il titolo dell'articolo (o del libro) e la rivista (se presente) nei campi appositi di "Cerca la Citazione di AIRE".
Le url contenute in alcuni riferimenti sono raggiungibili cliccando sul link alla fine della citazione (Vai!) e tramite Google (Ricerca con Google). Il risultato dipende dalla formattazione della citazione.

1. Owlia MS, Aspinwall EM. Quality in higher education – a survey. Total Quality Cerca con Google

Management 1996; 7(2): 161-177 Cerca con Google

2. International Standards Organisation. ISO 8402: quality vocabulary. International Cerca con Google

Standards Organisation, Switzerland, 1986 Cerca con Google

3. Magd H, Curry A. ISO 9000 and TQM: are they complementary or contradictory to Cerca con Google

each other? The TQM Magazine 2003; 15(4): 244-256 Cerca con Google

4. Ho SK, Wearn K. A TQM model for higher education and training. Training for quality Cerca con Google

1995; 3(2): 25-33 Cerca con Google

5. Witcher BJ. Total marketing: total quality and the marketing concept. The quarterly Cerca con Google

review of marketing. Winter 1990 Cerca con Google

6. ISO. ISO 9000 Quality Management Systems – Fundamentals and vocabulary. Cerca con Google

International Organization for Standardization; Geneve. 2000. Cerca con Google

7. ISO. ISO 9001. Quality management systems – Requirements. International Cerca con Google

Organization for Standardization; Geneve. 2000. Cerca con Google

8. ISO. ISO 9004. Quality management systems. Guidelines for performance Cerca con Google

improvements. International Standard Organization, Genève. 2000 Cerca con Google

9. UNI (Ente Nazionale Italiano di Unificazione). UNI EN ISO 9001. Norma Italiana. Cerca con Google

Sistemi di gestione per la Qualità. Requisiti. UNI, Milano, 21.12.2000 Cerca con Google

10. Walton M. Deming Management at work. G.P. Putnam’s Sons Publishers, New York. Cerca con Google

1990 Cerca con Google

11. Laszlo G. “ISO 9000 e TQM- different approaches to quality”. In HO S. (ED) Cerca con Google

Proceedings of the first international Conference on ISO 9000 and TQM. 1996, April. Cerca con Google

De Montfort University, Leicester, UO. Pp. 35-40 Cerca con Google

12. McAdam R, Mc Kneown M. Life after ISO 9000: an analysis of the impact of ISO 9000 Cerca con Google

and total quality management on small businesses in Northern Ireland. Total Quality Cerca con Google

Management 1999; 10(2): 229-241 Cerca con Google

13. Ho S. Change for the better via ISO 9000 and TQM. Management decision 1999; Cerca con Google

37(4): 381-388 Cerca con Google

14. European Minister of Education. Joint Declaration. “The Bologna Declaration” of 19 Cerca con Google

June 1999. available at http://www.dfes.gov.uk/bologna Vai! Cerca con Google

15. Oliver R, Sanz M. The Bologna process and health science education: times are Cerca con Google

changing. Medical Education 2007; 41: 309-317. Cerca con Google

16. What is the Bologna process? Available at http://www.eua.be/index.php?id=65 Vai! Cerca con Google

17. EUA European University Association. Lisbon Declaration – Europe’s University Cerca con Google

beyond 2010: diversity with a common purpose. Available at Cerca con Google

109 Cerca con Google

http://www.eua.be/fileadmin/user_upload/files/Lisbon_Convention/Lisbon_Declaration. Vai! Cerca con Google

pdf Cerca con Google

18. European Association for Quality Assurance in Higher Education. Standards and Cerca con Google

Guidelines for Quality Assurance in the European Higher Education Area. Helsinki Cerca con Google

2005. Available at: http://www.enqa.eu/pubs.lasso Vai! Cerca con Google

19. DM n° 509 del 3.11.1999. Regolamento recante norme concernenti l’autonomia Cerca con Google

didattica degli atenei. Cerca con Google

20. DM n.270 del 22.10.2004. Modifiche del Regolamento recante norme concernenti Cerca con Google

l’autonomia didattica degli atenei, approvato con Decreto del Ministro dell’Università e Cerca con Google

della Ricerca scientifica e tecnologica il 3.11.1999, n.509. Cerca con Google

21. DL n°368 del 17.08.1999 Attuazione della direttiva 93/16/CEE in materia di libera Cerca con Google

circolazione dei medici e di reciproco riconoscimento dei loro diplomi, certificati ed altri Cerca con Google

titoli e delle direttive 97/50/CE, 98/63/ce e 99/46/ce che modificano la direttiva Cerca con Google

93/16/CEE. Cerca con Google

22. D.R. n. 232 del 11.02.2003. Regolamento per le Scuole di Specializzazione di Area Cerca con Google

Sanitaria. Cerca con Google

23. DM n°176 del 01.08.2005 (GU 05.11.2005). Riassetto delle Scuole di Specializzazione Cerca con Google

di area sanitaria. Cerca con Google

24. Allegato 1 al DM 01.08.2005 (GU 05.11.2005). Ordinamenti didattici Scuole di Cerca con Google

Specializzazione di Area Sanitaria. Cerca con Google

25. DM 11.05.1995 e 03.07.1996. Modificazioni all’ordinamento Didattico universitario Cerca con Google

relativamente alle Scuole di specializzazione del settore medico, e successive Cerca con Google

integrazioni. Cerca con Google

26. DM 29.03.2006 (GU n.105 del 08.05.2006). Definizione degli standard e dei requisiti Cerca con Google

minimi delle scuole di specializzazione. Cerca con Google

27. DM 06.07.2007. Definizione schema tipo del Contratto di formazione specialistica dei Cerca con Google

medici, ai sensi dell’Art. 37 del D. Lgs. 368/1999 e successive modifiche Cerca con Google

28. Sirvanci MB. Critical issues for TQM implementation in higher education. The TQM Cerca con Google

Magazine 2004; 16 (6): 382-386 Cerca con Google

29. DeShields OW Jr, Kara A, Kaynak E. Determinants of business student satisfaction Cerca con Google

and retention in higher education: applying Herzberg’s two factor theory. The Cerca con Google

International Journal of Educational Management, 2005;19 (2): 128-39. Cerca con Google

30. Karle H. Global standards and accreditation in medical education: a view from the Cerca con Google

WFME. Acad Med 2006; 81(12 Suppl):S43-S48 Cerca con Google

31. Karle H, Gordon D. Quality standards in medical education. Lancet 2007, 370 Cerca con Google

(9602):1828 Cerca con Google

32. Gordon D, Christensen L, Dayrit M, Dela F, karle H, Mercer H. Educating health Cerca con Google

professionals: the Avicenna project. Lancet 2008; 371: 966-967 Cerca con Google

110 Cerca con Google

33. Carroll VS, Thomas G, De Wolff D,. Academic Quality improvement program: using Cerca con Google

quality improvement as tool for the accreditation of nursing education. Q Manage Cerca con Google

Health Care 2006; 15(4):291-295 Cerca con Google

34. www.UEMS.net Vai! Cerca con Google

35. UEMS (Union Europeenne des Medecins Specialistes). UEMS Policy Statement on Cerca con Google

assessments during specialist postgraduate medical training. 2006/19. Available on Cerca con Google

www.UEMS.net Vai! Cerca con Google

36. UEMS 1990. UEMS specific recommendations for the specialty “Paediatrics”. Cerca con Google

37. Conferenza permanente dei Direttori delle Scuole di Specializzazione in Pediatria. “La Cerca con Google

valutazione e la certificazione delle attività”. Padova, 2.12.2006 Cerca con Google

38. Osservatorio Nazionale della Formazione Medica Specialistica. “L’accreditamento Cerca con Google

delle strutture ed i requisiti di idoneità della rete formativa, ai sensi del DL 368/99”. Cerca con Google

39. Fabbris L. (editor). Effectiveness of University Education in Italy. Employability, Cerca con Google

competences, human capital. Physica-Verlag Ed, Heidelberg 2007 (Preface) Cerca con Google

40. Campostrini S, Gerzeli S. “Informative sources for the evaluation of the University Cerca con Google

Education Effectiveness in Italy”. In Fabbris L. Effectiveness of University Education in Cerca con Google

Italy. Employability, competences, human capital”. Physica-Verlag Ed, Heidelberg Cerca con Google

2007 (Part I, pag.1-9) Cerca con Google

41. http://www.unipd.it Vai! Cerca con Google

42. http://www.pediatria.unipd.it Vai! Cerca con Google

43. Eriksen S.D. TQM and the transformation from an elite to a mass system of higher Cerca con Google

education in the UK. Quality Assurance in Education 1995;3(1):14-29. Cerca con Google

44. Bezzi C. “Il disegno della ricerca valutativa”. F. Angeli Editore, Milano, 2001. Cerca con Google

45. Koch J.V. TQM: why is ist impact in higher education so small? The TQM magazine Cerca con Google

2003: 15(5); 325-333 Cerca con Google

Download statistics

Solo per lo Staff dell Archivio: Modifica questo record