Variables that can improve formative feedback
", "tags": [], "relations": {}, "dateAdded": "2013-11-19T19:41:27Z", "dateModified": "2013-11-20T01:35:51Z" } }, { "key": "6CM2JTKH", "version": 60, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/6CM2JTKH", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/6CM2JTKH", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/HT3FABGZ", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "6CM2JTKH", "version": 60, "parentItem": "HT3FABGZ", "itemType": "note", "note": "Indian journal - how to make CV lectures more interactive and engaging for dental students
", "tags": [], "relations": {}, "dateAdded": "2013-11-20T01:12:00Z", "dateModified": "2013-11-20T01:12:13Z" } }, { "key": "TBEA3TQK", "version": 59, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/TBEA3TQK", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/TBEA3TQK", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/RTNN4RGF", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "TBEA3TQK", "version": 59, "parentItem": "RTNN4RGF", "itemType": "attachment", "linkMode": "imported_file", "title": "EffectiveFeedbackHealthProfessionals_Archer2009.pdf", "accessDate": "", "url": "", "note": "", "contentType": "application/pdf", "charset": "", "filename": "EffectiveFeedbackHealthProfessionals_Archer2009.pdf", "md5": "e0185f067eda20a3d699dc9976bb7a0b", "mtime": 1384893715773, "tags": [], "relations": {}, "dateAdded": "2013-11-19T20:44:59Z", "dateModified": "2013-11-19T20:44:59Z" } }, { "key": "RTNN4RGF", "version": 57, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/RTNN4RGF", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/RTNN4RGF", "type": "text/html" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "creatorSummary": "Archer", "parsedDate": "2010", "numChildren": 1 }, "data": { "key": "RTNN4RGF", "version": 57, "itemType": "journalArticle", "title": "State of the science in health professional education: effective feedback: Effective feedback in health professional education", "creators": [ { "creatorType": "author", "firstName": "Julian C", "lastName": "Archer" } ], "abstractNote": "", "publicationTitle": "Medical Education", "publisher": "", "place": "", "date": "01/2010", "volume": "44", "issue": "1", "section": "", "partNumber": "", "partTitle": "", "pages": "101-108", "series": "", "seriesTitle": "", "seriesText": "", "journalAbbreviation": "", "DOI": "10.1111/j.1365-2923.2009.03546.x", "citationKey": "", "url": "http://doi.wiley.com/10.1111/j.1365-2923.2009.03546.x", "accessDate": "2013-11-19T20:41:02Z", "PMID": "", "PMCID": "", "ISSN": "03080110, 13652923", "archive": "", "archiveLocation": "", "shortTitle": "State of the science in health professional education", "language": "", "libraryCatalog": "CrossRef", "callNumber": "", "rights": "", "extra": "", "tags": [], "collections": [], "relations": {}, "dateAdded": "2013-11-19T20:41:02Z", "dateModified": "2013-11-19T20:41:02Z" } }, { "key": "6JHM9JCK", "version": 56, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/6JHM9JCK", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/6JHM9JCK", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/E52626BA", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "6JHM9JCK", "version": 56, "parentItem": "E52626BA", "itemType": "note", "note": "CITATION: Strong J, Hughes C, Wilson W, Arnott W, Isles R, Bennison A. Perceptions of Feedback Among Undergraduate and
Postgraduate Students of Four Health Science Disciplines. The Internet Journal of Allied Health Sciences and Practice. Oct
2012. Volume 10 Number 4.
\n
Not the most applicable
\nVerbal feedback during practical sessions highly valued by health science students
", "tags": [], "relations": {}, "dateAdded": "2013-11-19T20:01:54Z", "dateModified": "2013-11-19T20:05:11Z" } }, { "key": "59DISR2I", "version": 54, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/59DISR2I", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/59DISR2I", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/XTMDZF7Q", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } } }, "data": { "key": "59DISR2I", "version": 54, "parentItem": "XTMDZF7Q", "itemType": "attachment", "linkMode": "linked_url", "title": "PubMed entry", "accessDate": "2013-11-19T20:00:41Z", "url": "http://www.ncbi.nlm.nih.gov/pubmed/1540", "note": "", "contentType": "text/html", "charset": "", "tags": [], "relations": {}, "dateAdded": "2013-11-19T20:00:41Z", "dateModified": "2013-11-19T20:00:41Z" } }, { "key": "BD6J7NWH", "version": 54, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/BD6J7NWH", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/BD6J7NWH", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/9XCSBVNX", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } } }, "data": { "key": "BD6J7NWH", "version": 54, "parentItem": "9XCSBVNX", "itemType": "attachment", "linkMode": "linked_url", "title": "PubMed entry", "accessDate": "2013-11-19T20:00:40Z", "url": "http://www.ncbi.nlm.nih.gov/pubmed/580", "note": "", "contentType": "text/html", "charset": "", "tags": [], "relations": {}, "dateAdded": "2013-11-19T20:00:40Z", "dateModified": "2013-11-19T20:00:40Z" } }, { "key": "2FDMPPM2", "version": 53, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/2FDMPPM2", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/2FDMPPM2", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/7XRIE5TA", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "2FDMPPM2", "version": 53, "parentItem": "7XRIE5TA", "itemType": "note", "note": "Verification: correct vs incorrect
\nElaboration can (a) address the topic, (b) address the response, (c) discuss the particular
error(s), (d) provide worked examples, or (e) give gentle guidance. The first
three types of elaborated feedback are more specific and directive, and the last two
types are more general and facilitative.
Prequel to other prospective study.
\nThis one just discusses how people found automated response systems (ARS) useful in lecture and that it enhances learning by making lecture less passive of an experience.
\nNo comment on how lectures are evaluated; they just used Likert scales.
", "tags": [], "relations": {}, "dateAdded": "2013-11-16T17:11:25Z", "dateModified": "2013-11-16T17:12:34Z" } }, { "key": "PE5GS9R4", "version": 47, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/PE5GS9R4", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/PE5GS9R4", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/H4GCX7BB", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "PE5GS9R4", "version": 47, "parentItem": "H4GCX7BB", "itemType": "note", "note": "Keane, Elaine, and I. Labhrainn. \"Obtaining student feedback on teaching & course quality.\" Brie ing paper 2 (2005).
", "tags": [], "relations": {}, "dateAdded": "2013-11-14T15:50:48Z", "dateModified": "2013-11-14T15:50:50Z" } }, { "key": "5C6D4K4D", "version": 46, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/5C6D4K4D", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/5C6D4K4D", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/5P2BBVET", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "5C6D4K4D", "version": 46, "parentItem": "5P2BBVET", "itemType": "attachment", "linkMode": "imported_file", "title": "QualityWrittenFeedback_BMCMedicalEducation2012.pdf", "accessDate": "", "url": "", "note": "", "contentType": "application/pdf", "charset": "", "filename": "QualityWrittenFeedback_BMCMedicalEducation2012.pdf", "md5": "488e8b65197d9ae7be234792b1527b10", "mtime": 1380207933203, "tags": [], "relations": {}, "dateAdded": "2013-09-26T15:09:40Z", "dateModified": "2013-11-14T15:48:10Z" } }, { "key": "JUW6VM6G", "version": 46, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/JUW6VM6G", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/JUW6VM6G", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/5P2BBVET", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "JUW6VM6G", "version": 46, "parentItem": "5P2BBVET", "itemType": "note", "note": "Intro: numerical feedback is poor means of changing practice (has references for these) and written or \"narrative\" feedback can improve in-trainer performance.
\nResults: trainers left specific comments frequently but rarely provided an action plan on HOW to turn those comments into improvements. Trainee self-reflective comments were sparse.
", "tags": [], "relations": {}, "dateAdded": "2013-09-26T15:07:15Z", "dateModified": "2013-11-14T15:48:08Z" } }, { "key": "V6IURV69", "version": 46, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/V6IURV69", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/V6IURV69", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/5P2BBVET", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } } }, "data": { "key": "V6IURV69", "version": 46, "parentItem": "5P2BBVET", "itemType": "attachment", "linkMode": "linked_url", "title": "PubMed entry", "accessDate": "2013-11-14T15:48:04Z", "url": "http://www.ncbi.nlm.nih.gov/pubmed/23075126", "note": "", "contentType": "text/html", "charset": "", "tags": [], "relations": {}, "dateAdded": "2013-11-14T15:48:04Z", "dateModified": "2013-11-14T15:48:04Z" } }, { "key": "5P2BBVET", "version": 46, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/5P2BBVET", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/5P2BBVET", "type": "text/html" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "creatorSummary": "Pelgrim et al.", "parsedDate": "2012", "numChildren": 3 }, "data": { "key": "5P2BBVET", "version": 46, "itemType": "journalArticle", "title": "Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise: an observational study", "creators": [ { "creatorType": "author", "firstName": "Elisabeth A M", "lastName": "Pelgrim" }, { "creatorType": "author", "firstName": "Anneke W M", "lastName": "Kramer" }, { "creatorType": "author", "firstName": "Henk G A", "lastName": "Mokkink" }, { "creatorType": "author", "firstName": "Cees P M", "lastName": "Van der Vleuten" } ], "abstractNote": "BACKGROUND: Research has shown that narrative feedback, (self) reflections and a plan to undertake and evaluate improvements are key factors for effective feedback on clinical performance. We investigated the quantity of narrative comments comprising feedback (by trainers), self-reflections (by trainees) and action plans (by trainer and trainee) entered on a mini-CEX form that was modified for use in general practice training and to encourage trainers and trainees to provide narrative comments. In view of the importance of specificity as an indicator of feedback quality, we additionally examined the specificity of the comments.\nMETHOD: We collected and analysed modified mini-CEX forms completed by GP trainers and trainees. Since each trainee has the same trainer for the duration of one year, we used trainer-trainee pairs as the unit of analysis. We determined for all forms the frequency of the different types of narrative comments and rated their specificity on a three-point scale: specific, moderately specific, not specific. Specificity was compared between trainee-trainer pairs.\nRESULTS: We collected 485 completed modified mini-CEX forms from 54 trainees (mean of 8.8 forms per trainee; range 1-23; SD 5.6). Trainer feedback was more frequently provided than trainee self-reflections, and action plans were very rare. The comments were generally specific, but showed large differences between trainee-trainer pairs.\nCONCLUSION: The frequency of self-reflection and action plans varied, all comments were generally specific and there were substantial and consistent differences between trainee-trainer pairs in the specificity of comments. We therefore conclude that feedback is not so much determined by the instrument as by the users. Interventions to improve the educational effects of the feedback procedure should therefore focus more on the users than on the instruments.", "publicationTitle": "BMC medical education", "publisher": "", "place": "", "date": "2012", "volume": "12", "issue": "", "section": "", "partNumber": "", "partTitle": "", "pages": "97", "series": "", "seriesTitle": "", "seriesText": "", "journalAbbreviation": "BMC Med Educ", "DOI": "10.1186/1472-6920-12-97", "citationKey": "", "url": "", "accessDate": "", "PMID": "", "PMCID": "", "ISSN": "1472-6920", "archive": "", "archiveLocation": "", "shortTitle": "Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise", "language": "eng", "libraryCatalog": "NCBI PubMed", "callNumber": "", "rights": "", "extra": "PMID: 23075126", "tags": [ { "tag": "Awareness", "type": 1 }, { "tag": "Clinical Competence", "type": 1 }, { "tag": "Curriculum", "type": 1 }, { "tag": "Education, Medical, Graduate", "type": 1 }, { "tag": "Educational Measurement", "type": 1 }, { "tag": "Faculty, Medical", "type": 1 }, { "tag": "Feedback", "type": 1 }, { "tag": "General Practice", "type": 1 }, { "tag": "Goals", "type": 1 }, { "tag": "Humans", "type": 1 }, { "tag": "Inservice Training", "type": 1 }, { "tag": "Internal-External Control", "type": 1 }, { "tag": "Motivation", "type": 1 }, { "tag": "Narration", "type": 1 }, { "tag": "Netherlands", "type": 1 }, { "tag": "Observer Variation", "type": 1 }, { "tag": "Problem Solving", "type": 1 }, { "tag": "Psychometrics", "type": 1 }, { "tag": "Self-Assessment", "type": 1 }, { "tag": "Writing", "type": 1 } ], "collections": [], "relations": {}, "dateAdded": "2013-11-14T15:48:04Z", "dateModified": "2013-11-14T15:48:04Z" } }, { "key": "T55EMC5A", "version": 45, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/T55EMC5A", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/T55EMC5A", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/5HC26IH3", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "T55EMC5A", "version": 45, "parentItem": "5HC26IH3", "itemType": "attachment", "linkMode": "imported_file", "title": "StudentPerceptionEvaluation_BMCMedicalEducation2012.pdf", "accessDate": "", "url": "", "note": "", "contentType": "application/pdf", "charset": "", "filename": "StudentPerceptionEvaluation_BMCMedicalEducation2012.pdf", "md5": "4f7b760da9b32e58a149eaf75194d3de", "mtime": 1380206858159, "tags": [], "relations": {}, "dateAdded": "2013-09-26T14:47:41Z", "dateModified": "2013-11-14T15:47:41Z" } }, { "key": "EWWSXSKH", "version": 45, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/EWWSXSKH", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/EWWSXSKH", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/5HC26IH3", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "EWWSXSKH", "version": 45, "parentItem": "5HC26IH3", "itemType": "note", "note": "German students questionnaire/discussion group. Students prefer comments to numerical scoring to induce change/improvement in teaching. Faculty have difficulty interpreting \"3\" on numerical scales. Discusses how incentives for good teaching in medical education are not optimal--professors have no objective rewards for being good teachers.
", "tags": [], "relations": {}, "dateAdded": "2013-09-26T14:32:32Z", "dateModified": "2013-11-14T15:47:35Z" } }, { "key": "5HC26IH3", "version": 45, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/5HC26IH3", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/5HC26IH3", "type": "text/html" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "creatorSummary": "Schiekirka et al.", "parsedDate": "2012", "numChildren": 3 }, "data": { "key": "5HC26IH3", "version": 45, "itemType": "journalArticle", "title": "Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school", "creators": [ { "creatorType": "author", "firstName": "Sarah", "lastName": "Schiekirka" }, { "creatorType": "author", "firstName": "Deborah", "lastName": "Reinhardt" }, { "creatorType": "author", "firstName": "Susanne", "lastName": "Heim" }, { "creatorType": "author", "firstName": "Götz", "lastName": "Fabry" }, { "creatorType": "author", "firstName": "Tobias", "lastName": "Pukrop" }, { "creatorType": "author", "firstName": "Sven", "lastName": "Anders" }, { "creatorType": "author", "firstName": "Tobias", "lastName": "Raupach" } ], "abstractNote": "BACKGROUND: Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data.\nMETHODS: This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers.\nRESULTS: Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers.\nCONCLUSIONS: In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.", "publicationTitle": "BMC medical education", "publisher": "", "place": "", "date": "2012", "volume": "12", "issue": "", "section": "", "partNumber": "", "partTitle": "", "pages": "45", "series": "", "seriesTitle": "", "seriesText": "", "journalAbbreviation": "BMC Med Educ", "DOI": "10.1186/1472-6920-12-45", "citationKey": "", "url": "", "accessDate": "", "PMID": "", "PMCID": "", "ISSN": "1472-6920", "archive": "", "archiveLocation": "", "shortTitle": "Student perceptions of evaluation in undergraduate medical education", "language": "eng", "libraryCatalog": "NCBI PubMed", "callNumber": "", "rights": "", "extra": "PMID: 22726271", "tags": [ { "tag": "Curriculum", "type": 1 }, { "tag": "Education, Medical, Undergraduate", "type": 1 }, { "tag": "Female", "type": 1 }, { "tag": "Focus Groups", "type": 1 }, { "tag": "Germany", "type": 1 }, { "tag": "Humans", "type": 1 }, { "tag": "Learning", "type": 1 }, { "tag": "Male", "type": 1 }, { "tag": "Perception", "type": 1 }, { "tag": "Qualitative Research", "type": 1 }, { "tag": "Schools, Medical", "type": 1 }, { "tag": "Students, Medical", "type": 1 }, { "tag": "Teaching", "type": 1 } ], "collections": [], "relations": {}, "dateAdded": "2013-11-14T15:47:29Z", "dateModified": "2013-11-14T15:47:29Z" } }, { "key": "IWDAX87V", "version": 45, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/IWDAX87V", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/IWDAX87V", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/5HC26IH3", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } } }, "data": { "key": "IWDAX87V", "version": 45, "parentItem": "5HC26IH3", "itemType": "attachment", "linkMode": "linked_url", "title": "PubMed entry", "accessDate": "2013-11-14T15:47:29Z", "url": "http://www.ncbi.nlm.nih.gov/pubmed/22726271", "note": "", "contentType": "text/html", "charset": "", "tags": [], "relations": {}, "dateAdded": "2013-11-14T15:47:29Z", "dateModified": "2013-11-14T15:47:29Z" } }, { "key": "PMFXUNGD", "version": 44, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/PMFXUNGD", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/PMFXUNGD", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/I2UK5S8W", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "PMFXUNGD", "version": 44, "parentItem": "I2UK5S8W", "itemType": "attachment", "linkMode": "imported_file", "title": "AttributesEffectiveMedicalLecture_JGIM2000.pdf", "accessDate": "", "url": "", "note": "", "contentType": "application/pdf", "charset": "", "filename": "AttributesEffectiveMedicalLecture_JGIM2000.pdf", "md5": "3284a1e22adf7fb7d3e267847bd5d14f", "mtime": 1380205551953, "tags": [], "relations": {}, "dateAdded": "2013-09-26T14:52:36Z", "dateModified": "2013-11-14T15:47:05Z" } }, { "key": "G7XXW9A5", "version": 44, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/G7XXW9A5", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/G7XXW9A5", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/I2UK5S8W", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "numChildren": 0 }, "data": { "key": "G7XXW9A5", "version": 44, "parentItem": "I2UK5S8W", "itemType": "note", "note": "Identifies basic elements of effective internal medicine lecture. Biggest takeaway seems to be the use of a computerized audience response system (ARS) as a tool to increase audience engagement and learning.
", "tags": [], "relations": {}, "dateAdded": "2013-09-26T14:53:08Z", "dateModified": "2013-11-14T15:47:03Z" } }, { "key": "8SJ6E927", "version": 44, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/8SJ6E927", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/8SJ6E927", "type": "text/html" }, "up": { "href": "https://api.zotero.org/groups/216000/items/I2UK5S8W", "type": "application/json" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } } }, "data": { "key": "8SJ6E927", "version": 44, "parentItem": "I2UK5S8W", "itemType": "attachment", "linkMode": "linked_url", "title": "PubMed entry", "accessDate": "2013-11-14T15:47:00Z", "url": "http://www.ncbi.nlm.nih.gov/pubmed/10886470", "note": "", "contentType": "text/html", "charset": "", "tags": [], "relations": {}, "dateAdded": "2013-11-14T15:47:00Z", "dateModified": "2013-11-14T15:47:00Z" } }, { "key": "I2UK5S8W", "version": 44, "library": { "type": "group", "id": 216000, "name": "Lecture Evaluation", "links": { "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation", "type": "text/html" } } }, "links": { "self": { "href": "https://api.zotero.org/groups/216000/items/I2UK5S8W", "type": "application/json" }, "alternate": { "href": "https://www.zotero.org/groups/lecture_evaluation/items/I2UK5S8W", "type": "text/html" } }, "meta": { "createdByUser": { "id": 1516615, "username": "abkothar", "name": "", "links": { "alternate": { "href": "https://www.zotero.org/abkothar", "type": "text/html" } } }, "creatorSummary": "Copeland et al.", "parsedDate": "2000-06", "numChildren": 3 }, "data": { "key": "I2UK5S8W", "version": 44, "itemType": "journalArticle", "title": "Successful lecturing: a prospective study to validate attributes of the effective medical lecture", "creators": [ { "creatorType": "author", "firstName": "H L", "lastName": "Copeland" }, { "creatorType": "author", "firstName": "D L", "lastName": "Longworth" }, { "creatorType": "author", "firstName": "M G", "lastName": "Hewson" }, { "creatorType": "author", "firstName": "J K", "lastName": "Stoller" } ], "abstractNote": "OBJECTIVE: In a study conducted over 3 large symposia on intensive review of internal medicine, we previously assessed the features that were most important to course participants in evaluating the quality of a lecture. In this study, we attempt to validate these observations by assessing prospectively the extent to which ratings of specific lecture features would predict the overall evaluation of lectures.\nMEASUREMENTS AND MAIN RESULTS: After each lecture, 143 to 355 course participants rated the overall lecture quality of 69 speakers involved in a large symposium on intensive review of internal medicine. In addition, 7 selected participants and the course directors rated specific lecture features and overall quality for each speaker. The relations among the variables were assessed through Pearson correlation coefficients and cluster analysis. Regression analysis was performed to determine which features would predict the overall lecture quality ratings. The features that most highly correlated with ratings of overall lecture quality were the speaker's abilities to identify key points (r =.797) and be engaging (r =.782), the lecture clarity (r =.754), and the slide comprehensibility (r =.691) and format (r =.660). The three lecture features of engaging the audience, lecture clarity, and using a case-based format were identified through regression as the strongest predictors of overall lecture quality ratings (R2 = 0.67, P = 0.0001).\nCONCLUSIONS: We have identified core lecture features that positively affect the success of the lecture. We believe our findings are useful for lecturers wanting to improve their effectiveness and for educators who design continuing medical education curricula.", "publicationTitle": "Journal of general internal medicine", "publisher": "", "place": "", "date": "Jun 2000", "volume": "15", "issue": "6", "section": "", "partNumber": "", "partTitle": "", "pages": "366-371", "series": "", "seriesTitle": "", "seriesText": "", "journalAbbreviation": "J Gen Intern Med", "DOI": "", "citationKey": "", "url": "", "accessDate": "", "PMID": "", "PMCID": "", "ISSN": "0884-8734", "archive": "", "archiveLocation": "", "shortTitle": "Successful lecturing", "language": "eng", "libraryCatalog": "NCBI PubMed", "callNumber": "", "rights": "", "extra": "PMID: 10886470", "tags": [ { "tag": "Education, Medical, Continuing", "type": 1 }, { "tag": "Humans", "type": 1 }, { "tag": "Internal Medicine", "type": 1 }, { "tag": "Prospective Studies", "type": 1 }, { "tag": "Regression Analysis", "type": 1 }, { "tag": "Teaching", "type": 1 } ], "collections": [], "relations": {}, "dateAdded": "2013-11-14T15:47:00Z", "dateModified": "2013-11-14T15:47:00Z" } } ]