System for Evaluation of Teaching Qualities (SETQ) Smart for use in Brazil: resident’s version

Abstract

ABSTRACT Introduction: It is commonly recognized that the enhancement of students’ learning potential is directly related to preceptors’ qualities. In this sense, the assessment of teachers’ practice becomes an essential element in ensuring the quality in the training of new specialists. However, in the context of medical education in Brazil, there are currently few studies on the evaluation of preceptors and a shortage of instruments for this purpose. One of the currently available instruments is the System for Evaluation of Teaching Qualities (SETQ) Smart. Objective: To conduct a cross-cultural adaptation and content validity of SETQ for use in Brazil. Methods: This instrument comprises two versions and, in this study, the version for residents was adapted for preceptor assessment. The cultural adaptation followed five steps: two initial English to Brazilian Portuguese translations; two synthesis translations; two back-translations; an expert committee assessment of conceptual analysis, semantic, idiomatic and cultural equivalences; and a pre-test. In addition, a panel of expert judges conducted the content validation. Results: Forty resident physicians, with a median age of 30 (IQR = 6.25), participated in the pre-test. Eighty percent of the participants rated the components that make up the SETQ Smart as clear and culturally appropriate, except for the title statement. The expert panel of judges comprised ten residents, 70% female. The agreement rates ranged from 80 to 100% regarding clarity, cultural adequacy, item representativeness within their respective domains and each item permanence in the instrument assessments. Conclusion: This study culturally adapted one of the two versions of the SETQ Smart for use in Brazil and provided preliminary evidence sources of validity of the versions through content validation.