Other

RESEARCH Open Access

Rubric for the evaluation of competencies in traumatology in the Degree of Physiotherapy: Delphi approach Esther Díaz-Mohedo1 , Rita Romero-Galisteo1* , Carmen Suárez-Serrano2 , Esther Medrano-Sánchez2 and Rocío Martín-Valero1

Abstract

Background: In health professions, the curriculum that must be met in order to obtain the academic certificate is based on the development of the so-called competencies. The broad content of the Practicum of the Degree of Physiotherapy has led to the creation of multiple types of evaluation, which makes it difficult for faculty members to reach a consensus on competencies. The aim of this study was to develop and validate content of a rubric for the evaluation of acquired competencies related to physiotherapeutic performance and intervention in traumatology within the Practicum of the Degree of Physiotherapy.

Methods: Following the Delphi methodology, a group of experts from all over the Spanish territory participated in the study. Through on-line questionnaires, several sequential rounds were established, alternated by controlled feedback until obtaining a consensus in the opinion of the experts, which allowed elaborating the final rubric.

Results: Initially, 16 experts were contacted, of whom 10 worked and completed the final content of the rubric. For the 3 rounds that were conducted, the initial 142 interventions of the initial proposition, which correspond to specific competencies, were reduced to the final 29 items that compose the specific evaluation rubric presented in this study.

Conclusions: This rubric is an evaluation instrument with valid content for the assessment of specific competencies of Traumatology in the Practicum of the Degree of Physiotherapy.

Keywords: Evaluation, Higher education, Physiotherapy, Rubric, Delphi

Background In health professions, the curriculum that must be met in order to obtain the academic certificate is based on the development of the so-called competencies. These are defined not only as the understanding of the content, problem solving, clinical abilities and attitudes; they also include the know-how (or procedural knowledge) in the professional context, which requires the student to

implement the acquired knowledge in a creative, flexible and responsible manner [1]. In Europe, higher education is usually standardised though the Bologna Process [2, 3]. This challenge of homogenising the teaching-learning procedures involves the use of a common language, which has resulted in the proposition of contents and tools from different disciplines to respond to such a goal [4, 5]. At the same time, the evaluation of the abilities ac-

quired by the undergraduate students of the Degree of Physiotherapy during their university education has gen- erated multiple publications in the last years, which have

© The Author(s). 2021 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

* Correspondence: [email protected] 1Faculty of Health Sciences, Department of Physiotherapy, University of Málaga, C/ Arquitecto Francisco Peñalosa, 3, 29071 Málaga, Spain Full list of author information is available at the end of the article

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 https://doi.org/10.1186/s12909-021-02904-4

provided different tools designed to assess the compe- tencies acquired in different areas, such as patient edu- cation [5], clinical performance [6] and interprofessional collaboration [7]. Despite the existence of other, widely studied evalu-

ation tools [8, 9], the convenience of having consensual guidelines to score and evaluate the learning of the stu- dents has popularised the use of rubrics. These are use- ful to examiners, instructors and students [10]. In Physiotherapy, the evaluation of the clinical practices within the Practicum subject is varied, since their con- tent in the different fields is heterogeneous, which gen- erates a lack of consensus in the scientific literature about the contents that must be evaluated in the differ- ent areas [11]. In addition to this, a large number of the evaluation tools that are currently used do not comply with the adequate psychometric properties [12, 13]. In the evaluation of the Practicum of the Degree of Physio- therapy (an eminently practical subject, developed in the different health centres), such lack of consensus is evi- dent in the specific assessment of the competencies in Traumatology [14]. Consensus methods, such as Delphi, allow synthesising

information about a specific problem. Sequential rounds, alternated by controlled feedback, are used with the aim of reaching a consensus in the opinion of a group of identified experts [15]. Therefore, this is a useful ap- proach in situations where individual judgements must be considered to address an incomplete state of knowledge. The aim of this study was to develop and validate the

content of a rubric for the evaluation of acquired com- petencies related to physiotherapeutic performance in Traumatology within the Practicum of the Degree of Physiotherapy.

Methods The Delphi methodology was followed, which is useful and widely employed to identify and clarify roles, to reach consensus and to synthesise information, both in medical field and education, allowing the participation of an identified group of experts within the Spanish ter- ritory [5].

Participants Using a purposive sampling approach [16], 16 potential- participant experts were identified by members of the re- search team and were subsequently contacted and in- vited to participate in the Delphi questionnaire via e- mail. For these clinical consensus studies, Jones and Hunter recommend the participation of specialists in the specific area [17]. In this study, an expert was defined as a physiotherap-

ist with over 5 years of experience as either a faculty

member in the Practicum subject of the Degree of Physiotherapy, as a clinical tutor participating in the Practicum, or as a healthcare professional specialised in the field of Physiotherapy and specifically in Traumatol- ogy. The expert was also required to be working within the Spanish territory.

All participants signed informed consent documents. The study was approved by the Ethics Committee of the University of Málaga (CEUMA: 34-2020-H).

Procedure This study incorporated three rounds of on-line ques- tionnaires, described in the next section, which proved to the sufficient to generate an adequate feedback and establish a broad consensus on different opinions. New rounds were planned to accommodate additional inter- ventions or other problems that could justify this re- search. Each round of questionnaires was open for two weeks and a reminder e-mail was sent to all participants who had not replied two days before the submission deadline.

First round The questions of the first round were formatted in the on-line software LimeSurvey and were sent through a link via e-mail to each participant. The first Delphi round consisted of two sections. In the first section, socio-demographic information of

the experts was requested, including gender, age, profes- sional area, professional experience in years and geo- graphic location. This information was used to obtain feedback about the structure of the expert panel and guarantee the heterogeneous flow of contributions with regard to the analysis of the data. In the second section, the experts were asked the

open-ended Delphi question, developed by the authors of the study with the specific aim of generating enough themes integrated in the answers of the panel members, in line with a Delphi approach [5]. The initial question was designed to direct the experts

toward the consideration of multiple competencies and the consideration of competencies that physiotherapists may or may not have regarding physiotherapy applied in the field of Traumatology: “ What practical interventions do you think that undergraduate Physiotherapy students should carry out during their clinical practice in order to respond to the specific competencies related to the con- tents of Physiotherapy in Traumatology within the Prac- ticum subject?”. Based on the answers obtained, a search was con-

ducted in different databases to identify possible profes- sional interventions in this field. The terms used were “physiotherapy”, “traumatology”, “competencies”, “as- sessment”, “evaluation”, “skills”, “knowledge” and

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 2 of 10

“methods”. This literature review allowed completing the identification of different categories/areas of competen- cies that had to be addressed to improve the validity of the content of this tool. The editing of the obtained feedback was slightly

modified to make it clearer. The 44 interventions into which the initial 142 interventions were summarised are the following:

Specific

1. - Systematically elaborate and complete the physiotherapeutic medical record.

2. - Correctly record and write down the most relevant aspects of the evaluation of the patient: anamnesis, inspection, observation, examination, extraction and interpretation of data from medical reports and complementary diagnostic tests.

3. - Know the generalities of the most common medical-surgical interventions in the scope of trau- matology, as well as the cicatrization time of the different tissues.

4. - Identify as many symptoms and signs reported by the patient, as well as the psychosocial risk factors that may influence his/her recovery.

5. - Identify yellow and red flags or alarm signals that could require referral to a specialist during the patient’s evaluation/treatment process.

6. - Perform a complete evaluation of the patient’s movement and its possible alterations, making use of the pertinent measurement instruments (goniometer, measuring tape, stabilizer, etc.), recording such results adequately.

7. - Carry out a complete evaluation of the patient’s gait and its possible alterations.

8. - Assess and record pain through validated instruments and identify the type of pain presented by the patient (nociceptive, visceral, neuropathic or chronic/dysfunctional).

9. - Conduct a diagnostic palpation that allows you to obtain information of local suffering points, tissue normality and alterations of the palpated area, tissue asymmetries, etc., with anatomical precision and pressure adapted to the depth of the evaluated Sec.

10. - Carry out a neurological assessment of the patient through a test of superficial and deep sensitivity and reflexes, recording such information with specific terminology and interpreting the results adequately.

11. - Correctly select and perform orthopedic and/or functional tests, and interpret the results adequately.

12. - Write down the report of the patient’s physiotherapeutic evolution and/or discharge.

13. - Be capable of clinical reasoning, formulating coherent hypotheses and proposing differential diagnosis strategies that allow you to correctly identify the dysfunction presented by the patient and establish the physiotherapeutic diagnosis according to the internationally accepted rules.

14. - Correctly propose coherent physiotherapeutic objectives for the short, medium and long term, considering the pathology and the individuality of the user and his/her expectations and preferences.

15. - Plan the treatment in coherence with the objectives set, attending to the adequacy, validity and efficiency criteria, considering risks and contraindications, and efficiently managing the treatment time.

16. - Explain to the patient the purpose of the therapeutic interventions ensuring the adherence to the treatment.

17. - Reevaluate results periodically and adapt the intervention plan.

18. - Correctly execute a functional (preventive and/or therapeutic) and neuromuscular bandaging, knowing how to choose among the different materials and techniques to achieve the best result based on the objective set.

19. - Correctly execute a compressive bandaging to treat the edema.

20. - Correctly execute the procedure to calculate the TI curve in a certain muscular group and correctly interpret the result to subsequently proceed with electrostimulation.

21. - Know the effects of an electrotherapeutic application (motor electrostimulation, TENS, galvanic current, magnetotherapy, laser, shockwave therapy), know how to apply it correctly, selecting among the different parameters, establishing dosimetries and application times, etc., to achieve the best result based on the objective set.

22. - Know the effects of the different types of active exercise (isometric, concentric and eccentric isotonic, functional, motor control, etc.), adequately choosing among them and prescribing and controlling their correct execution to achieve the best result according to the objective set in a musculoskeletal dysfunction.

23. - Know the principles of proprioceptive reeducation in its different phases, adequately selecting the techniques depending on the evolution phase of the patient, and perform, prescribe and control its execution to achieve the best result according to the objective set.

24. - Know the effects of an application of thermotherapy (paraffin baths, microwaves, short wave, ultrasound, tecar therapy, etc.), know how to

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 3 of 10

apply it correctly, selecting among the different parameters, establishing dosimetries and application times, etc., to achieve the best result according to the objective set.

25. - Know the effects of support and loading in lower limb injuries, and know how to carry out the procedure of progressive loading and gait reeducation for the patient.

– Know the effects of the following manual therapy techniques, adequately selecting among them and executing them correctly to achieve the best result according to the objective set:

26. - Masotherapy, 27. - Neuromuscular techniques, 28. - Myofascial techniques, 29. - Articulatory techniques, 30. - Manipulative techniques, 31. - Neurodynamic techniques, 32. - Dry needling techniques, 33. - Mulligan techniques, 34. - Sohier techniques. 35. - Know and apply cortical reorganisation

techniques (motor imagery, mirror therapy, gradual exposure to movement).

36. - Know the indications and contraindications of all the above described therapeutic interventions.

37. - Know, design and implement Patient Health Education programmes in different situations (chronic diseases, pain, risk groups, etc.)

38. - Take into account safety measures, such as hand washing, use of gloves and protecting injured areas (depending on the patient’s evolution phase).

39. - Know and use relaxation techniques.

Transversal

40. - Show verbal and non-verbal communication skills, as well as an active listening attitude.

41. - Show empathy for the patient and face conflict situations adequately.

42. - Use an appropriate vocabulary in all contexts: patient, family and interdisciplinary team.

43. - Be active and proactive in the workplace, and interact correctly with the rest of the team members.

44. - Be responsible (punctual, correctly identified and uniformed, comply with the internal functioning rules of the centre, the data protection law, rotation dates and timetable/schedule, take care of the material, etc.), reflect on the risks and consequences

of your interventions, and communicate with the manager in the face of any event.

Second round The open questions of the first round were subjected to a frame analysis, as recommended by the Delphi ap- proach [18]. The principal investigator, who was quali- fied for the use of qualitative research methods, read all the data several times to familiarise with the meanings that were attributed to the practical competencies and the corresponding practical interventions. Each potential theme was discussed by the research team. An initial list of 142 interventions was synthesised and reduced to 39 items by the research team, based on a tentative list from different sources: competencies defined by the Ministry of Education for the Degree of Physiotherapy, statements about competencies from the White Paper about the Physiotherapy degree in Spain [19]. In compli- ance with Order CIN/2135/2008, the requirements for the verification of official university titles that enable a person to work as a physiotherapist were established and grouped into three dimensions: clinical history in Physiotherapy, physiotherapeutic diagnoses and clinical reasoning in traumatology. The final 39 items were writ- ten in the present tense, according to the design of the intervention, and they were presented in a format that allowed being verified by the expert panel [5]. Each member of the panel of the first round received an e- mail directly from the principal investigator with a link to the second questionnaire with the 29 items that cor- responded to the different competencies. The experts were asked to express, independently, their degree of conformity with the statements of each of the item pro- posed by all of them. The answers were established in a 5-point Likert scale, from 1 (totally disagree) to 5 (totally agree). A final space was included, in which the experts could leave a comment that could help to identify add- itional competencies-interventions which they believed were not included or to point out any problems they de- tected among the 39 items provided. The analysis of the Delphi panels was performed using

descriptive statistics that included measures of central tendency (median) and dispersion (interquartile range). Consensus was defined as the 75th percentile or higher values in the score of each item obtained by the panelists and an interquartile range below 3. The interventions that did not reach a consensus or

needed to be reformulated with respect to the items in this round were the following:

– Understanding the generalities of the medical- surgical interventions that are most commonly attended to in the field of Traumatology, as well as the wound healing times of the different tissues.

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 4 of 10

– Identifying most of the symptoms and signs reported by the patient, as well as the psychosocial risk factors that may influence his/her recovery.

– Conducting a complete evaluation of the gait of the patient and its possible alterations.

– Conducting a diagnostic palpation that allows obtaining information of local pain points, tissue normality and alterations of the examined area, tissue asymmetries, different sensations, etc., with anatomic precision and pressure adapted to the depth of the assessed plane.

– Knowing the effects of the following techniques of Manual Therapy, selecting adequately among them and executing the correctly in order to obtain the best result based on the objective set: Myofascial Techniques, Manipulation Techniques, Dry Needling Techniques, Mulligan Techniques and Sohier Techniques.

– Knowing and applying different cortical reorganization techniques (motor imagery, mirror therapy and graded exposure to movement).

Third round Each member of the panel received a new e-mail with a link to the second questionnaire with the resulting 30 items that corresponded to the different competencies. They were asked to proceed in the same manner, i.e., ex- pressing their degree of conformity with the statements of the items-interventions on which they all agreed, using the same 5-point Likert scale, again with an add- itional open space to leave any comments and/or suggestions. The answers of the third round were analysed based

on the same stabilization criteria, resulting in a final ru- bric with 29 items.

Table 1 Demographic characteristics of the expert panel

Gendern (%)

Workplace n (%)

Years of teaching experiencen (%)

Years of clinical experiencen (%)

Age (years)n (%)

Female 3 (30 %)

Male 7 (70 %)

U. of Castilla la Mancha

2 (20 %)

U. of Jaén 1 (10 %)

U. of Sevilla 1 (10 %)

U. of Valencia 2 (20 %)

U. of Ponferrada 1 (10 %)

U. of Granada 1 (10 %)

U. of La Coruña 1 (10 %)

U. of Málaga 1 (10 %)

0 to 10 3 (30 %)

11 to 20 4 (40 %)

21 to 30 2 (20 %)

31 to 40 1 (10 %)

0 to 10 4 (40 %)

11 to 20 4 (40 %)

21 to 30 1 (10 %)

31 to 40 0 (0 %)

41 to 50 1 (10 %)

20–30 1 (10 %)

31–40 2 (20 %)

41–50 4 (40 %)

51–60 1 (10 %)

61–70 2 (20 %)

U. University

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 5 of 10

Results Expert panel Of the 16 experts that were invited to participate, 10 ac- cepted the invitation and signed an informed consent form. These 10 responded to all three rounds (10/10, 100 %). The demographic characteristics of the expert panel are presented in Table 1.

Summary of the Delphi process The Delphi phase required 3 rounds to reach consensus (Fig. 1). This method produced a list of 39 interventions that were associated with each of the 13 competencies (Table 2). Of the 39 interventions provided in the second round,

30 were agreed on and presented in the third round, in which the experts agreed upon 29 interventions that they finally considered important to include in the rubric of the Practicum of Physiotherapy to respond to the spe- cific competencies related to Physiotherapy in Trauma- tology (Fig. 1).

The final interventions and their corresponding spe- cific competencies are shown in Table 2.

The intervention that did not reach the consensus of the expert panel was the following:

– Correctly executing the procedure to calculate the time-intensity curve (TIC) in a specific muscular group and correctly interpreting the result for the subsequent electrostimulation procedure.

Discussion In this study, we developed and validated the content of a rubric for the evaluation of specific competencies re- lated to physiotherapeutic performance and intervention in the field of traumatology for use by undergraduate Physiotherapy students in the corresponding Practicum. After the analysis of the initial 142 interventions, a final evaluation rubric with 29 interventions, corresponding to 13 specific competencies, was agreed upon by 10 experts. The current certification state of university titles gen-

erates the need to create competency-based evaluation tools that guarantee the quality of the evaluation pro- cesses based on the direct observation of the different interventions of the students with real patients in the

Fig. 1 Summary of the procedure by rounds

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 6 of 10

Table 2 Competencies and their association with the interventions

Specific competencies of the White Paper about the Degree of Physiotherapy

Interventions of the rubric

1. Elaborate and complete the clinical physiotherapy history.

Elaborate and complete the clinical physiotherapy history in a systematic manner

Correctly record and write the most relevant aspects of the valuation of the patient: anamnesis, inspection, observation, exploration, extraction of data of medical reports and diagnostic tests

2. Examine and assess the functional state of the patient/user.

Identify alarm signs that may influence the evolution of the treatment and/or may require referral to the specialist during the evaluation/treatment of the patient

Perform, in patients who require so, an evaluation (visual and/or instrumental) of the movement of the patient (range, quality, strength,…) and its possible alterations, recording such results adequately

Assess and record pain, in patients who require so, through validated instruments, and identify the type of pain observed (nociceptive, visceral, neuropathic or chronic-dysfunctional)

When appropriate, conduct a neurological assessment of the patient through a superficial and deep sensitivity test and a reflex test, recording such information with proper terminology and interpreting the results adequately

3. Determine the physiotherapy diagnosis. Identify most of the symptoms and signs reported by the patient

Correctly select and conduct orthopedic and/or functional tests and adequately interpret the results

Be able to perform clinical reasoning, proposing coherent hypotheses and strategies of differential diagnosis

4. Design the physiotherapy intervention or treatment plan.

Correctly prescribe and control physical exercise in its different modalities (isometric, concentric and eccentric isotonic, functional, motor control, conscious movement, etc.), adequately selecting among them to achieve the best result according to the objective set in a musculoskeletal dysfunction

Prescribe, perform and/or control the Proprioceptive and Neuromuscular Re-education Tech- niques in their different phases, adequately selecting the techniques according to the evolu- tionary phase of the patient to achieve the best result based on the objective set

5. Execute, direct and coordinate the physiotherapy intervention plan.

Correctly propose coherent physiotherapeutic objectives in the short, medium and long term, considering the pathology and the individuality of the user and his/her expectations and preferences

Plan the treatment based on the objectives set, attending to the criteria of adequacy, validity and efficiency, considering risks and contraindications and efficiently managing the treatment time

Correctly perform a bandaging (functional, neuromuscular, compressive), knowing the best choice among the different materials and techniques to achieve the best result according to the objective set

Correctly carry out an application of electrotherapy (motor electrostimulation, TENS, galvanic current, magnetotherapy, laser, shock waves), selecting among the different parameters, and establishing dosimetries and application times, etc., to achieve the best result according to the objective set

Know the effects of the different techniques of Manual Therapy: massage therapy (decontraction, bowel evacuation, cicatrization massage, Cyriax), adequately selecting among them and correctly executing them to achieve the best result according to the objective set

Correctly carry out an application of thermotherapy (paraffin baths, MW, PSWT, radiofrequency, etc.), selecting among the different parameters, and establishing dosages and application times, etc., to achieve the best result according to the objective set

Carry out the procedure of progressive loading and gait reeducation in patients who require so due to the lower limbs injuries

Correctly carry out the following techniques of Manual Therapy: neuromuscular techniques, adequately selecting among them to achieve the best result according to the objective set

Correctly carry out the following techniques of Manual Therapy: articulatory techniques, adequately selecting among them to achieve the best result according to the objective set

Correctly carry out the following techniques of Manual Therapy: neurodynamic techniques, adequately selecting among them to achieve the best result according to the objective set

6. Motivate others. Explain to the patient the purpose of the therapeutic interventions to achieve their adherence to the treatment

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 7 of 10

clinical context. The evaluable criteria must consider those tasks from the cognitive, procedural, affective and interpersonal perspectives, including the evaluation of the different interventions conducted. These range from the integral approach applied in the first contact with the patients/users of the health system to the diagnoses and the different therapeutic and preventive interven- tions carried out [20]. The evaluation performed during the university prac-

tical training helps students to develop abilities that will allow them to establish an adequate relationship with their patients [21]. Previous studies claim that rubric- based evaluations are equivalent to and possibly more accurate than the traditional evaluation methods (clinical evaluation of health professionals) in the improvement of the knowledge and abilities acquired through educa- tion by the students of health professionals [22]. There is a large variety of instruments designed to

evaluate university students during their training period [5, 8]. However, the results of a systematic review criti- cise the lack of evidence about their educational impact and the evaluation of the educational results [6]. Some studies support the qualitative approach, which,

through exhaustive interviews and focus groups, provide an enriching perspective for the identification of the the- matic categories about the competencies of a specific field within physiotherapy to select the clinical interven- tions of the experts [23]. Other authors use quantitative methods, such as questionnaires [24], application of the Generalizability Theory [25] and mixed approaches [7]. The Delphi method for information gathering used in the present study is the most widely used in the field of Health Sciences [26, 27]. However, the issues identified in this study are dynamic and may change over time as the practice of mindfulness progresses and may need to be revisited in the near future [28]. The rubrics for the evaluation of competencies ac-

quired by the students in health university subjects are of objective utility to determine their critical thinking,

case-resolution capacity, etc. through the positive feed- back obtained [29], which helps constituting such ru- brics as a potentially valuable strategy that must be implemented from higher education. The implementa- tion of these tools must be based on a multidimensional theoretical framework such as the one used in this study, thus providing a high content validity. The set of se- lected interventions was constantly subjected to the competencies that they had to represent, that is, the traumatology competencies that should be included in order to: elaborate and complete the clinical physiother- apy history; examine and value the functional state of the patient/user; determine the physiotherapy diagnosis; execute, direct, design and coordinate the physiotherapy intervention plan; evaluate the evolution of the results, etc. [19]. Our results are in line with those of previous studies,

which claim that the use of a rubric facilitates the evalu- ation of the clinical reasoning of Physiotherapy in Trau- matology [14, 25]. We believe that the implementation of the rubric-based evaluation tool has increased the ac- curacy of the evaluation of physiotherapy students with respect to the clinical professionals objective score [30, 31]. Strengths: Traditionally, clinical competencies have

been assessed frequently through general impressions from repeated encounters between professionals, clinical tutors and students, with obvious limitations due to het- erogeneity and lack of assessment criteria. The findings of this study can help all stakeholders to solve this problem. Limitations: Given that the Delphi process was conducted in an

asynchronous manner, the experts and the researchers had limited opportunity to resolve any miscommunica- tions. Although it is deemed a valuable method to gener- ate knowledge in an area that lacks empirical evidence, the competencies selected in our study should be sub- jected to further research to investigate their usefulness

Table 2 Competencies and their association with the interventions (Continued)

Specific competencies of the White Paper about the Degree of Physiotherapy

Interventions of the rubric

7. Evaluate the evolution of the results. Re-evaluate the results periodically and adapt the intervention plan

8. Provide an efficient and integral care. In patients who require so, apply techniques of cortical reorganization (motor imagery, mirror therapy, graded exposure to movement)

9. Incorporate scientific research and evidence-based practice as professional culture.

Know the indications and contraindications of all the proposed therapeutic interventions

10. Intervene in health promotion and disease prevention.

Know, design and implement educational programmes for the health of the patient in different situations (chronic diseases, pain, risk groups, etc.)

11. Write the physiotherapy discharge report. Write the physiotherapy report of the progress and/or discharge of the patient

12. Keep knowledge, abilities and attitudes up to date.

Consider safety measures such as handwashing, the use of gloves and protection of the injured areas (based on the progress period)

13. Manage stress. Know and use relaxation techniques in patients who require so

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 8 of 10

across different clinical settings and within assessment measures [5]. Further research should also explore how individual

competencies may be grouped or categorised based on the clinical setting or stage of the patient consultation. This should be validated through consensus or observa- tional research to further develop a competency model that is consistent with relevant frameworks for physio- therapists and aid in practical applications.

Conclusions This rubric is expected to contribute to improving the content validity of an instrument that will be used to as- sess the competencies of undergraduate Physiotherapy students in the field of Traumatology in the Practicum. Both students and faculty members will have at their disposal an optimised and recent instrument that removes subjectivity in the evaluation process, clearly defining what is going to be evaluated. Furthermore, this tool will help to internalise in faculty members and stu- dents the specific competences of Traumatology in the Practicum of the Degree of Physiotherapy. This study demonstrates the feasibility of using expert

consensus to establish conditions impacting the com- plexity of procedural skills, and the benefits of incorpor- ating the Delphi method.

Acknowledgements The authors thank the expert participants for their willingness and collaboration with the study. The authors´ confirm that all methods were carried out in accordance with relevant guidelines and regulations.

Authors’ contributions All authors have made substantial contributions to all of the following: (1) the conception and design of the study (RRG, EDM), acquisition of data (EDM, RMV), analysis and interpretation of data (EMS, CSS); (2) drafting the article or revising it critically for important intellectual content (EDM, RRG, RMV). The authors read and approved the final manuscript.

Funding Not applicable.

Availability of data and materials The dataset used during the current study is available from the corresponding author on reasonable request.

Declarations

Ethics approval and consent to participate The study was approved by the Ethics Committee of the University of Málaga (CEUMA: 34-2020-H). All participants signed informed consent documents.

Consent for publication All participants signed informed consent for publication documents.

Competing interests The authors declare that they have no competing interests.

Author details 1Faculty of Health Sciences, Department of Physiotherapy, University of Málaga, C/ Arquitecto Francisco Peñalosa, 3, 29071 Málaga, Spain. 2Faculty of

Nursey, Physiotherapy and Podiatry, Department of Physical Therapy, University of Sevilla, C/ Avicena, s/n, 41009 Seville, Spain.

Received: 18 March 2021 Accepted: 11 August 2021

References 1. Weber JM. Core competencies for health care professionals. J Allied Health.

2006;35:185. 2. Collins S, Hewer I. The impact of the Bologna process on nursing higher

education in Europe: A review. Int J Nurs Stud. 2014;51:150–6. https://doi. org/10.1016/j.ijnurstu.2013.07.005.

3. European Commission. The Bologna process and the European Higher education area. Brussels: European Comission; 2014.

4. Iglesias-Parra MR, García-Guerrero A, García-Mayor S, Kaknani- Uttumchandani S, León-Campos Á, Morales-Asencio JM. Design of a competency evaluation model for clinical nursing practicum, based on standarized language systems: psychometric validation study. J Nurs Scholarsh. 2015;47:371–6. https://doi.org/10.1111/jnu.12140.

5. Forbes R, Mandrusiak A, Smith M, Russell T. Identification of competencies for patient education in physiotherapy using a Delphi approach. Physiother (United Kingdom). 2018;104:232–8. https://doi.org/10.1016/j.physio.2017.06. 002.

6. O’Connor A, McGarr O, Cantillon P, McCurtin A, Clifford A. Clinical performance assessment tools in physiotherapy practice education: a systematic review. Physiother (United Kingdom). 2018;104:46–53. https://doi. org/10.1016/j.physio.2017.01.005.

7. Curran V, Hollett A, Casimiro LM, McCarthy P, Banfield V, Hall P, et al. Development and validation of the interprofessional collaborator assessment rubric (ICAR). J Interprof Care. 2011;25:339–44. https://doi.org/1 0.3109/13561820.2011.589542.

8. Chan A, Purcell A, Power E. A systematic review of assessment and intervention strategies for effective clinical communication in culturally and linguistically diverse students. Med Educ. 2016;50:898–911. https://doi.org/1 0.1111/medu.13117.

9. Hawkins RE, Margolis MJ, Durning SJ, Norcini JJ. Constructing a validity argument for the mini-clinical evaluation exercise: A review of the research. Acad Med. 2010;85:1453–61. https://doi.org/10.1097/ACM.0b013e3181eac3 e6.

10. Stevens DD, Levi AJ. Introduction to rubrics: an assessment tool to save grading time, convey effective feedback and promote student learning. Virginia: Sterling; 2004.

11. Crossley J, Humphris G, Jolly B. Assessing health professionals. Med Educ. 2002;36:800–4. https://doi.org/10.1046/j.1365-2923.2002.01294.x.

12. Oates M, Davidson M. A critical appraisal of instruments to measure outcomes of interprofessional education. Med Educ 2015;49:386–98. https:// doi.org/10.1111/medu.12681.

13. Downing SM, Validity. On the meaningful interpretation of assessment data. Med Educ. 2003;37:830–7. https://doi.org/10.1046/j.1365-2923.2003.01594.x.

14. Zamora Navas P, Guerado Parra E. The rubric in the oral exam in Traumatology and Orthopaedics. Educ Med. 2018;19:318–24. https://doi. org/10.1016/j.edumed.2017.04.018.

15. Hsu Chia-Chien, Sandford BA. The delphi technique: making sense of Consensus. Proj Apprais. 2007;3:55–6. https://doi.org/10.1080/02688867.1988. 9726654.

16. Springer K. Educational Research: A Contextual Approach. NJ: Wiley; 2010. 17. Jones J, Hunter D. Consensus methods for medical and health services

research. BMJ. 1995;311:376–80. https://doi.org/10.1136/bmj.311.7001.376. 18. Krippendorff K. Content Analysis An Introduction to Its Methodology. 2nd

ed. London: SAGE Publications; 2013. 19. Agencia Nacional de Evaluación de la Calidad y Acreditación (ANECA). Libro

Blanco de la Titulación de Fisioterapia. Madrid: ANECA; 2004. 20. Martiáñez Ramírez NL, Terrón López MJ, Gallego Izquierdo T, Álvarez

Comino MJ, Rubio Alonso M, Hernando Jerez MA. Competencias en las Prácticas Clínicas en Ciencias de la Salud Guía de estrategias y recursos para su desarrollo y evaluación. Madrid: Edit Médica Panamericana; 2016.

21. Polonio-López B, Triviño-Juárez JM, Corregidor-Sánchez AI, Toledano- González A, Rodríguez-Martínez MC, Cantero-Garlito P, et al. Improving self- perceived emotional intelligence in Occupational Therapy students through practical training. Front Psychol. 2019;10:1–11. https://doi.org/10.3389/ fpsyg.2019.00920.

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 9 of 10

22. Dunleavy G, Nikolaou CK, Nifakos S, Atun R, Law GCY, Car LT. Mobile digital education for health professions: Systematic review and meta-analysis by the digital health education collaboration. J Med Internet Res. 2019;21(2): e12937. https://doi.org/10.2196/12937.

23. Langridge N. The skills, knowledge and attributes needed as a first-contact physiotherapist in musculoskeletal healthcare. Musculoskeletal Care. 2019. https://doi.org/10.1002/msc.1401.

24. Mori B, Norman KE, Brooks D, Herold J, Beaton DE. Canadian Physiotherapy Assessment of Clinical Performance: Face and Content Validity. Physiother Canada. 2016;68:64–72. https://doi.org/10.3138/ptc.2015-35E.

25. Yeung E, Kulasagarem K, Woods N, Dubrowski A, Hodges B, Carnahan H. Validity of a new assessment rubric for a short-answer test of clinical reasoning. BMC Med Educ. 2016;16:1–10. https://doi.org/10.1186/s12909-01 6-0714-1.

26. Weigl M, Cieza A, Andersen C, Kollerits B, Amann E, Stucki G. Identification of relevant ICF categories in patient with chronic health conditions: A Delphi exercise. J Rehabil Med Suppl. 2004:12–21. https://doi.org/10.1080/1 6501960410015443.

27. de Villiers MR, de Villiers PJT, Kent AP. The Delphi technique in health sciences education research. Med Teach. 2005;27:639–43. https://doi.org/1 0.1080/13611260500069947.

28. Martínez-Sánchez A. Using the Delphi Technique to Determine Objectives and Topical Outline for a Pharmaceutical Care Course: An Experience from the Cuban Higher. Educ Syst. 2020;1:1–11. https://doi.org/10.21203/rs.3.rs-3 5397/v1.

29. Cockett A, Jackson C. The use of assessment rubrics to enhance feedback in higher education: An integrative literature review. Nurse Educ Today. 2018; 69:8–13. https://doi.org/10.1016/j.nedt.2018.06.022.

30. Smith KM, Geletta S, Mcardle A. The Use of Rubrics in the Clinical Evaluation of Podiatric Medical Students: Objectification of the Subjective Experience. J Am Podiatr Med Assoc. 2016;106(1):60–7. https://doi.org/10.7547/14-038.

31. Llaurado-Serra M, Rodríguez E, Gallart A, Fuster P, Monforte-Royo C, De Juan M. Assessing the competences associated with a nursing Bachelor thesis by means of rubrics. Nurse Educ Today. 2018;66:103–9. https://doi.org/10.1016/ j.nedt.2018.04.009.

Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Díaz-Mohedo et al. BMC Medical Education (2021) 21:474 Page 10 of 10

BioMed Central publishes under the Creative Commons Attribution License (CCAL). Under the CCAL, authors retain copyright to the article but users are allowed to download, reprint, distribute and /or copy articles in BioMed Central journals, as long as the original work is properly cited.