Blum et al. (2010) |
Examination of the quantitative relationship between simulation, student self-confidence, and clinical competence. |
N = 53 first-semester BSN students in a health assessment and skills course. |
Quantitative, quasi-experimental |
Students were assigned to control (traditional task trainers and student volunteers) and experimental (simulation-enhanced with human patient simulators) groups that met weekly during the 13-week course. Faculty and students scored clinical judgment during the midterm and final week. For those in the experimental group, clinical judgment was faculty scored in simulation scenarios of groups of two students. |
Selected four subscale items; recognizing deviations from expected patterns, information seeking, prioritizing data, and clear communication.
Internal consistency for student self-rated was α = 0.810 and faculty α = 0.884.
LCJR scored independently by multiple clinical faculty. Rater training not discussed. |
Bussard (2018) |
Examine the differences in clinical judgment of students across four simulation scenarios. |
N = 70 diploma prelicensure students completing a medical–surgical course |
Quantitative (part of mixed-method study), quasi-experimental |
Students participated, it appears as an individual, in four different simulation scenarios scheduled throughout the semester. Scenarios involved diabetic ketoacidosis, leg fracture, pneumonia with ischemic stroke, and bowel obstruction with a PE. Faculty scored clinical judgment during the simulations. |
All dimensions and subscales used.
LCJR scored independently by one rater.
Psychometric data not provided. |
Bussard (2015) |
Explore the nature of clinical judgment development as revealed in students' reflective journals after participating in four progressive high-fidelity simulation (HFS) scenarios |
N = 30 pre-licensure diploma nursing students in a medical–surgical nursing course. |
Qualitative (part of mixed-method study), interpretive description |
Students participated, it appears as an individual, in four different simulation scenarios scheduled throughout the semester. Scenarios involved diabetic ketoacidosis, leg fracture, pneumonia with ischemic stroke, and bowel obstruction with a PE. Clinical judgment was faculty scored through reflective journals on the experience. |
All dimensions and subscales used.
Psychometric data not provided.
LCJR scored independently by two raters. Rater training discussed. |
Coram (2016) |
Determine the effect of the specific prebriefing strategy of expert role modeling on novice nursing students' clinical judgment scores |
N = 43 junior university students enrolled in a medical–surgical nursing course. |
Quantitative, experimental |
Students were randomly assigned to treatment (prebriefing strategy of expert role modeling) and control (standard prebriefing) before participating, seemingly in a group, in simulation scenarios. Faculty scored clinical judgment during the simulation scenarios. Students self-scored and peer scored after the simulations. |
All dimensions and subscales used.
Percent agreement yielded a score of 80%.
LCJR scored independently by three raters. Rater training not discussed.
Limitations - The lack of significance in student scores may have been related to inadequate training of the students in how to use the LCJR. |
Douglass (2014)
DNP project |
Test the effect of the middle range theory of the Developing Nurses' Thinking (DNT) Model on clinical judgment in nursing students. |
N = 44 first semester senior BSN students in an adult health course |
Quantitative, experimental pre/posttest design |
Students were randomly assigned from clinical groups to receive the intervention (DNT model during clinical post conference) or control (standard clinical post conference). Faculty scored clinical judgment during a group simulation pre- and postintervention. |
All dimensions and subscales used.
Psychometric data not provided.
LCJR scored independently by one rater.
Limitations - limited time for rater practice before using. |
Fawaz & Hamdan-Mansour (2016) |
Study the impact of using high-fidelity simulation (HFS) on the development of clinical judgment and motivation for academic achievement among Lebanese nursing students. |
N = 56 first-year nursing students from two universities enrolled in an adult nursing course. |
Quantitative, quasi-experimental, posttest only |
Students in University A were assigned the intervention (individual simulation training on one congestive heart failure scenario) while students at university B were assigned to the control (traditional-method demonstration) group. All students then completed clinical training for patients with heart failure. Faculty scored clinical judgment at the end of clinical training. |
All dimensions and subscales used.
Internal consistency was α = 0.93.
LCJR scored independently by one rater. |
Ferguson (2012)
Dissertation |
Investigate the use of human patient simulation (HPS) as a tool to develop critical thinking knowledge and skills in undergraduate nursing students. |
N = 57 second-semester undergraduate BSN students |
Quantitative, experimental pre/posttest |
Students randomized into three groups; 1) lecture followed by a micro-simulation (virtual reality on cardiac arrhythmias), 2) lecture followed by a micro-simulation and group mentored simulation (narrow and wide complex tachycardia), 3) lecture followed by a microsimulation and group mentored/nonmentored simulation. Faculty scored clinical judgment for groups 2 and 3 through observation during a simulation. |
All dimensions and subscales used.
Psychometric data not reported.
LCJR scored independently by one rater.
Limitations - potential scoring bias due to only 1 rater limiting inter-rater reliability. |
Go (2012)
DNP project |
Examine the effect of high-fidelity patient simulation (HFPS) on the clinical judgment acquisition |
N = 35 nursing BSN students enrolled in a senior level medical–surgical nursing course |
Quantitative, quasi-experimental, pre/posttest design |
All students participated in a simulation scenario about congestive heart failure as a group. Faculty scored for clinical judgment based on their individual answers on a LCJR based congestive heart failure case scenario completed before and after the simulation. |
All dimensions and subscales used.
Psychometric data not provided.
LCJR scored independently by two raters. Rater training discussed. |
Gubrud-Howe (2008)
Dissertation |
Examine the effect of the learning framework How People Learn (HPL) impact development of clinical judgment. |
N = 36 ASN students in final semester enrolled at a community college. |
Mixed-methods, quasi-experimental pre/posttest, qualitative |
Students assigned to control (standard debriefing) and intervention (learning activity pre-simulation and structured debriefing based on the HPL framework) group. Both groups participated in the same 4 simulation scenarios in student groups. Faculty scored for clinical judgment during the 1st and 4th simulation. |
All dimensions and subscales used.
Internal consistency was α = .886 for “Noticing”, α = .931 for “Interpreting”, α = .887 for “Responding”, and α = .914 for “Reflecting”. Inter-rater reliability was 92% pretest and 96% posttest agreement. One-way ANOVA found no significant differences between raters.
LCJR scored by two raters for each student. Rater training discussed.
Limitations - lack of established reliability of the tool at the time. |
Johnson et al. (2012) |
Determine the effect of expert role modeling on nursing students' clinical judgment in the care of a simulated geriatric hip fracture patient. |
N = 94 first-semester nursing students from five schools of nursing |
Quantitative (part of mixed-methods study), quasi-experimental |
Students assigned to control and treatment groups before a simulation experience. The treatment group watched a video of expert role modeling in a simulated geriatric hip fracture scenario before the group simulation experience. Faculty scored for clinical judgment during the simulation. |
All dimensions and subscales used.
Psychometric data not reported.
LCJR scored independently by two raters for each student. Average scores of the two raters were recorded. Rater training discussed. |
Kubin & Wilson (2017) |
Examine the impact of using community voluntary children on physical assessment abilities and comfort levels among undergraduate pediatric nursing students. |
N = 99 undergraduate baccalaureate nursing students in the third semester pediatric course of a four-semester nursing program |
Quantitative, quasi-experimental |
Students assigned to two groups. After didactic and hands-on skills laboratory instruction on pediatric assessments, one group practiced group assessments on a high-fidelity simulator and the other practiced as a group on community volunteer children. Students self-assessed and faculty scored clinical judgment while individually performing a pediatric assessment during a hospital rotation. |
Only evaluated students on the noticing and responding domains.
Psychometric data not reported.
LCJR scored independently by multiple clinical faculty. Rater training not discussed. |
Kulju (2013)
Dissertation |
Examine the effects of high-fidelity patient simulation (HFPS) on the development of BSN students' knowledge, attitudes, and clinical judgment regarding pain management. |
N = 14 students enrolled in a traditional track and accelerated track BSN program |
Quantitative, experimental, pre/posttest repeated measures |
Students randomly assigned to control group (interactive case study) and treatment (one scenario HFPS) after didactic teaching on pain management. Faculty scored clinical judgment during an individual pretest entry-level pain management simulation and an individual posttest complex pain management simulation. |
All dimensions and subscales used.
Internal consistency was α = .97 pretest and α = .96 posttest. Pearson r = .993 and percent agreement 84% pretest. Pearson r = .780 and 81% posttest.
LCJR scored independently by two raters. Rater training discussed.
Limitations - Concerns with some lack of agreement between raters indicated some subjectivity and potential measurement error. |
Lasater et al. (2014) |
Determine the effect of expert role modeling on nursing students' clinical judgment in the care of a simulated geriatric hip fracture patient. |
N = 134 first-semester nursing students from four schools of nursing |
Qualitative (part of mixed-methods study), thematic and content analysis |
Students assigned to control and treatment groups before a simulation experience and real-life care experiences. The treatment group watched a video of expert role modeling in a simulated geriatric hip fracture scenario before the group simulation experience. Subsequently, students in both groups participated in real-life care experiences. Students completed and faculty scored a reflective journal after the simulation experience and 4 weeks after the real-life care experiences. |
All dimensions and subscales used.
Psychometric data not reported.
Qualitative data coded and research team analyzed coded data. |
Mann (2010)
Dissertation |
Evaluate the effectiveness of grand rounds as an educational strategy to develop critical thinking and clinical judgment skills in baccalaureate nursing students |
N = 22 second-semester baccalaureate students |
Mixed-methods, Quantitative, experimental, pre/posttest, |
Students randomly assigned to intervention or comparison group. Both groups participated in a health care dilemma case study. Students in the intervention group received a faculty-led grand rounds activity and follow up interview as an educational strategy while completing the case study. Clinical judgment was faculty scored and analyzed based on the recordings. |
All dimensions and subscales used.
Interrater reliability was 98.49%.
LCJR scored independently by two raters. Rater training not discussed. |
Marcyjanik (2016)
Dissertation |
Determine if the implementation of an objective structured clinical examination (OSCE) had an effect on senior baccalaureate nursing students' clinical self-competence scores. |
N = 35 senior baccalaureate capstone students in final semester |
Quantitative, quasi-experimental pre/posttest |
Students assigned to an intervention group (participated individually in a three-station OSCE) and control group (no OSCE participation). Clinical judgment was student self-scored pre- and posttest with a reflection survey of self-competence. |
All dimensions and subscales used.
Internal consistency reliability was noted at 0.82.
LCJR self-scored by students. Student rater training not discussed.
Limitations - amount of information students had about the LCJR. No explanation as to how this was a limitation was provided except as a potential bias. |
Mariani et al. (2013) |
Empirically test and compare the clinical judgment of students who participated in structured debriefing sessions using Debriefing of Meaningful Learning (DML) and of students who received unstructured debriefing. |
N = 86 first-semester junior-level university medical–surgical nursing course |
Mixed-methods, quasi-experimental |
Students assigned to either control or intervention group. Students participated individually in two simulations. The intervention group received the DML and control group received unstructured debriefing after each simulation. Clinical judgment was faculty scored at the conclusion of each simulation experience, prior to the debriefing. |
All dimensions and subscales used.
Internal consistency reliability ranged from α = .80 to .97 for total scale and subscales at each time of measurement.
Using Pearson product-moment correlation, the IRR was determined to be high (r = .92; p < .01). LCJR scored independently by multiple faculty. Rater training was discussed
Limitations – narrow range of scores reduced ability to discriminate between groups. |
McMahon (2013)
Dissertation |
Test the feasibility and effectiveness of a problem-based learning (PBL) intervention on clinical judgment in baccalaureate nursing students during a high-fidelity simulation (HFS) experience |
N = 18 senior-level final capstone course; baccalaureate |
Quantitative, quasi-experimental pre/posttest |
Students randomly assigned to either control or intervention group to prepare for the HFS experience. Intervention group participated in an online, group-based, facilitator guided, PBL intervention while the control group prepared independently. The group simulation experience was recorded, and faculty scored for clinical judgment. |
All dimensions and subscales used.
Five of the eighteen LCJR evaluations met an IRR of .70 or greater. IRR ranged from 0% to 100% agreement.
LCJR scored independently by two raters. Rater training discussed.
Limitations – the study only evaluated CJ one time. And poor IRR was seen as a limitation. |
Rodriguez (2014)
Dissertation |
Evaluate the effectiveness of simulation alone or in combination with traditional clinical experiences on the development of clinical judgment for all nursing students and for Hispanic nursing students specifically |
N = 60 completed first two semesters of associate degree program |
Mixed-methods, experimental, Sequential, exploratory |
Students were randomly assigned to one of 3 three clinical groups for four weeks: traditional, simulation, combined traditional and simulation. Clinical judgment from individual performance was faculty scored 4 times following each clinical experience. |
All dimensions and subscales used.
The percent agreement between the data collectors ranged 76 – 95%. Internal consistency reliability across the four weeks of clinical evaluation (week 3 α = 0.93, week 4 α = 0.93, week 5 α = 0.93, and week 6 α = 0.90).
LCJR scored independently by three raters. Rater training discussed.
Limitations - potential for inconsistent scores. |
Skoronski (2018)
Dissertation |
Determine if participation in a repeating cardiac arrest simulation experience has an impact on senior nursing students' knowledge and clinical judgment. |
N = 56 senior baccalaureate students |
Quantitative, quasi-experimental, repeated measures |
Recruited students participated in two group cardiac arrest simulations. Clinical judgment was faculty scored during each simulation. |
All dimensions and subscales used.
Psychometric data not provided.
LCJR scored independently by two raters. Rater training discussed.
Limitations - psychometric data was not collected. |
Yuan et al. (2014) |
Assess nursing students' clinical judgment in high-fidelity simulation-based learning using observational measures. The research questions further explains that clinical judgment will be measured through a series of simulation sessions. |
N = 120 2- and 3-year baccalaureate students who had completed fundamentals of nursing, health assessment, and medical–surgical nursing |
Quantitative, quasi-experimental single-group repeated-measures |
Year two and year three students were assigned to simulation groups within their year. Each group participated in five simulations. Video recordings of the simulations were faculty scored for clinical judgment. |
All dimensions and subscales used.
IRR ranged .833 to .910.
LCJR scored independently by two raters. Rater training not discussed. |