Inter-Rater and Intra-Rater Reliability of Return-to-Work Screening Tests for UK Firefighters Following Injury
Round 1
Reviewer 1 Report
The study addresses the problem of firefighters returning to work after a musculoskeletal injury, in that there is no physical performance screening test available to provide evidence of task competency. The research proposes that firefighters are tactical athletes. The aim is to assess the inter-rater and intra-rater reliability of a RTW screening test to be used on UK firefighters following injury. The authors’ previous research identified the tasks for the RTW screening test to be implemented in UK fire services nationally. The current research determined the reliability of the test with overall good results. The intra-rater reliability was interpreted between moderate-excellent. This is important to determine whether a firefighter passes or fails the test on a reliable basis.
Comment: “Further research is needed to assess the validity of the use of this RTW screening test to help reduce firefighter reinjury rates in UK fire and rescue services”. It appears there is mostly consideration of firefighters who want to RTW. Although, there could be more consideration about those who do not want to RTW in their previous role. Perhaps, they are claiming total and permanent disability. For example, the firefighters who experience a musculoskeletal injury may have been provided with different specialist opinions about the type of work they are suited for. As their job is linked to their identity, they don’t want to easily give it up. They may also be able to pass the test on a good day. Although, they may trigger the injury again perhaps years later it exacerbates. Therefore the 2nd or 3rd RTW situations need to be considered in terms of the suitability of the RTW test. Is it a one test covers all? Or does it become redundant at some point? How can users of the test account for fluctuations of the injury over the course of time? Consider the cases of false positives for example.
Author Response
"Please see the attachment."
Author Response File: 
Author Response.docx
Reviewer 2 Report
This paper investigates and analyzes the inter-rater and intra-rater reliability of a RTW screening test to be used on UK firefighters following injury. Although this paper may provide valuable findings, I could not fully understand the methods.
1) I confused “Score”. In the case of “Putting on & Removal of Breathing Apparatus
Set” task, does “Score” mean that the number of pass in 6 pass criteria? Please define what “Score” is.
2) Does the video include examples of Pass and Fall in all criteria in each task?
3) How were the Pass and Fall examples in videos determined?
4) Why are the results shown separately for Pass and Fail in Table 3? Conversely, why don't Table 1 and 2 show the results separately (Pass and Fail) ?
5) The numbers on the vertical axis in Figure 3 do not need decimals.
Author Response
"Please see the attachment."
Author Response File: Author Response.docx
