Using the NTS 2020 reporting tool

Using the tool

The reporting tool allows you to explore aggregated survey response data for doctors in training and trainers. Questions have been split by theme and numbered to match the version of the questionnaire available on our website.

Please note:

  • Reporting is based on trusts rather than sites due to the lower than usual response rate and also to report responses in a consistent and meaningful way where doctors have been redeployed to different sites across their trust.
  • Not all trusts/boards and specialty combinations have the required minimum number of responses.
  • This year’s reports are based on individual questions instead of scored question groupings (indicators).
  • To protect the identity of respondents we have excluded data for questions with less than three responses.

Report types and filters

You can change the data view using the filters the top of your screen. As you select an option from a drop-down list you will see the values change in the table or chart underneath.

  • Report Type tab: allows you to breakdown the survey response data by different report types, for example by programme specialty. Below are a few examples on how to operate these filters.
    • To view the results for England: select 'Country' using the Report type filter and 'England' under the adjacent Selection filter.
    • To view the results for a programme specialty at a trust/board select 'Trust/board and Programme' using the Report type filter and select the trust under the adjacent Selection and the specialty under the 'Specialty' filter.
  • Question Theme: select a theme from the survey to view the corresponding questions and response data.
  • Select question: view a single question or all questions within the selected theme.
  • Display Option: view survey data as a graph or a table. The data in both chart and table view is the same.

Display options

Question response graph view

Chart view shows aggregated responses to survey questions as a bar chart.

The orange marker represents the benchmark group. If you hover your cursor over a bar a box will appear giving more information, including the percentage value.

Question response table view

You can also view response data in a table format. This shows the scores for your selected report type alongside the benchmark figure.

Click on the table to highlight any row or column. You can scroll up and down the table in the same way as in the bar chart view.

Question score graph view

In this view we show responses aggregated as scores. Responses are scored from 0 -100, with the most positive repose option scored as 100. The score displayed is the average of all responses within the reporting unit. We also display a benchmark score (orange line) which represents the average score for all respondents. If a score is significantly above the benchmark score it is displayed in red, scores significantly below the benchmark are displayed in red.

Question score table view

You can also view scores in a table format. This shows the number and percentage of responses for your selected report type alongside the benchmark figure.

Click on the table to highlight any row or column. You can scroll up and down the table in the same way as in the bar chart view.

What are benchmarks?

Results are calculated by comparing a report group to a benchmark group. Doctors' scores contribute to the score for the report groups they are in (specialty, trust, training level, etc). The scores are also used to calculate the benchmark score.

The benchmark group is the group of respondents whose scores you are comparing your report group to. For most reports the benchmark is the overall survey population. Specialty-specific reports are benchmarks against the wider specialty group.

For example, you can look at a post specialty by trust/board report to see how General psychiatry at your trust compares to General psychiatry at national level. In this example the benchmark group would be all psychiatry.

The vertical lines represent confidence intervals which visualise how similar or different the answers for each question are. The shorter the line, the more similar the answer are. Scores are displayed as statistically significant outliers if the confidence interval does not overlap with the benchmark mean score.

Additional functionality

The reporting tool has additional features in the ribbon at the top of the screen, which can be useful.

If you have made changes to the data view, such as excluding a question, you can Undo and Redo the last action, or Refresh the tool completely using the button to the ribbon left.

To the right of the ribbon, the 'Share', 'Download' and 'Full Screen' buttons are functional. 'Share' allows you to copy and share a hyperlink to the tool, 'Download' prepares a downloadable version of your selected data in a format of your choice and 'Full Screen' expands the tool to fill your screen.

To download a report, you must click the results table then select download from the ribbon. The download options are as follows:

  • Image - Downloads the worksheet view as an image,
  • Data - Creates a page with the data table (This is further downloadable in Excel format),
  • Crosstab - Downloads the data in Excel format,
  • PDF and PowerPoint – Export the view of the current page and the entire table in its current formatting. To do this, select under Include 'Specific sheets from this dashboard'  Then click Select All. To initiate the export click Download.