Diagnostic Tool Content Management System (CMS)

Guidance on using the CMS to build a confidence-based self-assessment diagnostic tool to allow students to align their levels of confidence around the skills, needs, preferences and competencies that they will require on their course (and/or placement or future employment) and to (self) determine a plan of action to develop these skills and competencies along-side their studies.

To access the Diagnostic Tool CMS use your University of Bath single sign-on username and password to log in.

University of Bath Single Sign-on
University of Bath Single Sign-on

CMS Roles

Guidance about the roles within the CMS  

On accessing the CMS you will automatically be enrolled in the Viewer Role. 

Diagnostic Tool Content Management System
Diagnostic Tool Content Management System

This role allows you to view all current Categories and associated Questions.

Diagnostic CMS Viewer Role Categories Table
Viewer Role Categories Table
Diagnostic CMS Viewer Role Questions Table
Viewer Role Questions Table

When you are ready to start to create questions use the Upgrade button to move to the Creator Role.

This role means that you can now – Create, Edit and Delete your own Questions and Categories. 

Diagnostic CMS Creator Role Add a new category
Creator Role Add a new category

Where a Category has a question(s) created by another user or where the Category is used in a Diagnostic, the category will be locked (from editing or deletion).

If the Category isn’t locked and was created by you then you will be able to Edit and Delete the Category.

Diagnostic CMS Creator Role Add a new question
Creator Role Add a new question
Creating Questions

In creating good questions for your diagnostic here are some guiding rules:

  1. Ensure your questions are clear and unambiguous
  2. Ensure your questions relate to a single skill / attribute / competency
  3. Your students should be able to answer your questions instinctively
  4. Your students (and you) should learn something from their responses
  5. Every question should be directly related to the resources provided in your diagnostic 

Where a Question has been created by another user or where the Question is used in a Diagnostic, the Question will be locked (from editing or deletion).

If the Question isn’t locked and was created by you then you will be able to Edit and Delete the Question.

You are also able to Copy an existing question and put this into a new category.

Diagnostic CMS Creator Role Copy question
Creator Role Copy question

When you are ready to start to create your diagnostic use the Upgrade button to move to the Space Admin Role.

This role means that you can now – Create your own Diagnostic Tool.

Diagnostic CMS Space Admin Role Add a new diagnostic
Space Admin Role Add a new diagnostic

To start creating your diagnostic first select the Add a new diagnostic.

Diagnostic CMS Add a new Diagnostic
Add a new Diagnostic

You will then be directed to the Add a new Diagnostic homepage, This contains 4 fields which you will need to complete. If you are unsure about where these fields appear on the diagnostic, or are simply looking for suggested text, then open the Diagnostic Demo to see the fields/text. 

Diagnostic CMS Add a new Diagnostic homepage
Add a new Diagnostic homepage

1. The first requirement is the diagnostic name. 

Diagnostic CMS Add a new Diagnostic name
Add a new Diagnostic Name

2i. You will then need to add the homepage text. This should be used to explain the purpose of the diagnostic (what you expect the student (user) to do and what they will get from doing so).

Diagnostic CMS Add a new Diagnostic homepage text
Add a new Diagnostic Homepage Text

2ii. You will need to upload an image for your homepage. You can create your own WordCloud free online.

Diagnostic CMS Add a new Diagnostic Homepage Image
Add a new Diagnostic Homepage Image

3. You will need to then add the Contact Details. This is used by a student (user) with queries with or issues about the diagnostic. You should put your details here, as the diagnostic ‘owner’. 

Diagnostic CMS Add a new Diagnostic Contact Details
Add a new Diagnostic Contact Details

4. You will need to a 2 final pieces of text. The first, the Next Steps Introduction Text, is the advice text for the student (user) about selecting their Areas for Development. The second, the Next Steps Final Text, is the instructions for the student (user) on what to do next.

Diagnostic CMS Add a new Diagnostic Next Steps text
Add a new Diagnostic Next Steps Text

Once all these fields have been completed you should then save this content. You can elect to either save and return to the CMS Dashboard or save and continue to build your diagnostic.

Diagnostic CMS Add a new Diagnostic Save
Add a new Diagnostic Next Steps Save

The next part of creating your diagnostic is to complete the questions, recommendations and resources page. On this page you will need to select the categories you want to include, the associated questions and complete recommendations text and resources for 3 levels of confidence – high, reasonable and low.

Diagnostic CMS Add a new Diagnostic Questions, Recommendations and Resources
Add a new Diagnostic Questions, Recommendations and Resources

Firstly you should select each category you wish to include, and select the 8 associated questions, using the checkboxes.

Diagnostic CMS Add a new Diagnostic Category and Question selection
Add a new Diagnostic Category and Question selection

For each Category selected you will need to complete the recommendation text and add resource text, and URLs (where applicable) for each of the 3 levels of confidence – high, reasonable and low. 

Diagnostic CMS Add a new Diagnostic Category Recommendations and Resources
Add a new Diagnostic Category Recommendations and Resources

Once all these fields have been completed you should then save this content. 

Diagnostic CMS Add a new Diagnostic Questions, Recommendations and Resources Save
Add a new Diagnostic Questions, Recommendations and Resources Save

Your diagnostic is now saved. Once a diagnostic is built the default setting is Unpublish(ed). This means that it has not been published (not live).

Diagnostic CMS Unpublish
Unpublished status

You will now see that your diagnostic appears in your Space marked as Disabled.

Diagnostic CMS Spaces Disabled
Diagnostic Disabled

When you are ready to test your diagnostic you will need to return to the Questions, Recommendations and Resources page and change the Status of your diagnostic to Publish 

Diagnostic CMS Publish
Publish

You will now see that your diagnostic appears in your Space marked as Live.

Diagnostic CMS Diagnostic Live
Diagnostic Live

You can now use the URL generated to share your diagnostic. The first thing you should do is check everything appears as intended, then share your diagnostic with colleagues and students for feedback.

Testing your diagnostic

Guidance on testing your diagnostic

Once you’ve created your diagnostic and made it live the next thing to do is to test it. Testing should be undertaken for a number of reasons including:

  • proofing text
  • checking all resource URL links
  • getting colleague and student input on question selection and resources provided

As part of the testing you can use the user data to also check the response data. You can access the response data from the Spaces section of the Diagnostic CMS by selecting the data icon Diagnostic CMS Spaces Response Data Icon.

Diagnostic CMS Spaces Response Data
Spaces Response Data

And download the responses. These are provided in a Comma Separate Values (CSV) file (Excel).

Duiagnostic CMS Response CSV Download
Response CSV Download

The downloaded file provides all student (user) response data. This data is separated by Category, providing the student ID, each question and the student response (1=High, 2 = Reasonable, 3=Don’t Know or No Experience & 4=Low) and resources selected (Checked) and not selected (Unchecked).

Diagnostic Downloaded Responses
Downloaded Responses

Once testing is completed you:

  • may need to edit your diagnostic
  • be ready to deploy your diagnostic to students (users)

Either way you will need to Unpublish your diagnostic.

Diagnostic CMS Unpublish/Purge Responses
Unpublish (and Purge Responses)

By selecting Unpublish this will generate an email requesting your diagnostic be disabled. As part of this process all response data will be purged (deleted).

If you make edits to your diagnostic then it is recommended that you to go through the testing process again.

Once testing has been completed, and all response data has been purged, your diagnostic is ready to be be deployed.

Deploying your diagnostic

How to give your students (users) access to your diagnostic

To deploy your course you simply need to make it Live.

Once Live you can use the URL for your course found in Spaces.

Diagnostic CMS URL
Diagnostic URL

This can be embedded in a Moodle Course, on a Xerte LO, shared by email or via Social Media on embedded using a QR Code for poster, brochures or handouts. 

Diagnostic response data

Analysing the student (user) data

From the point of launch you are able to view the student (user) response data. This data:

  • includes number of users
  • can be used to identify Categories / Questions where the highest percentage of students identify as having High Confidence and Low Confidence, which in turn can be used to inform support provision
  • question Mean, Std. Deviation and Median
  • can be used to track confidence levels against Area of Development (planning)
  • can be used in a test retest to measure individual and group changes in confidence reported