Using Reporting Tools
Moodle - Re:View - Zoom - Teams
When staff and students work in Moodle the technology logs their interactions. This information is then made available in various report functions:
- for staff so that they can understand student behaviour and analyse how students are working with the online content
- for students so that they can keep track of their progress
The following information identifies some of the most useful reports and their potential uses, but please be clear that the information does not provide evidence that learning has taken place. Rather, it gives you an indication that tasks are being attempted, or completed, that readings are being viewed or that forum posts are being made. You can see which types of activity are visited regularly and which are not so popular. With this information you can start to get a picture of how your students are interacting with the content, you and their peers.
The Participants list can be filtered in a number of ways:
- by enrolment method (e.g. SAMIS enrolled, Course meta link enrolled, self-enrolled etc.)
- by role (e.g. student, non-editing teacher etc.)
- by group (if you have set up groups)
- by 'inactivity' (i.e. have not accessed the Moodle course) over a number of days, weeks or months.
To filter participants and download the results
- Select the relevant Moodle course, and then choose Participants from the menu on the left of the page.
- From the drop-down menus (by clicking the down arrows) select the filter options you need. You can have multiple selections (e.g. filter by SAMIS enrolment, for those in the role of Student, who have been inactive for over a week).
- Click Apply filters. The resulting list will give you a number of participants who match the criteria chosen.
- If you wish to download this list scroll down past the table of results and click the green button to select all the participants (in the filtered list) and use the 'With selected users' drop-down menu to select a format (e.g. PDF, CSV etc.) for the downloaded file. The list will contain the names and email addresses only.
Note: You can also access this 'report' via the Action menu (cog), selecting More. Then select the Users tab and click on Enrolled users.
You can access Moodle Reports by clicking:
- Action menu (cog icon)
- Your chosen report/log (under the Course administration tab)
Here we'll concentrate on Logs, Activity Completion and the Activity report.
The logs in Moodle create an audit trail for activity undertaken by staff or students.
The logs can be viewed at course level, and can be filtered:
- by all participants or a specific named individual
- by all days or a specific date
- by all activities or a specific activity (e.g. an assignment, forum or resource)
- by all actions or a specific action (e.g. whether a resource has been viewed or deleted, or whether an assignment has been submitted)
- by all events or a specific event (e.g. teaching or participating)
When the results are obtained they appear on screen (in multiple pages). You are able to download the results, exported as an Excel or CSV file, where you can access more filtering options.
You can find the Logs by clicking the Actions menu (cog icon to the top right of the Moodle page). Select More and then under the Course administration tab you can click on Logs from the Reports area. Once you have chosen the appropriate filtering options click Get these logs.
The logs can also be viewed from within individual activities, and provides the activity filter for you.
You can find a specific activity log by clicking into the activity (e.g. an Assignment or Forum). From the Action menu (cog icon) on the right select Logs from the drop-down menu. You can still use the other filtering options before clicking Get these logs.
These logs are a subset of the full data, showing the most recent activity (i.e. the last hour). These are only viewable on screen (i.e. no downloads) and there are no filtering options.
Activity completion allows students to track their progress through the activities on a Moodle page. Students can see a checklist of what they have done so far. Using the activity completion report, staff can review student progress.
Enabling completion tracking
Completion tracking is normally enabled by default for most Moodle pages. If you need to enable completion tracking on your Moodle page
- Go to the Action menu (cog icon)
- Choose edit settings
- Scroll down to Completion tracking, and set enable completion tracking to Yes
- Save and display
Activity completion settings
Once completion tracking is enabled on your Moodle page, you can set the completion criteria for each activity in the settings.
When you create new activities or resources they will have activity completion tracking set by default (for students to manually indicate completion). You can disable this for individual resources where activity completion tracking is not suitable (e.g. a general Q&A forum which students will refer back to many times). You can set the default activity completion for different types of resources (e.g. for labels, set Activity completion to None by default).
You can set the activity completion conditions so that students manually indicate completion (by ticking a box), or so that the completion box is automatically ticked once conditions are met. The conditions for activity completion depend on the type of activity e.g. for an assignment, you can choose whether students must submit or receive a grade, for forums, choose whether students must post or reply to a number of discussions.
For pre-existing activities or resources, you will need to edit the settings to set the activity completion criteria. You can edit the activity completion settings in bulk. This works best if you select similar activity types (e.g. select all pages, all assignments, or all forums) and then apply the activity completion conditions. To do this
- Go to the Action menu (cog icon)
- Select Course completion
- Choose the Bulk edit activity completion tab
- Use the checkboxes to select activities, then choose Edit
- Apply the activity completion conditions (manual or automatic criteria)
- Choose Save changes
- Repeat for different activity types
Note you can also set the default activity completion conditions for different types of activity by going to Course completion then Default activity completion. This allows you to define the criteria for any newly created activities of the chosen type (e.g. set assignments to have an automated activity completion criteria of Student submits assignment by default).
Activity completion can be linked to Restrict access to set criteria upon which a student is allowed to progress through a course and access materials. This can be a useful way to provide structure and scaffold the learning experience, but consider carefully when to use this, to balance structure and guidance with self-paced learning.
Activity completion report
When you have completion tracking enabled and you have set activity completion criteria, you can view the Activity Completion report by clicking:
- Action menu (cog icon)
- Choose activity completion report (under the Course administration tab)
The report shows student progress through the learning activities. Some students may choose not to manually mark activities as complete. When designing your Moodle page, consider whether there are key activities which can act as 'checking in points', where you could use automated completion conditions to give you a comprehensive picture of student progress at key stages (e.g. introductions forum, formative assignment submission).
You can download the activity completion report in .csv format. The spreadsheet includes timestamps for activity completion.
A course activity report shows the number of views for each activity and resource. An activity report is calculated from the course's start date, which is taken from the course settings. This can be a quick way to identify which resources or activities are popular (or not).
You can find the Activity report by
- Clicking the Actions menu (cog icon to the top right of the Moodle page).
- Select More and then under the Course administration tab you can click on Activity report.
Taking this reporting further, Moodle version 3.9 (new in August 2021) now incorporates Learning Analytics. It automatically analyses data (based on specific models that have been enabled on the site) to identify patterns of behaviour (known as ‘Insights’) which help course owners to track engagement, easily monitor and contact students who may not have accessed recently/at all.
“Insights may be predictions about future performance or may detect current, hidden aspects or processes of learning. They may apply to students, courses, cohorts, or any other entity in Moodle.” (Moodle.org)
In the first instance, two models will be enabled:
- Students who have never accessed the course
- Students who haven’t accessed the course in the last month
Course owners can access the ‘Insights’ reports at any time, but Moodle will also send teachers automatic notifications when new insights are identified (via email or through the Moodle messaging tool depending on your preference settings).
Accessing the Insights reports
- Go to the Action menu (cog icon).
- Select More.
- The Insights report will be listed in the Reports section IF there is anything to report, otherwise it will not be present.
The other software tools we use for teaching and learning can also provide some usage data that can be useful.
Folders and videos come with a stats icon in Re:View, where you can access data and download reports. Statistics such as viewer engagement and view by day will give you insights about how your students are using the recordings.
It might be that students are viewing more often during revision periods or that they are watching a particular part more often because they find it difficult. You can see which students on your course have viewed videos and this data is also available to download.
In Zoom the reporting relates to attendance and poll results.
For attendance data only the Meeting organiser can access the data from Zoom Cloud, whereas in Moodle anyone in the Teacher role can access a Session link to see those who participated. Note that you may see duplicates if a participant left the meeting at any time and then subsequently rejoined.
If you record your Zoom meeting, the recording will be uploaded to Re:View (Panopto), where you will also be able to view statistics.
During Teams meetings it's possible to access an attendance list.
When working in a Teams team, you can access a page of statistics summarising activity within the team. Enter your Team and from the ellipsis menu (More options) select Manage Team and then select the Analytics tab.