Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adaptive learning: Update documentation to match new mastery calculation #8853

Merged
Show file tree
Hide file tree
Changes from 5 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 10 additions & 2 deletions docs/user/adaptive-learning/adaptive-learning-instructor.rst
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,14 @@ By completing lectures and exercises, students gain mastery of a competency (see

A prerequisite is a competency that students are expected to have already mastered before the course. Instructors select competencies from previous courses they taught as a prerequisite, or create new ones.

Competencies measure two metrics for each student:
The progress starts at 0% and increases for every completed lecture unit and with the achieved score in exercises linked to the competency. The growth is linear, i.e. completing half of the lecture units and scoring 50% in all linked exercises results in 50% progress.
JohannesStoehr marked this conversation as resolved.
Show resolved Hide resolved
JohannesStoehr marked this conversation as resolved.
Show resolved Hide resolved
The mastery is a weighted metric and is influenced by the following heuristics:
- The mastery increases when the latest scores of the student are higher than the average score of all linked exercises and vice versa.
- The mastery increases when the student proportionally achieved more points in exercises marked as hard compared to the distribution of points in the competency and vice versa.
- A similar measurement applies to easy exercises, where the mastery is decreased for achieving proportionally more points in easy exercises.
- If the student quickly solves programming exercises with a score of at least 80% based on the amount of pushes, the mastery increases. There is no decrease in mastery for slower students!
JohannesStoehr marked this conversation as resolved.
Show resolved Hide resolved

Manage Competencies
^^^^^^^^^^^^^^^^^^^^
Instructors can manage competencies and prerequisites of a course in the *Competency Management* view. Here they can:
Expand All @@ -40,8 +48,8 @@ Create/Edit Competencies

| An instructor can create or edit competencies using the following form.
Besides a title and description, they can set a `taxonomy <https://en.wikipedia.org/wiki/Bloom%27s_taxonomy>`_.
| The mastery threshold describes the minimum average score required for a student to reach 100% confidence in this competency.
The current average score of all linked exercises shown on this page can be used as a basis for defining a reasonable threshold value.
| The mastery threshold describes the minimum mastery required for a student to consider the competency as mastered.
The current average mastery shown on this page can be used as a basis for defining a reasonable threshold value.
JohannesStoehr marked this conversation as resolved.
Show resolved Hide resolved
| Instructors can link competencies to lecture units on this page by first choosing a lecture and then selecting desired lecture units.

|instructor-competency-edit|
Expand Down
14 changes: 9 additions & 5 deletions docs/user/adaptive-learning/adaptive-learning-student.rst
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,10 @@ Competencies
------------
Competencies allow students to understand the learning goals of the course and measure their progress toward achieving them.

In Artemis, a competency is considered mastered by a student when they complete all linked learning objects (progress equals 100%) and have an adequate confidence level (average score greater or equal to the mastery threshold set by the instructor).
Artemis measures two metrics for each competency: **progress** and **mastery**.
The progress starts at 0% and increases with every completed lecture unit and score achieved in exercises linked to the competency.
The mastery is a weighted metric of the student's progress. It can be influenced by different factors, e.g. if the latest exercise scores are higher or lower than the student's average score in the competency.
In Artemis, a competency is considered mastered by a student when the mastery is greater than or equal to the threshold set by the instructor.

In case competencies are defined, students can get an overview of their individual progress and confidence on the competencies tab.
The page lists all competencies with their title, description, and `taxonomy <https://en.wikipedia.org/wiki/Bloom%27s_taxonomy>`_.
Expand All @@ -21,10 +24,11 @@ Expanding the prerequisites section shows the student all competencies the instr
|students-learning-goals-statistics|

When clicking on a competency, a page opens and displays detailed statistics about the competency together with all linked lecture units and exercises.
The tripartite rings show the student's advancement:
The **blue ring describes the progress**, the percentage of completed lecture units and exercises.
The **green ring visualizes the confidence**, the average score in all linked exercises in relation to the threshold required for mastering the competency (set by the instructor).
The **red ring is a weighted metric of the student's progress and confidence**, which shows the overall advancement toward competency mastery.
The bipartite rings show the student's advancement:
JohannesStoehr marked this conversation as resolved.
Show resolved Hide resolved
The **green ring describes the progress**, the percentage of completed lecture units and achieved scores exercises.
The **red ring indicates the mastery**, which shows the overall advancement toward competency completion.

If the mastery diverges from the progress, the student can see the main reason for this divergence as a tooltip next to the mastery value.

|students-learning-goals-statistics-detail|

Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.