Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow custom evaluation data in Playground #309

Merged
merged 67 commits into from
Jul 29, 2024
Merged

Allow custom evaluation data in Playground #309

merged 67 commits into from
Jul 29, 2024

Conversation

FelixTJDietrich
Copy link
Collaborator

@FelixTJDietrich FelixTJDietrich commented Jul 5, 2024 •
edited
Loading

Motivation and Context

#308 instructors or others might want to upload their own data for experimentation

Description

We had two datasets "example" and "evaluation". Those are unchanged.
Additionally we now have "evaluation-" for custom datasets located in "data/evaluation/"

  • Added text field to set custom dataset in "Evaluation Data"
  • If set, you can do the following options
    • Import: Import one or more exercise.json files or zips, i.e. evaluation.zip
    • Export: Downloads the data of the named dataset
    • Delete: Deletes the named dataset

Warning

Note that the data is not yet password protected/encrypted

Steps for Testing

  1. Use the playground
  2. Choose "Evaluation Data"
  3. Set a name, e.g. "felix"
  4. Import some sample evaluation data for programming exercises and non-programming exercises
  5. Verify that the data is in the data/evaluation/<name> directory
  6. Export the data and check if it looks correct
  7. Test if you can use the data with the module requests and it looks correctly
  8. Delete the data again

Screenshots

image

image

image

dependabot bot and others added 30 commits May 10, 2024 01:55
@dependabot
Bump next from 13.5.6 to 14.1.1 in /playground
505dd2e 
Bumps [next](https://github.com/vercel/next.js) from 13.5.6 to 14.1.1.
- [Release notes](https://github.com/vercel/next.js/releases)
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js)
- [Commits](vercel/next.js@v13.5.6...v14.1.1)

---
updated-dependencies:
- dependency-name: next
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@maximiliansoelch
Merge branch 'develop' into dependabot/npm_and_yarn/playground/next-1…
80cc39a 
…4.1.1
@dmytropolityka
use unique keys across artemis instances
7769e87
@dmytropolityka
set values from .env and .ini
88e5ba7
@dmytropolityka
change authorization process
cfc9f1f
@dmytropolityka
extend database to store artemis url
a376fcb
@dmytropolityka
fix bugs
d356749
@dmytropolityka
Merge branch 'develop' into feature/decouple-artemis-from-athena
1757ea8
@dmytropolityka
fix linting issues
7df5183
@dmytropolityka
add further deployments
6f837a1
@dmytropolityka
remove dotenv
749aeae
@dmytropolityka
remove dotenv and unused code
cf8bd83
@dmytropolityka
adjust deployment units
9348bf3
@dmytropolityka
make deployments not compulsory
f014359
@dmytropolityka
bugs
76df5d9
@dmytropolityka
more logging
bc293fa
@dmytropolityka
more logging
61dfd0a
@dmytropolityka
fix bug
92b5424
@dmytropolityka
rename unique constraint
2db5fa9
@dmytropolityka
Update __main__.py
c95634f
@maximiliansoelch
Merge branch 'develop' into dependabot/npm_and_yarn/playground/next-1…
646d51e 
…4.1.1
@dependabot
Bump mysql2 from 3.9.7 to 3.9.8 in /playground
1f552cc 
Bumps [mysql2](https://github.com/sidorares/node-mysql2) from 3.9.7 to 3.9.8.
- [Release notes](https://github.com/sidorares/node-mysql2/releases)
- [Changelog](https://github.com/sidorares/node-mysql2/blob/master/Changelog.md)
- [Commits](sidorares/node-mysql2@v3.9.7...v3.9.8)

---
updated-dependencies:
- dependency-name: mysql2
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
@dmytropolityka
rename artemis_url to lms_url
af34b89
@dmytropolityka
Merge remote-tracking branch 'origin/dependabot/npm_and_yarn/playgrou…
4ae0c27 
…nd/next-14.1.1' into feature/playground-self-learning-feedback
@dmytropolityka
make playground work for multi-instance setup; add non-graded feedbac…
e0be309 
…k suggestions
@dmytropolityka
Merge remote-tracking branch 'origin/dependabot/npm_and_yarn/playgrou…
8fb8fd1 
…nd/mysql2-3.9.8' into feature/playground-self-learning-feedback
@maximiliansoelch
Merge branch 'develop' into feature/decouple-artemis-from-athena
ea0696e
@dmytropolityka
rename artemis_url into lms_url, further occurrences
c74b112
@dmytropolityka
rename artemis into lms, further occurrences
0f45254
@dmytropolityka
Merge branch 'develop' into feature/decouple-artemis-from-athena
4324ea6
FelixTJDietrich and others added 3 commits July 26, 2024 13:56
@FelixTJDietrich @dmytropolityka
Update assessment_module_manager/modules.ini
1af0ed3 
Co-authored-by: Dmytro Polityka <33299157+undernagruzez@users.noreply.github.com>
@FelixTJDietrich @dmytropolityka
Update assessment_module_manager/modules.docker.ini
c18f263 
Co-authored-by: Dmytro Polityka <33299157+undernagruzez@users.noreply.github.com>
@FelixTJDietrich @dmytropolityka
Update playground/src/components/selectors/data_mode_select.tsx
61b3b9d 
Co-authored-by: Dmytro Polityka <33299157+undernagruzez@users.noreply.github.com>
@dmytropolityka dmytropolityka added the deploy:athena-test1 Athena Test Server 1 label Jul 26, 2024
@github-actions github-actions bot added deployment-error Added by deployment workflows if an error occured and removed deploy:athena-test1 Athena Test Server 1 labels Jul 26, 2024
@dmytropolityka dmytropolityka added deploy:athena-test1 Athena Test Server 1 and removed deployment-error Added by deployment workflows if an error occured labels Jul 26, 2024
@github-actions github-actions bot added deployment-error Added by deployment workflows if an error occured and removed deploy:athena-test1 Athena Test Server 1 labels Jul 26, 2024
@EneaGore EneaGore added deploy:athena-test1 Athena Test Server 1 and removed deployment-error Added by deployment workflows if an error occured labels Jul 26, 2024
@github-actions github-actions bot added lock:athena-test1 Is currently deployed to Athena Test Server 1 and removed deploy:athena-test1 Athena Test Server 1 labels Jul 26, 2024
@EneaGore EneaGore temporarily deployed to Athena Test Server 3 July 26, 2024 13:41 — with GitHub Actions Inactive
EneaGore
EneaGore approved these changes Jul 26, 2024
View reviewed changes
Copy link
Contributor

@EneaGore EneaGore left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tesed on the test server and all functionalities work.

@EneaGore EneaGore removed the lock:athena-test1 Is currently deployed to Athena Test Server 1 label Jul 26, 2024
@FelixTJDietrich FelixTJDietrich added the deploy:athena-test1 Athena Test Server 1 label Jul 29, 2024
@github-actions github-actions bot added lock:athena-test1 Is currently deployed to Athena Test Server 1 and removed deploy:athena-test1 Athena Test Server 1 labels Jul 29, 2024
@github-actions github-actions bot added the deployment-error Added by deployment workflows if an error occured label Jul 29, 2024
@FelixTJDietrich FelixTJDietrich removed the deployment-error Added by deployment workflows if an error occured label Jul 29, 2024
@ls1intum ls1intum deleted a comment from github-actions bot Jul 29, 2024
@ls1intum ls1intum deleted a comment from github-actions bot Jul 29, 2024
@maximiliansoelch maximiliansoelch merged commit dff8e69 into develop Jul 29, 2024
34 of 38 checks passed
@maximiliansoelch maximiliansoelch deleted the feature/import-evaluation-data branch July 29, 2024 10:47
This was referenced Sep 4, 2024
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@EneaGore EneaGore EneaGore approved these changes

@maximiliansoelch maximiliansoelch maximiliansoelch approved these changes

@dmytropolityka dmytropolityka dmytropolityka left review comments

Assignees

@FelixTJDietrich FelixTJDietrich

Labels
documentation Improvements or additions to documentation enhancement New feature or request javascript Pull requests that update Javascript code lock:athena-test1 Is currently deployed to Athena Test Server 1 playground Pull requests that update the playground
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@FelixTJDietrich @dmytropolityka @maximiliansoelch @EneaGore