Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide an API endpoint to validate custom grading scripts #82

Open
blerner opened this issue Aug 27, 2024 · 1 comment
Open

Provide an API endpoint to validate custom grading scripts #82

blerner opened this issue Aug 27, 2024 · 1 comment
Assignees

Comments

@blerner
Copy link
Collaborator

blerner commented Aug 27, 2024

Currently, all the grading script schemas are in the worker/ subdirectory as multiple JSON files. This is inconvenient. It would be better to

(a) consolidate these into a single file,
(b) either make this file available to orchestrator as a static path (e.g. orca.com.invalid/schemas/grading_job.json) so that customers could validate their grading scripts against it, or
(c) add an API to validate a grading job file against the schema (e.g. POST /api/v1/validate_grading_job with an apiKey and a grading script as its JSON payload parameters)

@blerner
Copy link
Collaborator Author

blerner commented Aug 30, 2024

Also important -- the existing .json schema files don't match what the .ts schema-enforcement files are doing. This should be consolidated and fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants