When implementing custom judges for the evaluation of specific problems, the only option to update those judges seems to be to upload a newer version of the custom judge instead of replacing the previous version. As custom judges as shared between problems, this has a number of drawbacks:
- switching to the newer version of the custom judge needs to be done fore each problem that uses the judge
- results in a long drop down list of (deprecated) judges
As a somewhat related problem, each submitted judges receives a default name “Problem ‘problem_name’ judge”. It would be more enveloping if more generic custom judges could be properly named.
So a request for two additional features:
- possibility to assign self-explaining name to custom judges
- possibility to update custom judges 'in place'