Module umm::grade

For all things related to grading

Structs

• ByHiddenTestGrader
  Grades using hidden tests. Test file is downloaded, ran, and then cleaned up before returning.
• ByUnitTestGrader
  Grades by running tests, and reports how many tests pass. Final grade is the same percentage of maximum grade as the number of tests passing.
• DiffGrader
  string. Any difference results in a 0 grade. A grader that grades by diffing an expected string with an actual
• DocsGrader
  A struct representing arguments to grade_docs function
• Grade
  A struct representing a grade
• GradeResult
  A struct to store grading results and display them
• GradescopeLeaderboardEntry
  Represents an entry in the leaderboard.
• GradescopeLeaderboardEntryBuilder
  Builder for GradescopeLeaderboardEntry instances.
• GradescopeSubmission
  Represents the overall submission data.
• GradescopeSubmissionBuilder
  Builder for GradescopeSubmission instances.
• GradescopeTestCase
  Represents an individual test case.
• GradescopeTestCaseBuilder
  Builder for GradescopeTestCase instances.
• JavacDiagnostic
  A struct representing a javac diagnostic message
• JavacDiagnosticBuilder
  Builder for JavacDiagnostic instances.
• LineRef
  A struct representing a line in a stack trace
• MutationDiagnostic
  A struct representing a PIT diagnostic message
• MutationDiagnosticBuilder
  Builder for MutationDiagnostic instances.
• PromptRow
  Schema for prompts table
• Query
  A struct to represent a treesitter query.
• QueryGrader
  A struct to represent a query grader.
• RetrievalFunctionCallParams 🔒
  RetrievalFunctionCallParams is a struct that holds the parameters for a retrieval function call.
• RetrievalFunctionCallParamsArray 🔒
  RetrievalFunctionCallParamsArray is a struct that holds an array of RetrievalFunctionCallParams.
• UnitTestGrader
  Runs mutation tests using Pitest to grade unit tests written by students.

Enums

• GradescopeOutputFormat
  Represents output format settings for Gradescope submissions.
• GradescopeStatus
  Represents the status of a test case in Gradescope submissions.
• GradescopeVisibility
  Represents visibility settings for Gradescope submissions and test cases.
• QueryConstraint
  An enum to represent the constraint of a query.
• QueryError
  An enum to represent possible errors when running a query.
• SLOFileType 🔒
  What kind of file the SLO is for.

Functions

• generate_feedback
  Generates a FEEDBACK file after prompting ChatGPT for feedback on an array of results.
• generate_feedback_script
  Macro generated variant of #fn_name that returns EvalAltResult. This allows the function to be used in scripts.
• generate_single_feedback 🔒
  Generates feedback for a single GradeResult and posts it to the database.
• generate_single_feedback_script
  Macro generated variant of #fn_name that returns EvalAltResult. This allows the function to be used in scripts.
• get_active_retrieval_context
  Retrieves the active context for a retrieval operation.
• get_source_context
  Returns a ChatCompletionRequestMessage with the given line references that include contextual lines of code from the source
• show_result
  Print grade result
• show_result_script
  Macro generated variant of #fn_name that returns EvalAltResult. This allows the function to be used in scripts.