Skip to main content
POST
/
v1
/
platform
/
evaluators
Error
A valid request URL is required to generate request examples
{
  "evaluator": {
    "code_evaluator": {
      "code": "<string>",
      "evaluator_id": "<string>",
      "language": "<string>"
    },
    "created_at": "<string>",
    "created_by": "<string>",
    "feedback_keys": [
      "<string>"
    ],
    "id": "<string>",
    "llm_evaluator": {
      "annotation_queue_id": "<string>",
      "commit_hash_or_tag": "<string>",
      "corrections_dataset_id": "<string>",
      "evaluator_id": "<string>",
      "num_few_shot_examples": 123,
      "prompt_id": "<string>",
      "prompt_repo_handle": "<string>",
      "use_corrections_dataset": true,
      "variable_mapping": {}
    },
    "name": "<string>",
    "run_rules": [
      {
        "corrections_dataset_id": "<string>",
        "dataset_id": "<string>",
        "dataset_name": "<string>",
        "group_by": "<string>",
        "id": "<string>",
        "num_few_shot_examples": 123,
        "session_id": "<string>",
        "session_name": "<string>",
        "use_corrections_dataset": true
      }
    ],
    "spend_usd": 123,
    "tenant_id": "<string>",
    "trace_count": 123,
    "updated_at": "<string>"
  }
}

Authorizations

​
X-API-Key
string
header
required

Body

application/json
​
code_evaluator
object
​
llm_evaluator
object
​
name
string
​
type
enum<string>
Available options:
llm,
code

Response

Created

​
evaluator
object