branch187-pi-temperature

内容来源:README.md(说明文档) · 原始地址 · 查看安装指南

原始内容

pi-temperature

Pi extension for setting LLM sampling parameters (temperature, top_p, top_k, min_p, frequency_penalty, presence_penalty, repetition_penalty).

Parameters can be defined in models.json:

{
  "providers": {
    "vllm": {
      "models": [
        { "id": "Mistral-Medium-3.5", "parameters": { "temperature": 1.0, "top_p": 0.9 } }
      ]
    }
  }
}

Use /params during a session to view, set, or unset parameters.