- Add evals/run-ollama-evals-logged.sh: self-logging eval script that runs without babysitting; writes timestamped log to evals/logs/; includes Ollama health check, model availability check (auto-pulls if missing), JSON smoke test, cache clear, full promptfoo run, pass-rate summary, and macOS notification on completion - Update package.json scripts: add eval, eval:ci, eval:task, eval:json, eval:ollama, eval:compare |
||
|---|---|---|
| .. | ||
| evals | ||
| python | ||
| src | ||
| .env.example | ||
| Dockerfile | ||
| package.json | ||
| supervisord.conf | ||
| tsconfig.json | ||