Explorar o código

automatically get agent version for eval (#1844)

Xingyao Wang hai 1 ano
pai
achega
e31f8b8322
Modificáronse 1 ficheiros con 5 adicións e 1 borrados
  1. 5 1
      evaluation/swe_bench/scripts/run_infer.sh

+ 5 - 1
evaluation/swe_bench/scripts/run_infer.sh

@@ -1,9 +1,13 @@
 #!/bin/bash
 
 AGENT=CodeActAgent
-AGENT_VERSION=v1.3
+AGENT_VERSION=v$(python3 -c "from agenthub.codeact_agent import CodeActAgent; print(CodeActAgent.VERSION)")
 MODEL_CONFIG=$1
 
+echo "AGENT: $AGENT"
+echo "AGENT_VERSION: $AGENT_VERSION"
+echo "MODEL_CONFIG: $MODEL_CONFIG"
+
 # You should add $MODEL_CONFIG in your `config.toml`
 
 poetry run python3 evaluation/swe_bench/run_infer.py \