Bläddra i källkod

Evaluation: Fix bug on python path on run.sh (#98)

* Move regression tests to evaluation/

* use pythnon instead of docker in the script

* add model para

* change python to python3

* bug fix

* add python path

* add readme
zch-cc 2 år sedan
förälder
incheckning
e5a28cba2f
2 ändrade filer med 16 tillägg och 0 borttagningar
  1. 11 0
      evaluation/regression/README.md
  2. 5 0
      evaluation/regression/run.sh

+ 11 - 0
evaluation/regression/README.md

@@ -16,3 +16,14 @@ echo "write a hello world script" >> ./agent/regression/cases/$name/task.txt
 # Single out your test case using the TEST_CASE environment variable
 TEST_CASE=$name ./agent/regression/run.sh
 ```
+
+To add agent to regreesion test:
+```bash
+add agent pair to directory_class_pairs variable in run.sh 
+key is the directory name in /agenthub and value is the class name 
+```
+
+To run regresion test:
+```bash
+./run.sh and enter DEBUG, OPENAI_API_KEY and Model name in the prompt.
+``` 

+ 5 - 0
evaluation/regression/run.sh

@@ -29,6 +29,11 @@ else
     MODEL="$model"
 fi
 
+echo "Running with model: $MODEL" 
+
+# add python path
+export PYTHONPATH="$PYTHONPATH:$SCRIPT_DIR/../../" 
+
 # hardcode pairs for directory to python class mapping 
 declare -A directory_class_pairs=(
     [langchains_agent]="LangchainsAgent"