|
@@ -164,3 +164,19 @@ You can start the evaluation by running:
|
|
|
./run_infer.sh eval_gpt_4o_2024_05_13
|
|
./run_infer.sh eval_gpt_4o_2024_05_13
|
|
|
```
|
|
```
|
|
|
Where `eval_gpt_4o_2024_05_13` is the model config you defined on the config.toml.
|
|
Where `eval_gpt_4o_2024_05_13` is the model config you defined on the config.toml.
|
|
|
|
|
+Like this:
|
|
|
|
|
+
|
|
|
|
|
+```toml
|
|
|
|
|
+[core]
|
|
|
|
|
+...
|
|
|
|
|
+
|
|
|
|
|
+[llm]
|
|
|
|
|
+model="gpt-4-32k"
|
|
|
|
|
+...
|
|
|
|
|
+
|
|
|
|
|
+[eval_gpt_4o_2024_05_13]
|
|
|
|
|
+model="gpt-4o-2024-05-13"
|
|
|
|
|
+api_key="sk-xxx"
|
|
|
|
|
+```
|
|
|
|
|
+
|
|
|
|
|
+If `[eval_gpt_4o_2024_05_13]` is not present, it will default to using the model configured in `[llm]`.
|