Эх сурвалжийг харах

(feat): Prompt engineering to remind o1 to generate a patch (#4807)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
Co-authored-by: mamoodi <mamoodiha@gmail.com>
Co-authored-by: tofarr <tofarr@gmail.com>
Co-authored-by: Robert Brennan <contact@rbren.io>
Alejandro Cuadron Lafuente 1 жил өмнө
parent
commit
a6810fa6ad

+ 8 - 0
evaluation/swe_bench/run_infer.py

@@ -91,6 +91,14 @@ def get_instruction(instance: pd.Series, metadata: EvalMetadata):
             "Your thinking should be thorough and so it's fine if it's very long.\n"
         )
 
+    instruction += (
+        '<IMPORTANT>\n'
+        '- You MUST generate only one action per turn!\n'
+        '- A patch is a set of changes to the source code of the codebase that you are given\n'
+        '- You MUST generate a patch that attempts to fix the issue described in the <pr_description>\n'
+        '</IMPORTANT>\n'
+    )
+
     if RUN_WITH_BROWSING:
         instruction += (
             '<IMPORTANT!>\n'