Abhijeetsingh Meena 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año
..
README.md 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año
__init__.py 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año
eval_w_subhypo_gen.py 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año
lm_utils.py 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año
openai_helpers.py 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año
openai_semantic_gen_prompts.py 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año
response_parser.py 8857f02083 [Eval] DiscoveryBench OpenHands Integration (#4627) hace 1 año

README.md

DiscoveryBench Evaluation Utils

  • eval_w_subhypo_gen.py: Implements the DiscoveryBench logic for evaluating agent-generated hypotheses.
  • lm_utils.py: Provides utility functions necessary for the evaluation process.
  • openai_helpers.py: Includes helper functions for OpenAI-related tasks.
  • openai_semantic_gen_prompts.py: Contains prompts used for semantic generation.
  • response_parser.py: Handles the parsing of agent-generated hypotheses.