2025/coursework/cw2/code_question/README.md

@@ -2,56 +2,34 @@
 
 ### `main.py`
 
-This is the main script that sets up the entire process. It involves loading datasets, model initialisation, and evaluation.
-
+This is the main script that sets up the entire process, including loading datasets, model initialisation, and evaluation.
 
 To execute the main script, use the following command:
 
 ```bash
-cd MMLU_NLU
+cd code_question
 ```
 
 ```bash
-python main.py --dataset  mmlu-redux-college_mathematics  --method <method_name> --model <model_name> 
+python main.py --dataset  mmlu-redux-college_mathematics  --method comat --model gpt
 ```
 
-Available methods include:
-
-- non-cot: Baseline model
-- cot: Chain of Thought
-- comat: CoMAT
-
 ### `mmlu_redux.py`
 
-This file contains functions used to processing the MMLU-Redux datasets.
+This file contains functions for processing the MMLU-Redux dataset.
 
 - **`process_mmlu_redux_questions`**: Processes questions from the MMLU-Redux dataset and evaluates them.
 
-### `MMLU-Redux-College_Mathematics/`
-
-This directory contains CSV files that store output for MMLU-Redux-College_Mathematics (using GPT-4o model) dataset:
-
-- **`CoMAT_MMLU-Redux-College_Mathematics.csv`**: Stores the output for the MMLU-Redux-College-Mathematics dataset using the CoMAT method.
-- **`CoT_MMLU-Redux-College_Mathematics.csv`**: Stores the output for the MMLU-Redux-College-Mathematics dataset using the CoT method.
+This directory also contains prompt files associated with the College Mathematics dataset:
 
-### `MMLU-Redux-college_mathematics_prompts/`
+- **`MMLU-Redux-college_mathematics_prompts/comat.txt`**: Prompt file for the CoMAT method.
+- **`CoMAT_Instruction.py`**: Prompt file for the CoMAT method, used for evaluation in this assignment.
 
-This directory contains prompt files associated with the College Mathematics dataset:
-
-- **`comat.txt`**: Prompt file for the CoMAT method.
-- **`cot.txt`**: Prompt file for the CoT method.
-- **`non-cot.txt`**: Prompt file for the baseline method.
 
 ### `shapley_value_evaluation.py`
 
-This script evaluates the Shapley value, a concept from cooperative game theory. The Shapley value is used to fairly distribute the total gains among participants based on their individual contributions.
+This script evaluates the Shapley value, a concept from cooperative game theory. The Shapley value is used to fairly distribute total gains among participants based on their individual contributions.
 
 ### `utils.py`
 
-This file contains the functions for making predictions using different models and evaluating their outputs, the model includes : 
-
-- **`predict_gpt`**: Uses OpenAI's GPT model to generate a response based on the provided messages.
-
-- **`predict_gemini`**: Uses Google's Gemini model to generate a response based on the provided messages.
-
-- **`predict_qwen2`**: Uses the Qwen2 model to generate a response based on the provided question and options.
\ No newline at end of file
+This file contains functions for using gpt to make predictions with different models and evaluate their outputs.
\ No newline at end of file