From bddaf93fcf279fb8fc2cf0247245e21d887db39b Mon Sep 17 00:00:00 2001
From: Piotr Nawrot
Date: Mon, 3 Apr 2023 14:14:22 +0100
Subject: [PATCH] Typo in the FT command
---
README.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/README.md b/README.md
index 233661c..6e6140f 100644
--- a/README.md
+++ b/README.md
@@ -137,7 +137,7 @@ git clone https://github.com/allenai/natural-instructions.git data
We strictly follow the fine-tuning [config](nanoT5/configs/task/ft.yaml) of Tk-Instruct. It remains unclear whether Tk-Instruct was initialised from a regular checkpoint (*google/t5-v1_1-base*) or the one adapted explicitly for Language Modelling with continued training (*google/t5-base-lm-adapt*). Therefore, we decided to evaluate both. Run the following command to reproduce the Tk-Instruct experiments:
```
-python -m adaptive.moe task=ft \
+python -m nanoT5.main task=ft \
model.name={google/t5-v1_1-base,google/t5-base-lm-adapt} \
model.random_init={true,false} \
model.checkpoint_path={"","/path/to/pytorch_model.bin"}