update readme
Browse files
README.md
CHANGED
|
@@ -4,12 +4,14 @@ license: cc-by-4.0
|
|
| 4 |
|
| 5 |
# FiD model trained on NQ
|
| 6 |
|
| 7 |
-
-- This is the model checkpoint of FiD, based on T5 large (with 770M parameters) and trained on the NQ dataset.
|
| 8 |
|
| 9 |
-- Hyperparameters: 8 x 40GB A100 GPUs; batch size 8; AdamW; LR 3e-5; 50000 steps
|
| 10 |
|
| 11 |
References:
|
|
|
|
| 12 |
[1] Natural Questions: A Benchmark for Question Answering Research. TACL 2019.
|
|
|
|
| 13 |
[2] Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering. EACL 2021.
|
| 14 |
|
| 15 |
## Model performance
|
|
|
|
| 4 |
|
| 5 |
# FiD model trained on NQ
|
| 6 |
|
| 7 |
+
-- This is the model checkpoint of FiD [2], based on the T5 large (with 770M parameters) and trained on the natural question (NQ) dataset [1].
|
| 8 |
|
| 9 |
-- Hyperparameters: 8 x 40GB A100 GPUs; batch size 8; AdamW; LR 3e-5; 50000 steps
|
| 10 |
|
| 11 |
References:
|
| 12 |
+
|
| 13 |
[1] Natural Questions: A Benchmark for Question Answering Research. TACL 2019.
|
| 14 |
+
|
| 15 |
[2] Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering. EACL 2021.
|
| 16 |
|
| 17 |
## Model performance
|