Hugging Face's logo

deepset
/
roberta-base-squad2-distilled

Question Answering
Transformers
PyTorch
Safetensors
English
roberta
exbert
Eval Results (legacy)
Model card Files
xet
Community
6
sjrhuschlee commited on
Commit
4d931e9
路
1 Parent(s): 3064374

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +105 -0
README.md CHANGED
@@ -28,6 +28,111 @@ model-index:
28
  name: F1
29
  verified: true
30
  verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTAyZDViNWYzNjA4OWQ5MzgyYmQ2ZDlhNWRhMTIzYTYxYzViMmI4NWE4ZGU5MzVhZTAwNTRlZmRlNWUwMjI0ZSIsInZlcnNpb24iOjF9.Er21BNgJ3jJXLuZtpubTYq9wCwO1i_VLQFwS5ET0e4eAYVVj0aOA40I5FvP5pZac3LjkCnVacxzsFWGCYVmnDA
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
  ---
32
 
33
  ## Overview
 
28
  name: F1
29
  verified: true
30
  verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTAyZDViNWYzNjA4OWQ5MzgyYmQ2ZDlhNWRhMTIzYTYxYzViMmI4NWE4ZGU5MzVhZTAwNTRlZmRlNWUwMjI0ZSIsInZlcnNpb24iOjF9.Er21BNgJ3jJXLuZtpubTYq9wCwO1i_VLQFwS5ET0e4eAYVVj0aOA40I5FvP5pZac3LjkCnVacxzsFWGCYVmnDA
31
+ - task:
32
+ type: question-answering
33
+ name: Question Answering
34
+ dataset:
35
+ name: squad
36
+ type: squad
37
+ config: plain_text
38
+ split: validation
39
+ metrics:
40
+ - type: exact_match
41
+ value: 86.225
42
+ name: Exact Match
43
+ - type: f1
44
+ value: 92.483
45
+ name: F1
46
+ - task:
47
+ type: question-answering
48
+ name: Question Answering
49
+ dataset:
50
+ name: adversarial_qa
51
+ type: adversarial_qa
52
+ config: adversarialQA
53
+ split: validation
54
+ metrics:
55
+ - type: exact_match
56
+ value: 29.900
57
+ name: Exact Match
58
+ - type: f1
59
+ value: 41.183
60
+ name: F1
61
+ - task:
62
+ type: question-answering
63
+ name: Question Answering
64
+ dataset:
65
+ name: squad_adversarial
66
+ type: squad_adversarial
67
+ config: AddOneSent
68
+ split: validation
69
+ metrics:
70
+ - type: exact_match
71
+ value: 79.071
72
+ name: Exact Match
73
+ - type: f1
74
+ value: 84.472
75
+ name: F1
76
+ - task:
77
+ type: question-answering
78
+ name: Question Answering
79
+ dataset:
80
+ name: squadshifts amazon
81
+ type: squadshifts
82
+ config: amazon
83
+ split: test
84
+ metrics:
85
+ - type: exact_match
86
+ value: 70.733
87
+ name: Exact Match
88
+ - type: f1
89
+ value: 83.958
90
+ name: F1
91
+ - task:
92
+ type: question-answering
93
+ name: Question Answering
94
+ dataset:
95
+ name: squadshifts new_wiki
96
+ type: squadshifts
97
+ config: new_wiki
98
+ split: test
99
+ metrics:
100
+ - type: exact_match
101
+ value: 82.011
102
+ name: Exact Match
103
+ - type: f1
104
+ value: 91.092
105
+ name: F1
106
+ - task:
107
+ type: question-answering
108
+ name: Question Answering
109
+ dataset:
110
+ name: squadshifts nyt
111
+ type: squadshifts
112
+ config: nyt
113
+ split: test
114
+ metrics:
115
+ - type: exact_match
116
+ value: 84.203
117
+ name: Exact Match
118
+ - type: f1
119
+ value: 91.521
120
+ name: F1
121
+ - task:
122
+ type: question-answering
123
+ name: Question Answering
124
+ dataset:
125
+ name: squadshifts reddit
126
+ type: squadshifts
127
+ config: reddit
128
+ split: test
129
+ metrics:
130
+ - type: exact_match
131
+ value: 72.029
132
+ name: Exact Match
133
+ - type: f1
134
+ value: 83.454
135
+ name: F1
136
  ---
137
 
138
  ## Overview