Hugging Face's logo

reasonwang
/
embedding-qwen3-1.7b-embedding_ac1_unicode_shuf

Sentence Similarity
sentence-transformers
Safetensors
qwen3
feature-extraction
dense
Generated from Trainer
loss:CachedMultipleNegativesRankingLoss
Eval Results (legacy)
text-embeddings-inference
Model card Files
xet
 Community
reasonwang commited on
Commit
705734d
·
verified ·
1 Parent(s): 8483f56

Add new SentenceTransformer model

Browse files
Files changed (17) hide show
  1. .gitattributes +1 -0
  2. 1_Pooling/config.json +10 -0
  3. README.md +1441 -0
  4. added_tokens.json +28 -0
  5. chat_template.jinja +85 -0
  6. config.json +60 -0
  7. config_sentence_transformers.json +14 -0
  8. merges.txt +0 -0
  9. model-00001-of-00002.safetensors +3 -0
  10. model-00002-of-00002.safetensors +3 -0
  11. model.safetensors.index.json +318 -0
  12. modules.json +14 -0
  13. sentence_bert_config.json +4 -0
  14. special_tokens_map.json +31 -0
  15. tokenizer.json +3 -0
  16. tokenizer_config.json +246 -0
  17. vocab.json +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 2048,
3
+ "pooling_mode_cls_token": false,
4
+ "pooling_mode_mean_tokens": true,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": true,
9
+ "include_prompt": true
10
+ }
README.md ADDED
@@ -0,0 +1,1441 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - sentence-transformers
4
+ - sentence-similarity
5
+ - feature-extraction
6
+ - dense
7
+ - generated_from_trainer
8
+ - loss:CachedMultipleNegativesRankingLoss
9
+ pipeline_tag: sentence-similarity
10
+ library_name: sentence-transformers
11
+ metrics:
12
+ - cosine_accuracy@1
13
+ - cosine_accuracy@3
14
+ - cosine_accuracy@5
15
+ - cosine_accuracy@10
16
+ - cosine_precision@1
17
+ - cosine_precision@3
18
+ - cosine_precision@5
19
+ - cosine_precision@10
20
+ - cosine_recall@1
21
+ - cosine_recall@3
22
+ - cosine_recall@5
23
+ - cosine_recall@10
24
+ - cosine_ndcg@10
25
+ - cosine_ndcg@100
26
+ - cosine_mrr@10
27
+ - cosine_mrr@100
28
+ - cosine_map@100
29
+ model-index:
30
+ - name: SentenceTransformer
31
+ results:
32
+ - task:
33
+ type: information-retrieval
34
+ name: Information Retrieval
35
+ dataset:
36
+ name: validation retrieval
37
+ type: validation_retrieval
38
+ metrics:
39
+ - type: cosine_accuracy@1
40
+ value: 0.62
41
+ name: Cosine Accuracy@1
42
+ - type: cosine_accuracy@3
43
+ value: 0.79
44
+ name: Cosine Accuracy@3
45
+ - type: cosine_accuracy@5
46
+ value: 0.88
47
+ name: Cosine Accuracy@5
48
+ - type: cosine_accuracy@10
49
+ value: 0.93
50
+ name: Cosine Accuracy@10
51
+ - type: cosine_precision@1
52
+ value: 0.62
53
+ name: Cosine Precision@1
54
+ - type: cosine_precision@3
55
+ value: 0.4733333333333334
56
+ name: Cosine Precision@3
57
+ - type: cosine_precision@5
58
+ value: 0.406
59
+ name: Cosine Precision@5
60
+ - type: cosine_precision@10
61
+ value: 0.29200000000000004
62
+ name: Cosine Precision@10
63
+ - type: cosine_recall@1
64
+ value: 0.12063996930780413
65
+ name: Cosine Recall@1
66
+ - type: cosine_recall@3
67
+ value: 0.23012174376303066
68
+ name: Cosine Recall@3
69
+ - type: cosine_recall@5
70
+ value: 0.3082990416454995
71
+ name: Cosine Recall@5
72
+ - type: cosine_recall@10
73
+ value: 0.3879067546365363
74
+ name: Cosine Recall@10
75
+ - type: cosine_ndcg@10
76
+ value: 0.4788390199568546
77
+ name: Cosine Ndcg@10
78
+ - type: cosine_ndcg@100
79
+ value: 0.5509783510399775
80
+ name: Cosine Ndcg@100
81
+ - type: cosine_mrr@10
82
+ value: 0.721873015873016
83
+ name: Cosine Mrr@10
84
+ - type: cosine_mrr@100
85
+ value: 0.7250404366243076
86
+ name: Cosine Mrr@100
87
+ - type: cosine_map@100
88
+ value: 0.3511116398212947
89
+ name: Cosine Map@100
90
+ ---
91
+
92
+ # SentenceTransformer
93
+
94
+ This is a [sentence-transformers](https://www.SBERT.net) model trained on the generator dataset. It maps sentences & paragraphs to a 4096-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
95
+
96
+ ## Model Details
97
+
98
+ ### Model Description
99
+ - **Model Type:** Sentence Transformer
100
+ <!-- - **Base model:** [Unknown](https://huggingface.co/unknown) -->
101
+ - **Maximum Sequence Length:** 32768 tokens
102
+ - **Output Dimensionality:** 4096 dimensions
103
+ - **Similarity Function:** Cosine Similarity
104
+ - **Training Dataset:**
105
+ - generator
106
+ <!-- - **Language:** Unknown -->
107
+ <!-- - **License:** Unknown -->
108
+
109
+ ### Model Sources
110
+
111
+ - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
112
+ - **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
113
+ - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
114
+
115
+ ### Full Model Architecture
116
+
117
+ ```
118
+ SentenceTransformer(
119
+ (0): Transformer({'max_seq_length': 32768, 'do_lower_case': False, 'architecture': 'Qwen3Model'})
120
+ (1): Pooling({'word_embedding_dimension': 2048, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': True, 'include_prompt': True})
121
+ )
122
+ ```
123
+
124
+ ## Usage
125
+
126
+ ### Direct Usage (Sentence Transformers)
127
+
128
+ First install the Sentence Transformers library:
129
+
130
+ ```bash
131
+ pip install -U sentence-transformers
132
+ ```
133
+
134
+ Then you can load this model and run inference.
135
+ ```python
136
+ from sentence_transformers import SentenceTransformer
137
+
138
+ # Download from the 🤗 Hub
139
+ model = SentenceTransformer("reasonwang/embedding-qwen3-1.7b-embedding_ac1_unicode_shuf")
140
+ # Run inference
141
+ sentences = [
142
+ 'The weather is lovely today.',
143
+ "It's so sunny outside!",
144
+ 'He drove to the stadium.',
145
+ ]
146
+ embeddings = model.encode(sentences)
147
+ print(embeddings.shape)
148
+ # [3, 4096]
149
+
150
+ # Get the similarity scores for the embeddings
151
+ similarities = model.similarity(embeddings, embeddings)
152
+ print(similarities)
153
+ # tensor([[1.0000, 0.8993, 0.7656],
154
+ # [0.8993, 1.0000, 0.6804],
155
+ # [0.7656, 0.6804, 1.0000]])
156
+ ```
157
+
158
+ <!--
159
+ ### Direct Usage (Transformers)
160
+
161
+ <details><summary>Click to see the direct usage in Transformers</summary>
162
+
163
+ </details>
164
+ -->
165
+
166
+ <!--
167
+ ### Downstream Usage (Sentence Transformers)
168
+
169
+ You can finetune this model on your own dataset.
170
+
171
+ <details><summary>Click to expand</summary>
172
+
173
+ </details>
174
+ -->
175
+
176
+ <!--
177
+ ### Out-of-Scope Use
178
+
179
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
180
+ -->
181
+
182
+ ## Evaluation
183
+
184
+ ### Metrics
185
+
186
+ #### Information Retrieval
187
+
188
+ * Dataset: `validation_retrieval`
189
+ * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
190
+
191
+ | Metric | Value |
192
+ |:--------------------|:----------|
193
+ | cosine_accuracy@1 | 0.62 |
194
+ | cosine_accuracy@3 | 0.79 |
195
+ | cosine_accuracy@5 | 0.88 |
196
+ | cosine_accuracy@10 | 0.93 |
197
+ | cosine_precision@1 | 0.62 |
198
+ | cosine_precision@3 | 0.4733 |
199
+ | cosine_precision@5 | 0.406 |
200
+ | cosine_precision@10 | 0.292 |
201
+ | cosine_recall@1 | 0.1206 |
202
+ | cosine_recall@3 | 0.2301 |
203
+ | cosine_recall@5 | 0.3083 |
204
+ | cosine_recall@10 | 0.3879 |
205
+ | cosine_ndcg@10 | 0.4788 |
206
+ | **cosine_ndcg@100** | **0.551** |
207
+ | cosine_mrr@10 | 0.7219 |
208
+ | cosine_mrr@100 | 0.725 |
209
+ | cosine_map@100 | 0.3511 |
210
+
211
+ <!--
212
+ ## Bias, Risks and Limitations
213
+
214
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
215
+ -->
216
+
217
+ <!--
218
+ ### Recommendations
219
+
220
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
221
+ -->
222
+
223
+ ## Training Details
224
+
225
+ ### Training Dataset
226
+
227
+ #### generator
228
+
229
+ * Dataset: generator
230
+ * Columns: <code>sentence1</code> and <code>sentence2</code>
231
+ * Loss: [<code>CachedMultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cachedmultiplenegativesrankingloss) with these parameters:
232
+ ```json
233
+ {
234
+ "scale": 20.0,
235
+ "similarity_fct": "cos_sim",
236
+ "mini_batch_size": 4,
237
+ "gather_across_devices": false
238
+ }
239
+ ```
240
+
241
+ ### Training Hyperparameters
242
+ #### Non-Default Hyperparameters
243
+
244
+ - `eval_strategy`: steps
245
+ - `per_device_train_batch_size`: 256
246
+ - `learning_rate`: 2e-05
247
+ - `max_steps`: 100000
248
+ - `log_level`: info
249
+ - `bf16`: True
250
+ - `dataloader_num_workers`: 1
251
+ - `accelerator_config`: {'split_batches': False, 'dispatch_batches': False, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
252
+
253
+ #### All Hyperparameters
254
+ <details><summary>Click to expand</summary>
255
+
256
+ - `overwrite_output_dir`: False
257
+ - `do_predict`: False
258
+ - `eval_strategy`: steps
259
+ - `prediction_loss_only`: True
260
+ - `per_device_train_batch_size`: 256
261
+ - `per_device_eval_batch_size`: 8
262
+ - `per_gpu_train_batch_size`: None
263
+ - `per_gpu_eval_batch_size`: None
264
+ - `gradient_accumulation_steps`: 1
265
+ - `eval_accumulation_steps`: None
266
+ - `torch_empty_cache_steps`: None
267
+ - `learning_rate`: 2e-05
268
+ - `weight_decay`: 0.0
269
+ - `adam_beta1`: 0.9
270
+ - `adam_beta2`: 0.999
271
+ - `adam_epsilon`: 1e-08
272
+ - `max_grad_norm`: 1.0
273
+ - `num_train_epochs`: 3.0
274
+ - `max_steps`: 100000
275
+ - `lr_scheduler_type`: linear
276
+ - `lr_scheduler_kwargs`: {}
277
+ - `warmup_ratio`: 0.0
278
+ - `warmup_steps`: 0
279
+ - `log_level`: info
280
+ - `log_level_replica`: warning
281
+ - `log_on_each_node`: True
282
+ - `logging_nan_inf_filter`: True
283
+ - `save_safetensors`: True
284
+ - `save_on_each_node`: False
285
+ - `save_only_model`: False
286
+ - `restore_callback_states_from_checkpoint`: False
287
+ - `no_cuda`: False
288
+ - `use_cpu`: False
289
+ - `use_mps_device`: False
290
+ - `seed`: 42
291
+ - `data_seed`: None
292
+ - `jit_mode_eval`: False
293
+ - `bf16`: True
294
+ - `fp16`: False
295
+ - `fp16_opt_level`: O1
296
+ - `half_precision_backend`: auto
297
+ - `bf16_full_eval`: False
298
+ - `fp16_full_eval`: False
299
+ - `tf32`: None
300
+ - `local_rank`: 0
301
+ - `ddp_backend`: None
302
+ - `tpu_num_cores`: None
303
+ - `tpu_metrics_debug`: False
304
+ - `debug`: []
305
+ - `dataloader_drop_last`: True
306
+ - `dataloader_num_workers`: 1
307
+ - `dataloader_prefetch_factor`: None
308
+ - `past_index`: -1
309
+ - `disable_tqdm`: False
310
+ - `remove_unused_columns`: True
311
+ - `label_names`: None
312
+ - `load_best_model_at_end`: False
313
+ - `ignore_data_skip`: False
314
+ - `fsdp`: []
315
+ - `fsdp_min_num_params`: 0
316
+ - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
317
+ - `fsdp_transformer_layer_cls_to_wrap`: None
318
+ - `accelerator_config`: {'split_batches': False, 'dispatch_batches': False, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
319
+ - `parallelism_config`: None
320
+ - `deepspeed`: None
321
+ - `label_smoothing_factor`: 0.0
322
+ - `optim`: adamw_torch_fused
323
+ - `optim_args`: None
324
+ - `adafactor`: False
325
+ - `group_by_length`: False
326
+ - `length_column_name`: length
327
+ - `project`: huggingface
328
+ - `trackio_space_id`: trackio
329
+ - `ddp_find_unused_parameters`: None
330
+ - `ddp_bucket_cap_mb`: None
331
+ - `ddp_broadcast_buffers`: False
332
+ - `dataloader_pin_memory`: True
333
+ - `dataloader_persistent_workers`: False
334
+ - `skip_memory_metrics`: True
335
+ - `use_legacy_prediction_loop`: False
336
+ - `push_to_hub`: False
337
+ - `resume_from_checkpoint`: None
338
+ - `hub_model_id`: None
339
+ - `hub_strategy`: every_save
340
+ - `hub_private_repo`: None
341
+ - `hub_always_push`: False
342
+ - `hub_revision`: None
343
+ - `gradient_checkpointing`: False
344
+ - `gradient_checkpointing_kwargs`: None
345
+ - `include_inputs_for_metrics`: False
346
+ - `include_for_metrics`: []
347
+ - `eval_do_concat_batches`: True
348
+ - `fp16_backend`: auto
349
+ - `push_to_hub_model_id`: None
350
+ - `push_to_hub_organization`: None
351
+ - `mp_parameters`:
352
+ - `auto_find_batch_size`: False
353
+ - `full_determinism`: False
354
+ - `torchdynamo`: None
355
+ - `ray_scope`: last
356
+ - `ddp_timeout`: 1800
357
+ - `torch_compile`: False
358
+ - `torch_compile_backend`: None
359
+ - `torch_compile_mode`: None
360
+ - `include_tokens_per_second`: False
361
+ - `include_num_input_tokens_seen`: no
362
+ - `neftune_noise_alpha`: None
363
+ - `optim_target_modules`: None
364
+ - `batch_eval_metrics`: False
365
+ - `eval_on_start`: False
366
+ - `use_liger_kernel`: False
367
+ - `liger_kernel_config`: None
368
+ - `eval_use_gather_object`: False
369
+ - `average_tokens_across_devices`: True
370
+ - `prompts`: None
371
+ - `batch_sampler`: batch_sampler
372
+ - `multi_dataset_batch_sampler`: proportional
373
+ - `router_mapping`: {}
374
+ - `learning_rate_mapping`: {}
375
+
376
+ </details>
377
+
378
+ ### Training Logs
379
+ <details><summary>Click to expand</summary>
380
+
381
+ | Epoch | Step | Training Loss | validation_retrieval_cosine_ndcg@100 |
382
+ |:------:|:-----:|:-------------:|:------------------------------------:|
383
+ | 1e-05 | 1 | 5.2053 | - |
384
+ | 0.0001 | 10 | 3.8468 | - |
385
+ | 0.0002 | 20 | 2.8407 | - |
386
+ | 0.0003 | 30 | 2.5497 | - |
387
+ | 0.0004 | 40 | 2.4161 | - |
388
+ | 0.0005 | 50 | 2.3331 | - |
389
+ | 0.0006 | 60 | 2.3184 | - |
390
+ | 0.0007 | 70 | 2.2386 | - |
391
+ | 0.0008 | 80 | 2.2135 | - |
392
+ | 0.0009 | 90 | 2.1836 | - |
393
+ | 0.001 | 100 | 2.1797 | 0.4941 |
394
+ | 0.0011 | 110 | 2.1426 | - |
395
+ | 0.0012 | 120 | 2.1384 | - |
396
+ | 0.0013 | 130 | 2.1306 | - |
397
+ | 0.0014 | 140 | 2.1141 | - |
398
+ | 0.0015 | 150 | 2.1241 | - |
399
+ | 0.0016 | 160 | 2.0885 | - |
400
+ | 0.0017 | 170 | 2.0815 | - |
401
+ | 0.0018 | 180 | 2.099 | - |
402
+ | 0.0019 | 190 | 2.0519 | - |
403
+ | 0.002 | 200 | 2.0482 | 0.5110 |
404
+ | 0.0021 | 210 | 2.0405 | - |
405
+ | 0.0022 | 220 | 2.0122 | - |
406
+ | 0.0023 | 230 | 2.025 | - |
407
+ | 0.0024 | 240 | 2.011 | - |
408
+ | 0.0025 | 250 | 2.0368 | - |
409
+ | 0.0026 | 260 | 1.9879 | - |
410
+ | 0.0027 | 270 | 2.0191 | - |
411
+ | 0.0028 | 280 | 1.9754 | - |
412
+ | 0.0029 | 290 | 2.0114 | - |
413
+ | 0.003 | 300 | 1.9769 | 0.5158 |
414
+ | 0.0031 | 310 | 1.9594 | - |
415
+ | 0.0032 | 320 | 1.9792 | - |
416
+ | 0.0033 | 330 | 1.9615 | - |
417
+ | 0.0034 | 340 | 1.955 | - |
418
+ | 0.0035 | 350 | 1.9725 | - |
419
+ | 0.0036 | 360 | 1.9524 | - |
420
+ | 0.0037 | 370 | 1.9435 | - |
421
+ | 0.0038 | 380 | 1.9398 | - |
422
+ | 0.0039 | 390 | 1.9251 | - |
423
+ | 0.004 | 400 | 1.8997 | 0.5228 |
424
+ | 0.0041 | 410 | 1.9296 | - |
425
+ | 0.0042 | 420 | 1.9267 | - |
426
+ | 0.0043 | 430 | 1.9301 | - |
427
+ | 0.0044 | 440 | 1.9417 | - |
428
+ | 0.0045 | 450 | 1.9179 | - |
429
+ | 0.0046 | 460 | 1.9091 | - |
430
+ | 0.0047 | 470 | 1.9147 | - |
431
+ | 0.0048 | 480 | 1.9187 | - |
432
+ | 0.0049 | 490 | 1.9345 | - |
433
+ | 0.005 | 500 | 1.883 | 0.5258 |
434
+ | 0.0051 | 510 | 1.9023 | - |
435
+ | 0.0052 | 520 | 1.8664 | - |
436
+ | 0.0053 | 530 | 1.9142 | - |
437
+ | 0.0054 | 540 | 1.8902 | - |
438
+ | 0.0055 | 550 | 1.877 | - |
439
+ | 0.0056 | 560 | 1.8753 | - |
440
+ | 0.0057 | 570 | 1.8804 | - |
441
+ | 0.0058 | 580 | 1.8923 | - |
442
+ | 0.0059 | 590 | 1.8501 | - |
443
+ | 0.006 | 600 | 1.8499 | 0.5265 |
444
+ | 0.0061 | 610 | 1.8719 | - |
445
+ | 0.0062 | 620 | 1.8692 | - |
446
+ | 0.0063 | 630 | 1.8813 | - |
447
+ | 0.0064 | 640 | 1.8758 | - |
448
+ | 0.0065 | 650 | 1.8721 | - |
449
+ | 0.0066 | 660 | 1.8466 | - |
450
+ | 0.0067 | 670 | 1.8873 | - |
451
+ | 0.0068 | 680 | 1.8429 | - |
452
+ | 0.0069 | 690 | 1.8719 | - |
453
+ | 0.007 | 700 | 1.8478 | 0.5271 |
454
+ | 0.0071 | 710 | 1.8616 | - |
455
+ | 0.0072 | 720 | 1.8486 | - |
456
+ | 0.0073 | 730 | 1.8766 | - |
457
+ | 0.0074 | 740 | 1.8614 | - |
458
+ | 0.0075 | 750 | 1.8722 | - |
459
+ | 0.0076 | 760 | 1.829 | - |
460
+ | 0.0077 | 770 | 1.8341 | - |
461
+ | 0.0078 | 780 | 1.8304 | - |
462
+ | 0.0079 | 790 | 1.8494 | - |
463
+ | 0.008 | 800 | 1.838 | 0.5328 |
464
+ | 0.0081 | 810 | 1.851 | - |
465
+ | 0.0082 | 820 | 1.8359 | - |
466
+ | 0.0083 | 830 | 1.8528 | - |
467
+ | 0.0084 | 840 | 1.8295 | - |
468
+ | 0.0085 | 850 | 1.8337 | - |
469
+ | 0.0086 | 860 | 1.8072 | - |
470
+ | 0.0087 | 870 | 1.8068 | - |
471
+ | 0.0088 | 880 | 1.8102 | - |
472
+ | 0.0089 | 890 | 1.8199 | - |
473
+ | 0.009 | 900 | 1.8308 | 0.5324 |
474
+ | 0.0091 | 910 | 1.8155 | - |
475
+ | 0.0092 | 920 | 1.7918 | - |
476
+ | 0.0093 | 930 | 1.7969 | - |
477
+ | 0.0094 | 940 | 1.8054 | - |
478
+ | 0.0095 | 950 | 1.8032 | - |
479
+ | 0.0096 | 960 | 1.7972 | - |
480
+ | 0.0097 | 970 | 1.8063 | - |
481
+ | 0.0098 | 980 | 1.8227 | - |
482
+ | 0.0099 | 990 | 1.8111 | - |
483
+ | 0.01 | 1000 | 1.7909 | 0.5312 |
484
+ | 0.0101 | 1010 | 1.8105 | - |
485
+ | 0.0102 | 1020 | 1.7976 | - |
486
+ | 0.0103 | 1030 | 1.8117 | - |
487
+ | 0.0104 | 1040 | 1.7823 | - |
488
+ | 0.0105 | 1050 | 1.7967 | - |
489
+ | 0.0106 | 1060 | 1.7941 | - |
490
+ | 0.0107 | 1070 | 1.8054 | - |
491
+ | 0.0108 | 1080 | 1.7938 | - |
492
+ | 0.0109 | 1090 | 1.784 | - |
493
+ | 0.011 | 1100 | 1.8 | 0.5342 |
494
+ | 0.0111 | 1110 | 1.7895 | - |
495
+ | 0.0112 | 1120 | 1.805 | - |
496
+ | 0.0113 | 1130 | 1.8063 | - |
497
+ | 0.0114 | 1140 | 1.8011 | - |
498
+ | 0.0115 | 1150 | 1.7609 | - |
499
+ | 0.0116 | 1160 | 1.7658 | - |
500
+ | 0.0117 | 1170 | 1.7393 | - |
501
+ | 0.0118 | 1180 | 1.7716 | - |
502
+ | 0.0119 | 1190 | 1.7546 | - |
503
+ | 0.012 | 1200 | 1.776 | 0.5351 |
504
+ | 0.0121 | 1210 | 1.7735 | - |
505
+ | 0.0122 | 1220 | 1.7815 | - |
506
+ | 0.0123 | 1230 | 1.7805 | - |
507
+ | 0.0124 | 1240 | 1.7677 | - |
508
+ | 0.0125 | 1250 | 1.7697 | - |
509
+ | 0.0126 | 1260 | 1.7599 | - |
510
+ | 0.0127 | 1270 | 1.752 | - |
511
+ | 0.0128 | 1280 | 1.7591 | - |
512
+ | 0.0129 | 1290 | 1.7519 | - |
513
+ | 0.013 | 1300 | 1.7782 | 0.5344 |
514
+ | 0.0131 | 1310 | 1.741 | - |
515
+ | 0.0132 | 1320 | 1.7475 | - |
516
+ | 0.0133 | 1330 | 1.7903 | - |
517
+ | 0.0134 | 1340 | 1.7488 | - |
518
+ | 0.0135 | 1350 | 1.7426 | - |
519
+ | 0.0136 | 1360 | 1.7589 | - |
520
+ | 0.0137 | 1370 | 1.7327 | - |
521
+ | 0.0138 | 1380 | 1.7453 | - |
522
+ | 0.0139 | 1390 | 1.7453 | - |
523
+ | 0.014 | 1400 | 1.7347 | 0.5345 |
524
+ | 0.0141 | 1410 | 1.7467 | - |
525
+ | 0.0142 | 1420 | 1.743 | - |
526
+ | 0.0143 | 1430 | 1.7587 | - |
527
+ | 0.0144 | 1440 | 1.73 | - |
528
+ | 0.0145 | 1450 | 1.7453 | - |
529
+ | 0.0146 | 1460 | 1.7387 | - |
530
+ | 0.0147 | 1470 | 1.7431 | - |
531
+ | 0.0148 | 1480 | 1.7542 | - |
532
+ | 0.0149 | 1490 | 1.764 | - |
533
+ | 0.015 | 1500 | 1.7297 | 0.5376 |
534
+ | 0.0151 | 1510 | 1.7404 | - |
535
+ | 0.0152 | 1520 | 1.7497 | - |
536
+ | 0.0153 | 1530 | 1.756 | - |
537
+ | 0.0154 | 1540 | 1.7426 | - |
538
+ | 0.0155 | 1550 | 1.7246 | - |
539
+ | 0.0156 | 1560 | 1.7217 | - |
540
+ | 0.0157 | 1570 | 1.7319 | - |
541
+ | 0.0158 | 1580 | 1.7642 | - |
542
+ | 0.0159 | 1590 | 1.7345 | - |
543
+ | 0.016 | 1600 | 1.7312 | 0.5360 |
544
+ | 0.0161 | 1610 | 1.7394 | - |
545
+ | 0.0162 | 1620 | 1.7025 | - |
546
+ | 0.0163 | 1630 | 1.7431 | - |
547
+ | 0.0164 | 1640 | 1.7216 | - |
548
+ | 0.0165 | 1650 | 1.7378 | - |
549
+ | 0.0166 | 1660 | 1.7217 | - |
550
+ | 0.0167 | 1670 | 1.7424 | - |
551
+ | 0.0168 | 1680 | 1.7349 | - |
552
+ | 0.0169 | 1690 | 1.7191 | - |
553
+ | 0.017 | 1700 | 1.7288 | 0.5380 |
554
+ | 0.0171 | 1710 | 1.7173 | - |
555
+ | 0.0172 | 1720 | 1.7215 | - |
556
+ | 0.0173 | 1730 | 1.7108 | - |
557
+ | 0.0174 | 1740 | 1.6972 | - |
558
+ | 0.0175 | 1750 | 1.7177 | - |
559
+ | 0.0176 | 1760 | 1.7259 | - |
560
+ | 0.0177 | 1770 | 1.7103 | - |
561
+ | 0.0178 | 1780 | 1.7286 | - |
562
+ | 0.0179 | 1790 | 1.7127 | - |
563
+ | 0.018 | 1800 | 1.7102 | 0.5373 |
564
+ | 0.0181 | 1810 | 1.6951 | - |
565
+ | 0.0182 | 1820 | 1.7221 | - |
566
+ | 0.0183 | 1830 | 1.7135 | - |
567
+ | 0.0184 | 1840 | 1.6976 | - |
568
+ | 0.0185 | 1850 | 1.719 | - |
569
+ | 0.0186 | 1860 | 1.7182 | - |
570
+ | 0.0187 | 1870 | 1.7 | - |
571
+ | 0.0188 | 1880 | 1.7307 | - |
572
+ | 0.0189 | 1890 | 1.7024 | - |
573
+ | 0.019 | 1900 | 1.7092 | 0.5395 |
574
+ | 0.0191 | 1910 | 1.6905 | - |
575
+ | 0.0192 | 1920 | 1.7068 | - |
576
+ | 0.0193 | 1930 | 1.7053 | - |
577
+ | 0.0194 | 1940 | 1.7104 | - |
578
+ | 0.0195 | 1950 | 1.7068 | - |
579
+ | 0.0196 | 1960 | 1.7136 | - |
580
+ | 0.0197 | 1970 | 1.672 | - |
581
+ | 0.0198 | 1980 | 1.7229 | - |
582
+ | 0.0199 | 1990 | 1.6988 | - |
583
+ | 0.02 | 2000 | 1.7009 | 0.5376 |
584
+ | 0.0201 | 2010 | 1.6763 | - |
585
+ | 0.0202 | 2020 | 1.7004 | - |
586
+ | 0.0203 | 2030 | 1.6916 | - |
587
+ | 0.0204 | 2040 | 1.7155 | - |
588
+ | 0.0205 | 2050 | 1.7055 | - |
589
+ | 0.0206 | 2060 | 1.6892 | - |
590
+ | 0.0207 | 2070 | 1.7236 | - |
591
+ | 0.0208 | 2080 | 1.6971 | - |
592
+ | 0.0209 | 2090 | 1.7105 | - |
593
+ | 0.021 | 2100 | 1.6989 | 0.5398 |
594
+ | 0.0211 | 2110 | 1.7052 | - |
595
+ | 0.0212 | 2120 | 1.6936 | - |
596
+ | 0.0213 | 2130 | 1.7055 | - |
597
+ | 0.0214 | 2140 | 1.7038 | - |
598
+ | 0.0215 | 2150 | 1.6902 | - |
599
+ | 0.0216 | 2160 | 1.6808 | - |
600
+ | 0.0217 | 2170 | 1.6859 | - |
601
+ | 0.0218 | 2180 | 1.7133 | - |
602
+ | 0.0219 | 2190 | 1.6992 | - |
603
+ | 0.022 | 2200 | 1.6929 | 0.5389 |
604
+ | 0.0221 | 2210 | 1.6918 | - |
605
+ | 0.0222 | 2220 | 1.6732 | - |
606
+ | 0.0223 | 2230 | 1.7048 | - |
607
+ | 0.0224 | 2240 | 1.6682 | - |
608
+ | 0.0225 | 2250 | 1.6733 | - |
609
+ | 0.0226 | 2260 | 1.6655 | - |
610
+ | 0.0227 | 2270 | 1.6712 | - |
611
+ | 0.0228 | 2280 | 1.6707 | - |
612
+ | 0.0229 | 2290 | 1.668 | - |
613
+ | 0.023 | 2300 | 1.7152 | 0.5413 |
614
+ | 0.0231 | 2310 | 1.6816 | - |
615
+ | 0.0232 | 2320 | 1.6642 | - |
616
+ | 0.0233 | 2330 | 1.6809 | - |
617
+ | 0.0234 | 2340 | 1.6925 | - |
618
+ | 0.0235 | 2350 | 1.679 | - |
619
+ | 0.0236 | 2360 | 1.6857 | - |
620
+ | 0.0237 | 2370 | 1.6958 | - |
621
+ | 0.0238 | 2380 | 1.6943 | - |
622
+ | 0.0239 | 2390 | 1.6487 | - |
623
+ | 0.024 | 2400 | 1.6818 | 0.5352 |
624
+ | 0.0241 | 2410 | 1.6752 | - |
625
+ | 0.0242 | 2420 | 1.6707 | - |
626
+ | 0.0243 | 2430 | 1.6891 | - |
627
+ | 0.0244 | 2440 | 1.6691 | - |
628
+ | 0.0245 | 2450 | 1.6786 | - |
629
+ | 0.0246 | 2460 | 1.6831 | - |
630
+ | 0.0247 | 2470 | 1.6788 | - |
631
+ | 0.0248 | 2480 | 1.69 | - |
632
+ | 0.0249 | 2490 | 1.6811 | - |
633
+ | 0.025 | 2500 | 1.6584 | 0.5425 |
634
+ | 0.0251 | 2510 | 1.6523 | - |
635
+ | 0.0252 | 2520 | 1.6947 | - |
636
+ | 0.0253 | 2530 | 1.6542 | - |
637
+ | 0.0254 | 2540 | 1.6411 | - |
638
+ | 0.0255 | 2550 | 1.6729 | - |
639
+ | 0.0256 | 2560 | 1.6851 | - |
640
+ | 0.0257 | 2570 | 1.6642 | - |
641
+ | 0.0258 | 2580 | 1.6614 | - |
642
+ | 0.0259 | 2590 | 1.6684 | - |
643
+ | 0.026 | 2600 | 1.6676 | 0.5402 |
644
+ | 0.0261 | 2610 | 1.6678 | - |
645
+ | 0.0262 | 2620 | 1.6741 | - |
646
+ | 0.0263 | 2630 | 1.6769 | - |
647
+ | 0.0264 | 2640 | 1.6468 | - |
648
+ | 0.0265 | 2650 | 1.6688 | - |
649
+ | 0.0266 | 2660 | 1.6543 | - |
650
+ | 0.0267 | 2670 | 1.7078 | - |
651
+ | 0.0268 | 2680 | 1.6353 | - |
652
+ | 0.0269 | 2690 | 1.665 | - |
653
+ | 0.027 | 2700 | 1.6629 | 0.5441 |
654
+ | 0.0271 | 2710 | 1.6567 | - |
655
+ | 0.0272 | 2720 | 1.6395 | - |
656
+ | 0.0273 | 2730 | 1.6629 | - |
657
+ | 0.0274 | 2740 | 1.6852 | - |
658
+ | 0.0275 | 2750 | 1.6635 | - |
659
+ | 0.0276 | 2760 | 1.6765 | - |
660
+ | 0.0277 | 2770 | 1.6598 | - |
661
+ | 0.0278 | 2780 | 1.6547 | - |
662
+ | 0.0279 | 2790 | 1.6741 | - |
663
+ | 0.028 | 2800 | 1.6664 | 0.5423 |
664
+ | 0.0281 | 2810 | 1.6446 | - |
665
+ | 0.0282 | 2820 | 1.6662 | - |
666
+ | 0.0283 | 2830 | 1.6566 | - |
667
+ | 0.0284 | 2840 | 1.6397 | - |
668
+ | 0.0285 | 2850 | 1.6728 | - |
669
+ | 0.0286 | 2860 | 1.6592 | - |
670
+ | 0.0287 | 2870 | 1.657 | - |
671
+ | 0.0288 | 2880 | 1.6498 | - |
672
+ | 0.0289 | 2890 | 1.6375 | - |
673
+ | 0.029 | 2900 | 1.6437 | 0.5376 |
674
+ | 0.0291 | 2910 | 1.6309 | - |
675
+ | 0.0292 | 2920 | 1.6665 | - |
676
+ | 0.0293 | 2930 | 1.6666 | - |
677
+ | 0.0294 | 2940 | 1.6476 | - |
678
+ | 0.0295 | 2950 | 1.6604 | - |
679
+ | 0.0296 | 2960 | 1.6595 | - |
680
+ | 0.0297 | 2970 | 1.6476 | - |
681
+ | 0.0298 | 2980 | 1.6716 | - |
682
+ | 0.0299 | 2990 | 1.629 | - |
683
+ | 0.03 | 3000 | 1.6383 | 0.5425 |
684
+ | 0.0301 | 3010 | 1.6545 | - |
685
+ | 0.0302 | 3020 | 1.6477 | - |
686
+ | 0.0303 | 3030 | 1.6137 | - |
687
+ | 0.0304 | 3040 | 1.6581 | - |
688
+ | 0.0305 | 3050 | 1.6696 | - |
689
+ | 0.0306 | 3060 | 1.6316 | - |
690
+ | 0.0307 | 3070 | 1.6439 | - |
691
+ | 0.0308 | 3080 | 1.6537 | - |
692
+ | 0.0309 | 3090 | 1.6466 | - |
693
+ | 0.031 | 3100 | 1.6388 | 0.5416 |
694
+ | 0.0311 | 3110 | 1.6467 | - |
695
+ | 0.0312 | 3120 | 1.6235 | - |
696
+ | 0.0313 | 3130 | 1.6201 | - |
697
+ | 0.0314 | 3140 | 1.6342 | - |
698
+ | 0.0315 | 3150 | 1.6487 | - |
699
+ | 0.0316 | 3160 | 1.6531 | - |
700
+ | 0.0317 | 3170 | 1.6552 | - |
701
+ | 0.0318 | 3180 | 1.65 | - |
702
+ | 0.0319 | 3190 | 1.6457 | - |
703
+ | 0.032 | 3200 | 1.6448 | 0.5427 |
704
+ | 0.0321 | 3210 | 1.641 | - |
705
+ | 0.0322 | 3220 | 1.6612 | - |
706
+ | 0.0323 | 3230 | 1.6482 | - |
707
+ | 0.0324 | 3240 | 1.6362 | - |
708
+ | 0.0325 | 3250 | 1.6299 | - |
709
+ | 0.0326 | 3260 | 1.642 | - |
710
+ | 0.0327 | 3270 | 1.6443 | - |
711
+ | 0.0328 | 3280 | 1.6362 | - |
712
+ | 0.0329 | 3290 | 1.6234 | - |
713
+ | 0.033 | 3300 | 1.6294 | 0.5409 |
714
+ | 0.0331 | 3310 | 1.6278 | - |
715
+ | 0.0332 | 3320 | 1.6201 | - |
716
+ | 0.0333 | 3330 | 1.6059 | - |
717
+ | 0.0334 | 3340 | 1.6609 | - |
718
+ | 0.0335 | 3350 | 1.6263 | - |
719
+ | 0.0336 | 3360 | 1.6113 | - |
720
+ | 0.0337 | 3370 | 1.6403 | - |
721
+ | 0.0338 | 3380 | 1.6425 | - |
722
+ | 0.0339 | 3390 | 1.6274 | - |
723
+ | 0.034 | 3400 | 1.6364 | 0.5377 |
724
+ | 0.0341 | 3410 | 1.6252 | - |
725
+ | 0.0342 | 3420 | 1.6144 | - |
726
+ | 0.0343 | 3430 | 1.6334 | - |
727
+ | 0.0344 | 3440 | 1.6172 | - |
728
+ | 0.0345 | 3450 | 1.6293 | - |
729
+ | 0.0346 | 3460 | 1.6308 | - |
730
+ | 0.0347 | 3470 | 1.6309 | - |
731
+ | 0.0348 | 3480 | 1.6178 | - |
732
+ | 0.0349 | 3490 | 1.6426 | - |
733
+ | 0.035 | 3500 | 1.6178 | 0.5466 |
734
+ | 0.0351 | 3510 | 1.6516 | - |
735
+ | 0.0352 | 3520 | 1.6249 | - |
736
+ | 0.0353 | 3530 | 1.6355 | - |
737
+ | 0.0354 | 3540 | 1.6451 | - |
738
+ | 0.0355 | 3550 | 1.611 | - |
739
+ | 0.0356 | 3560 | 1.6265 | - |
740
+ | 0.0357 | 3570 | 1.633 | - |
741
+ | 0.0358 | 3580 | 1.6222 | - |
742
+ | 0.0359 | 3590 | 1.616 | - |
743
+ | 0.036 | 3600 | 1.6226 | 0.5412 |
744
+ | 0.0361 | 3610 | 1.6251 | - |
745
+ | 0.0362 | 3620 | 1.6148 | - |
746
+ | 0.0363 | 3630 | 1.6348 | - |
747
+ | 0.0364 | 3640 | 1.6421 | - |
748
+ | 0.0365 | 3650 | 1.5937 | - |
749
+ | 0.0366 | 3660 | 1.6469 | - |
750
+ | 0.0367 | 3670 | 1.6259 | - |
751
+ | 0.0368 | 3680 | 1.6216 | - |
752
+ | 0.0369 | 3690 | 1.6206 | - |
753
+ | 0.037 | 3700 | 1.6159 | 0.5422 |
754
+ | 0.0371 | 3710 | 1.6185 | - |
755
+ | 0.0372 | 3720 | 1.6414 | - |
756
+ | 0.0373 | 3730 | 1.6179 | - |
757
+ | 0.0374 | 3740 | 1.6002 | - |
758
+ | 0.0375 | 3750 | 1.6226 | - |
759
+ | 0.0376 | 3760 | 1.6305 | - |
760
+ | 0.0377 | 3770 | 1.6198 | - |
761
+ | 0.0378 | 3780 | 1.6184 | - |
762
+ | 0.0379 | 3790 | 1.6445 | - |
763
+ | 0.038 | 3800 | 1.6291 | 0.5396 |
764
+ | 0.0381 | 3810 | 1.6029 | - |
765
+ | 0.0382 | 3820 | 1.6039 | - |
766
+ | 0.0383 | 3830 | 1.6351 | - |
767
+ | 0.0384 | 3840 | 1.6238 | - |
768
+ | 0.0385 | 3850 | 1.6086 | - |
769
+ | 0.0386 | 3860 | 1.6435 | - |
770
+ | 0.0387 | 3870 | 1.5971 | - |
771
+ | 0.0388 | 3880 | 1.6114 | - |
772
+ | 0.0389 | 3890 | 1.6077 | - |
773
+ | 0.039 | 3900 | 1.584 | 0.5387 |
774
+ | 0.0391 | 3910 | 1.6086 | - |
775
+ | 0.0392 | 3920 | 1.6165 | - |
776
+ | 0.0393 | 3930 | 1.611 | - |
777
+ | 0.0394 | 3940 | 1.6102 | - |
778
+ | 0.0395 | 3950 | 1.5823 | - |
779
+ | 0.0396 | 3960 | 1.6146 | - |
780
+ | 0.0397 | 3970 | 1.5876 | - |
781
+ | 0.0398 | 3980 | 1.605 | - |
782
+ | 0.0399 | 3990 | 1.629 | - |
783
+ | 0.04 | 4000 | 1.6349 | 0.5434 |
784
+ | 0.0401 | 4010 | 1.6273 | - |
785
+ | 0.0402 | 4020 | 1.6252 | - |
786
+ | 0.0403 | 4030 | 1.6426 | - |
787
+ | 0.0404 | 4040 | 1.6003 | - |
788
+ | 0.0405 | 4050 | 1.6135 | - |
789
+ | 0.0406 | 4060 | 1.5962 | - |
790
+ | 0.0407 | 4070 | 1.6133 | - |
791
+ | 0.0408 | 4080 | 1.5951 | - |
792
+ | 0.0409 | 4090 | 1.6001 | - |
793
+ | 0.041 | 4100 | 1.5997 | 0.5432 |
794
+ | 0.0411 | 4110 | 1.6117 | - |
795
+ | 0.0412 | 4120 | 1.6178 | - |
796
+ | 0.0413 | 4130 | 1.6151 | - |
797
+ | 0.0414 | 4140 | 1.6253 | - |
798
+ | 0.0415 | 4150 | 1.613 | - |
799
+ | 0.0416 | 4160 | 1.6197 | - |
800
+ | 0.0417 | 4170 | 1.5976 | - |
801
+ | 0.0418 | 4180 | 1.6213 | - |
802
+ | 0.0419 | 4190 | 1.5855 | - |
803
+ | 0.042 | 4200 | 1.6117 | 0.5443 |
804
+ | 0.0421 | 4210 | 1.6309 | - |
805
+ | 0.0422 | 4220 | 1.6047 | - |
806
+ | 0.0423 | 4230 | 1.6154 | - |
807
+ | 0.0424 | 4240 | 1.6001 | - |
808
+ | 0.0425 | 4250 | 1.619 | - |
809
+ | 0.0426 | 4260 | 1.6137 | - |
810
+ | 0.0427 | 4270 | 1.5896 | - |
811
+ | 0.0428 | 4280 | 1.622 | - |
812
+ | 0.0429 | 4290 | 1.6047 | - |
813
+ | 0.043 | 4300 | 1.6177 | 0.5408 |
814
+ | 0.0431 | 4310 | 1.6021 | - |
815
+ | 0.0432 | 4320 | 1.6219 | - |
816
+ | 0.0433 | 4330 | 1.5891 | - |
817
+ | 0.0434 | 4340 | 1.6268 | - |
818
+ | 0.0435 | 4350 | 1.6135 | - |
819
+ | 0.0436 | 4360 | 1.5985 | - |
820
+ | 0.0437 | 4370 | 1.6017 | - |
821
+ | 0.0438 | 4380 | 1.6061 | - |
822
+ | 0.0439 | 4390 | 1.619 | - |
823
+ | 0.044 | 4400 | 1.5897 | 0.5449 |
824
+ | 0.0441 | 4410 | 1.6126 | - |
825
+ | 0.0442 | 4420 | 1.6143 | - |
826
+ | 0.0443 | 4430 | 1.6213 | - |
827
+ | 0.0444 | 4440 | 1.6026 | - |
828
+ | 0.0445 | 4450 | 1.5946 | - |
829
+ | 0.0446 | 4460 | 1.6191 | - |
830
+ | 0.0447 | 4470 | 1.5861 | - |
831
+ | 0.0448 | 4480 | 1.6075 | - |
832
+ | 0.0449 | 4490 | 1.5854 | - |
833
+ | 0.045 | 4500 | 1.5773 | 0.5399 |
834
+ | 0.0451 | 4510 | 1.6214 | - |
835
+ | 0.0452 | 4520 | 1.6005 | - |
836
+ | 0.0453 | 4530 | 1.579 | - |
837
+ | 0.0454 | 4540 | 1.6039 | - |
838
+ | 0.0455 | 4550 | 1.5778 | - |
839
+ | 0.0456 | 4560 | 1.6141 | - |
840
+ | 0.0457 | 4570 | 1.6088 | - |
841
+ | 0.0458 | 4580 | 1.5981 | - |
842
+ | 0.0459 | 4590 | 1.5863 | - |
843
+ | 0.046 | 4600 | 1.5873 | 0.5438 |
844
+ | 0.0461 | 4610 | 1.595 | - |
845
+ | 0.0462 | 4620 | 1.5976 | - |
846
+ | 0.0463 | 4630 | 1.5772 | - |
847
+ | 0.0464 | 4640 | 1.5724 | - |
848
+ | 0.0465 | 4650 | 1.5905 | - |
849
+ | 0.0466 | 4660 | 1.6146 | - |
850
+ | 0.0467 | 4670 | 1.6097 | - |
851
+ | 0.0468 | 4680 | 1.6069 | - |
852
+ | 0.0469 | 4690 | 1.5915 | - |
853
+ | 0.047 | 4700 | 1.5934 | 0.5478 |
854
+ | 0.0471 | 4710 | 1.6011 | - |
855
+ | 0.0472 | 4720 | 1.6017 | - |
856
+ | 0.0473 | 4730 | 1.6104 | - |
857
+ | 0.0474 | 4740 | 1.5903 | - |
858
+ | 0.0475 | 4750 | 1.6011 | - |
859
+ | 0.0476 | 4760 | 1.5801 | - |
860
+ | 0.0477 | 4770 | 1.5784 | - |
861
+ | 0.0478 | 4780 | 1.6015 | - |
862
+ | 0.0479 | 4790 | 1.591 | - |
863
+ | 0.048 | 4800 | 1.6159 | 0.5480 |
864
+ | 0.0481 | 4810 | 1.5994 | - |
865
+ | 0.0482 | 4820 | 1.5687 | - |
866
+ | 0.0483 | 4830 | 1.5986 | - |
867
+ | 0.0484 | 4840 | 1.6035 | - |
868
+ | 0.0485 | 4850 | 1.5855 | - |
869
+ | 0.0486 | 4860 | 1.5647 | - |
870
+ | 0.0487 | 4870 | 1.602 | - |
871
+ | 0.0488 | 4880 | 1.5805 | - |
872
+ | 0.0489 | 4890 | 1.5876 | - |
873
+ | 0.049 | 4900 | 1.6101 | 0.5447 |
874
+ | 0.0491 | 4910 | 1.5817 | - |
875
+ | 0.0492 | 4920 | 1.5869 | - |
876
+ | 0.0493 | 4930 | 1.5883 | - |
877
+ | 0.0494 | 4940 | 1.5646 | - |
878
+ | 0.0495 | 4950 | 1.571 | - |
879
+ | 0.0496 | 4960 | 1.5814 | - |
880
+ | 0.0497 | 4970 | 1.5863 | - |
881
+ | 0.0498 | 4980 | 1.5599 | - |
882
+ | 0.0499 | 4990 | 1.6061 | - |
883
+ | 0.05 | 5000 | 1.5672 | 0.5471 |
884
+ | 0.0501 | 5010 | 1.5785 | - |
885
+ | 0.0502 | 5020 | 1.5813 | - |
886
+ | 0.0503 | 5030 | 1.5932 | - |
887
+ | 0.0504 | 5040 | 1.5807 | - |
888
+ | 0.0505 | 5050 | 1.5704 | - |
889
+ | 0.0506 | 5060 | 1.5986 | - |
890
+ | 0.0507 | 5070 | 1.5812 | - |
891
+ | 0.0508 | 5080 | 1.5922 | - |
892
+ | 0.0509 | 5090 | 1.5789 | - |
893
+ | 0.051 | 5100 | 1.5829 | 0.5490 |
894
+ | 0.0511 | 5110 | 1.5634 | - |
895
+ | 0.0512 | 5120 | 1.5989 | - |
896
+ | 0.0513 | 5130 | 1.5928 | - |
897
+ | 0.0514 | 5140 | 1.5686 | - |
898
+ | 0.0515 | 5150 | 1.5548 | - |
899
+ | 0.0516 | 5160 | 1.599 | - |
900
+ | 0.0517 | 5170 | 1.5904 | - |
901
+ | 0.0518 | 5180 | 1.5898 | - |
902
+ | 0.0519 | 5190 | 1.578 | - |
903
+ | 0.052 | 5200 | 1.5721 | 0.5484 |
904
+ | 0.0521 | 5210 | 1.5729 | - |
905
+ | 0.0522 | 5220 | 1.5905 | - |
906
+ | 0.0523 | 5230 | 1.5629 | - |
907
+ | 0.0524 | 5240 | 1.5498 | - |
908
+ | 0.0525 | 5250 | 1.577 | - |
909
+ | 0.0526 | 5260 | 1.5995 | - |
910
+ | 0.0527 | 5270 | 1.5591 | - |
911
+ | 0.0528 | 5280 | 1.5772 | - |
912
+ | 0.0529 | 5290 | 1.5927 | - |
913
+ | 0.053 | 5300 | 1.5812 | 0.5467 |
914
+ | 0.0531 | 5310 | 1.5703 | - |
915
+ | 0.0532 | 5320 | 1.5885 | - |
916
+ | 0.0533 | 5330 | 1.5879 | - |
917
+ | 0.0534 | 5340 | 1.5884 | - |
918
+ | 0.0535 | 5350 | 1.5692 | - |
919
+ | 0.0536 | 5360 | 1.6 | - |
920
+ | 0.0537 | 5370 | 1.5907 | - |
921
+ | 0.0538 | 5380 | 1.5728 | - |
922
+ | 0.0539 | 5390 | 1.5876 | - |
923
+ | 0.054 | 5400 | 1.5661 | 0.5485 |
924
+ | 0.0541 | 5410 | 1.5525 | - |
925
+ | 0.0542 | 5420 | 1.5855 | - |
926
+ | 0.0543 | 5430 | 1.5752 | - |
927
+ | 0.0544 | 5440 | 1.5785 | - |
928
+ | 0.0545 | 5450 | 1.5825 | - |
929
+ | 0.0546 | 5460 | 1.5828 | - |
930
+ | 0.0547 | 5470 | 1.5743 | - |
931
+ | 0.0548 | 5480 | 1.5873 | - |
932
+ | 0.0549 | 5490 | 1.5909 | - |
933
+ | 0.055 | 5500 | 1.5811 | 0.5538 |
934
+ | 0.0551 | 5510 | 1.5871 | - |
935
+ | 0.0552 | 5520 | 1.5569 | - |
936
+ | 0.0553 | 5530 | 1.5748 | - |
937
+ | 0.0554 | 5540 | 1.6094 | - |
938
+ | 0.0555 | 5550 | 1.5623 | - |
939
+ | 0.0556 | 5560 | 1.5732 | - |
940
+ | 0.0557 | 5570 | 1.5724 | - |
941
+ | 0.0558 | 5580 | 1.5731 | - |
942
+ | 0.0559 | 5590 | 1.5873 | - |
943
+ | 0.056 | 5600 | 1.5913 | 0.5512 |
944
+ | 0.0561 | 5610 | 1.5916 | - |
945
+ | 0.0562 | 5620 | 1.5684 | - |
946
+ | 0.0563 | 5630 | 1.5526 | - |
947
+ | 0.0564 | 5640 | 1.5699 | - |
948
+ | 0.0565 | 5650 | 1.5732 | - |
949
+ | 0.0566 | 5660 | 1.5797 | - |
950
+ | 0.0567 | 5670 | 1.5723 | - |
951
+ | 0.0568 | 5680 | 1.5719 | - |
952
+ | 0.0569 | 5690 | 1.572 | - |
953
+ | 0.057 | 5700 | 1.5484 | 0.5491 |
954
+ | 0.0571 | 5710 | 1.5927 | - |
955
+ | 0.0572 | 5720 | 1.5614 | - |
956
+ | 0.0573 | 5730 | 1.5723 | - |
957
+ | 0.0574 | 5740 | 1.5675 | - |
958
+ | 0.0575 | 5750 | 1.5577 | - |
959
+ | 0.0576 | 5760 | 1.5801 | - |
960
+ | 0.0577 | 5770 | 1.5685 | - |
961
+ | 0.0578 | 5780 | 1.5802 | - |
962
+ | 0.0579 | 5790 | 1.5707 | - |
963
+ | 0.058 | 5800 | 1.588 | 0.5508 |
964
+ | 0.0581 | 5810 | 1.5642 | - |
965
+ | 0.0582 | 5820 | 1.5649 | - |
966
+ | 0.0583 | 5830 | 1.5724 | - |
967
+ | 0.0584 | 5840 | 1.5701 | - |
968
+ | 0.0585 | 5850 | 1.5731 | - |
969
+ | 0.0586 | 5860 | 1.5625 | - |
970
+ | 0.0587 | 5870 | 1.5822 | - |
971
+ | 0.0588 | 5880 | 1.5668 | - |
972
+ | 0.0589 | 5890 | 1.5742 | - |
973
+ | 0.059 | 5900 | 1.5413 | 0.5498 |
974
+ | 0.0591 | 5910 | 1.5535 | - |
975
+ | 0.0592 | 5920 | 1.5653 | - |
976
+ | 0.0593 | 5930 | 1.5604 | - |
977
+ | 0.0594 | 5940 | 1.5905 | - |
978
+ | 0.0595 | 5950 | 1.5689 | - |
979
+ | 0.0596 | 5960 | 1.5578 | - |
980
+ | 0.0597 | 5970 | 1.5616 | - |
981
+ | 0.0598 | 5980 | 1.5945 | - |
982
+ | 0.0599 | 5990 | 1.5721 | - |
983
+ | 0.06 | 6000 | 1.5701 | 0.5506 |
984
+ | 0.0601 | 6010 | 1.5486 | - |
985
+ | 0.0602 | 6020 | 1.5581 | - |
986
+ | 0.0603 | 6030 | 1.5801 | - |
987
+ | 0.0604 | 6040 | 1.5684 | - |
988
+ | 0.0605 | 6050 | 1.583 | - |
989
+ | 0.0606 | 6060 | 1.5885 | - |
990
+ | 0.0607 | 6070 | 1.5647 | - |
991
+ | 0.0608 | 6080 | 1.5826 | - |
992
+ | 0.0609 | 6090 | 1.5858 | - |
993
+ | 0.061 | 6100 | 1.5618 | 0.5501 |
994
+ | 0.0611 | 6110 | 1.5538 | - |
995
+ | 0.0612 | 6120 | 1.5721 | - |
996
+ | 0.0613 | 6130 | 1.5919 | - |
997
+ | 0.0614 | 6140 | 1.5693 | - |
998
+ | 0.0615 | 6150 | 1.5578 | - |
999
+ | 0.0616 | 6160 | 1.552 | - |
1000
+ | 0.0617 | 6170 | 1.5584 | - |
1001
+ | 0.0618 | 6180 | 1.5455 | - |
1002
+ | 0.0619 | 6190 | 1.5421 | - |
1003
+ | 0.062 | 6200 | 1.5551 | 0.5552 |
1004
+ | 0.0621 | 6210 | 1.5706 | - |
1005
+ | 0.0622 | 6220 | 1.5732 | - |
1006
+ | 0.0623 | 6230 | 1.5619 | - |
1007
+ | 0.0624 | 6240 | 1.5732 | - |
1008
+ | 0.0625 | 6250 | 1.5554 | - |
1009
+ | 0.0626 | 6260 | 1.5734 | - |
1010
+ | 0.0627 | 6270 | 1.5747 | - |
1011
+ | 0.0628 | 6280 | 1.571 | - |
1012
+ | 0.0629 | 6290 | 1.5616 | - |
1013
+ | 0.063 | 6300 | 1.5575 | 0.5546 |
1014
+ | 0.0631 | 6310 | 1.5586 | - |
1015
+ | 0.0632 | 6320 | 1.5857 | - |
1016
+ | 0.0633 | 6330 | 1.5593 | - |
1017
+ | 0.0634 | 6340 | 1.556 | - |
1018
+ | 0.0635 | 6350 | 1.5558 | - |
1019
+ | 0.0636 | 6360 | 1.5799 | - |
1020
+ | 0.0637 | 6370 | 1.5772 | - |
1021
+ | 0.0638 | 6380 | 1.5477 | - |
1022
+ | 0.0639 | 6390 | 1.5823 | - |
1023
+ | 0.064 | 6400 | 1.5462 | 0.5497 |
1024
+ | 0.0641 | 6410 | 1.57 | - |
1025
+ | 0.0642 | 6420 | 1.5551 | - |
1026
+ | 0.0643 | 6430 | 1.5687 | - |
1027
+ | 0.0644 | 6440 | 1.5703 | - |
1028
+ | 0.0645 | 6450 | 1.579 | - |
1029
+ | 0.0646 | 6460 | 1.5426 | - |
1030
+ | 0.0647 | 6470 | 1.5816 | - |
1031
+ | 0.0648 | 6480 | 1.5712 | - |
1032
+ | 0.0649 | 6490 | 1.5746 | - |
1033
+ | 0.065 | 6500 | 1.5648 | 0.5503 |
1034
+ | 0.0651 | 6510 | 1.5443 | - |
1035
+ | 0.0652 | 6520 | 1.5499 | - |
1036
+ | 0.0653 | 6530 | 1.5648 | - |
1037
+ | 0.0654 | 6540 | 1.5585 | - |
1038
+ | 0.0655 | 6550 | 1.5694 | - |
1039
+ | 0.0656 | 6560 | 1.5579 | - |
1040
+ | 0.0657 | 6570 | 1.5762 | - |
1041
+ | 0.0658 | 6580 | 1.5494 | - |
1042
+ | 0.0659 | 6590 | 1.5752 | - |
1043
+ | 0.066 | 6600 | 1.554 | 0.5493 |
1044
+ | 0.0661 | 6610 | 1.5469 | - |
1045
+ | 0.0662 | 6620 | 1.5532 | - |
1046
+ | 0.0663 | 6630 | 1.535 | - |
1047
+ | 0.0664 | 6640 | 1.5146 | - |
1048
+ | 0.0665 | 6650 | 1.5528 | - |
1049
+ | 0.0666 | 6660 | 1.5626 | - |
1050
+ | 0.0667 | 6670 | 1.5476 | - |
1051
+ | 0.0668 | 6680 | 1.5594 | - |
1052
+ | 0.0669 | 6690 | 1.5441 | - |
1053
+ | 0.067 | 6700 | 1.562 | 0.5504 |
1054
+ | 0.0671 | 6710 | 1.5468 | - |
1055
+ | 0.0672 | 6720 | 1.5462 | - |
1056
+ | 0.0673 | 6730 | 1.5711 | - |
1057
+ | 0.0674 | 6740 | 1.5659 | - |
1058
+ | 0.0675 | 6750 | 1.5413 | - |
1059
+ | 0.0676 | 6760 | 1.5497 | - |
1060
+ | 0.0677 | 6770 | 1.5477 | - |
1061
+ | 0.0678 | 6780 | 1.548 | - |
1062
+ | 0.0679 | 6790 | 1.5639 | - |
1063
+ | 0.068 | 6800 | 1.5676 | 0.5500 |
1064
+ | 0.0681 | 6810 | 1.5647 | - |
1065
+ | 0.0682 | 6820 | 1.5663 | - |
1066
+ | 0.0683 | 6830 | 1.5462 | - |
1067
+ | 0.0684 | 6840 | 1.5675 | - |
1068
+ | 0.0685 | 6850 | 1.5563 | - |
1069
+ | 0.0686 | 6860 | 1.5754 | - |
1070
+ | 0.0687 | 6870 | 1.5513 | - |
1071
+ | 0.0688 | 6880 | 1.5629 | - |
1072
+ | 0.0689 | 6890 | 1.5558 | - |
1073
+ | 0.069 | 6900 | 1.5536 | 0.5476 |
1074
+ | 0.0691 | 6910 | 1.5618 | - |
1075
+ | 0.0692 | 6920 | 1.5559 | - |
1076
+ | 0.0693 | 6930 | 1.5661 | - |
1077
+ | 0.0694 | 6940 | 1.5554 | - |
1078
+ | 0.0695 | 6950 | 1.5501 | - |
1079
+ | 0.0696 | 6960 | 1.581 | - |
1080
+ | 0.0697 | 6970 | 1.5303 | - |
1081
+ | 0.0698 | 6980 | 1.5432 | - |
1082
+ | 0.0699 | 6990 | 1.5486 | - |
1083
+ | 0.07 | 7000 | 1.5517 | 0.5495 |
1084
+ | 0.0701 | 7010 | 1.5765 | - |
1085
+ | 0.0702 | 7020 | 1.5536 | - |
1086
+ | 0.0703 | 7030 | 1.5425 | - |
1087
+ | 0.0704 | 7040 | 1.5593 | - |
1088
+ | 0.0705 | 7050 | 1.548 | - |
1089
+ | 0.0706 | 7060 | 1.5501 | - |
1090
+ | 0.0707 | 7070 | 1.5331 | - |
1091
+ | 0.0708 | 7080 | 1.567 | - |
1092
+ | 0.0709 | 7090 | 1.5906 | - |
1093
+ | 0.071 | 7100 | 1.5586 | 0.5474 |
1094
+ | 0.0711 | 7110 | 1.5468 | - |
1095
+ | 0.0712 | 7120 | 1.5503 | - |
1096
+ | 0.0713 | 7130 | 1.5514 | - |
1097
+ | 0.0714 | 7140 | 1.5584 | - |
1098
+ | 0.0715 | 7150 | 1.5471 | - |
1099
+ | 0.0716 | 7160 | 1.5462 | - |
1100
+ | 0.0717 | 7170 | 1.5498 | - |
1101
+ | 0.0718 | 7180 | 1.558 | - |
1102
+ | 0.0719 | 7190 | 1.5495 | - |
1103
+ | 0.072 | 7200 | 1.5585 | 0.5486 |
1104
+ | 0.0721 | 7210 | 1.536 | - |
1105
+ | 0.0722 | 7220 | 1.5493 | - |
1106
+ | 0.0723 | 7230 | 1.5442 | - |
1107
+ | 0.0724 | 7240 | 1.5409 | - |
1108
+ | 0.0725 | 7250 | 1.536 | - |
1109
+ | 0.0726 | 7260 | 1.5674 | - |
1110
+ | 0.0727 | 7270 | 1.5595 | - |
1111
+ | 0.0728 | 7280 | 1.5184 | - |
1112
+ | 0.0729 | 7290 | 1.5694 | - |
1113
+ | 0.073 | 7300 | 1.5593 | 0.5513 |
1114
+ | 0.0731 | 7310 | 1.5766 | - |
1115
+ | 0.0732 | 7320 | 1.5562 | - |
1116
+ | 0.0733 | 7330 | 1.5872 | - |
1117
+ | 0.0734 | 7340 | 1.5705 | - |
1118
+ | 0.0735 | 7350 | 1.5622 | - |
1119
+ | 0.0736 | 7360 | 1.5577 | - |
1120
+ | 0.0737 | 7370 | 1.5422 | - |
1121
+ | 0.0738 | 7380 | 1.5643 | - |
1122
+ | 0.0739 | 7390 | 1.5713 | - |
1123
+ | 0.074 | 7400 | 1.533 | 0.5500 |
1124
+ | 0.0741 | 7410 | 1.5204 | - |
1125
+ | 0.0742 | 7420 | 1.5445 | - |
1126
+ | 0.0743 | 7430 | 1.5503 | - |
1127
+ | 0.0744 | 7440 | 1.5243 | - |
1128
+ | 0.0745 | 7450 | 1.5465 | - |
1129
+ | 0.0746 | 7460 | 1.559 | - |
1130
+ | 0.0747 | 7470 | 1.5493 | - |
1131
+ | 0.0748 | 7480 | 1.5589 | - |
1132
+ | 0.0749 | 7490 | 1.5637 | - |
1133
+ | 0.075 | 7500 | 1.5547 | 0.5484 |
1134
+ | 0.0751 | 7510 | 1.5296 | - |
1135
+ | 0.0752 | 7520 | 1.5466 | - |
1136
+ | 0.0753 | 7530 | 1.5259 | - |
1137
+ | 0.0754 | 7540 | 1.5496 | - |
1138
+ | 0.0755 | 7550 | 1.5273 | - |
1139
+ | 0.0756 | 7560 | 1.5606 | - |
1140
+ | 0.0757 | 7570 | 1.5408 | - |
1141
+ | 0.0758 | 7580 | 1.5529 | - |
1142
+ | 0.0759 | 7590 | 1.5481 | - |
1143
+ | 0.076 | 7600 | 1.5571 | 0.5541 |
1144
+ | 0.0761 | 7610 | 1.5322 | - |
1145
+ | 0.0762 | 7620 | 1.567 | - |
1146
+ | 0.0763 | 7630 | 1.5387 | - |
1147
+ | 0.0764 | 7640 | 1.554 | - |
1148
+ | 0.0765 | 7650 | 1.5284 | - |
1149
+ | 0.0766 | 7660 | 1.5255 | - |
1150
+ | 0.0767 | 7670 | 1.5421 | - |
1151
+ | 0.0768 | 7680 | 1.5538 | - |
1152
+ | 0.0769 | 7690 | 1.5309 | - |
1153
+ | 0.077 | 7700 | 1.549 | 0.5519 |
1154
+ | 0.0771 | 7710 | 1.5373 | - |
1155
+ | 0.0772 | 7720 | 1.5315 | - |
1156
+ | 0.0773 | 7730 | 1.5345 | - |
1157
+ | 0.0774 | 7740 | 1.56 | - |
1158
+ | 0.0775 | 7750 | 1.5678 | - |
1159
+ | 0.0776 | 7760 | 1.5653 | - |
1160
+ | 0.0777 | 7770 | 1.521 | - |
1161
+ | 0.0778 | 7780 | 1.5377 | - |
1162
+ | 0.0779 | 7790 | 1.5518 | - |
1163
+ | 0.078 | 7800 | 1.5454 | 0.5490 |
1164
+ | 0.0781 | 7810 | 1.5227 | - |
1165
+ | 0.0782 | 7820 | 1.5604 | - |
1166
+ | 0.0783 | 7830 | 1.5283 | - |
1167
+ | 0.0784 | 7840 | 1.5448 | - |
1168
+ | 0.0785 | 7850 | 1.5116 | - |
1169
+ | 0.0786 | 7860 | 1.5223 | - |
1170
+ | 0.0787 | 7870 | 1.5497 | - |
1171
+ | 0.0788 | 7880 | 1.5417 | - |
1172
+ | 0.0789 | 7890 | 1.5358 | - |
1173
+ | 0.079 | 7900 | 1.5504 | 0.5544 |
1174
+ | 0.0791 | 7910 | 1.516 | - |
1175
+ | 0.0792 | 7920 | 1.5422 | - |
1176
+ | 0.0793 | 7930 | 1.537 | - |
1177
+ | 0.0794 | 7940 | 1.5479 | - |
1178
+ | 0.0795 | 7950 | 1.5579 | - |
1179
+ | 0.0796 | 7960 | 1.5369 | - |
1180
+ | 0.0797 | 7970 | 1.5321 | - |
1181
+ | 0.0798 | 7980 | 1.522 | - |
1182
+ | 0.0799 | 7990 | 1.5389 | - |
1183
+ | 0.08 | 8000 | 1.5274 | 0.5526 |
1184
+ | 0.0801 | 8010 | 1.5537 | - |
1185
+ | 0.0802 | 8020 | 1.5397 | - |
1186
+ | 0.0803 | 8030 | 1.5671 | - |
1187
+ | 0.0804 | 8040 | 1.5349 | - |
1188
+ | 0.0805 | 8050 | 1.5407 | - |
1189
+ | 0.0806 | 8060 | 1.5563 | - |
1190
+ | 0.0807 | 8070 | 1.5581 | - |
1191
+ | 0.0808 | 8080 | 1.5423 | - |
1192
+ | 0.0809 | 8090 | 1.5148 | - |
1193
+ | 0.081 | 8100 | 1.5557 | 0.5544 |
1194
+ | 0.0811 | 8110 | 1.5404 | - |
1195
+ | 0.0812 | 8120 | 1.5368 | - |
1196
+ | 0.0813 | 8130 | 1.5161 | - |
1197
+ | 0.0814 | 8140 | 1.5595 | - |
1198
+ | 0.0815 | 8150 | 1.5493 | - |
1199
+ | 0.0816 | 8160 | 1.5312 | - |
1200
+ | 0.0817 | 8170 | 1.5326 | - |
1201
+ | 0.0818 | 8180 | 1.5424 | - |
1202
+ | 0.0819 | 8190 | 1.5325 | - |
1203
+ | 0.082 | 8200 | 1.5458 | 0.5561 |
1204
+ | 0.0821 | 8210 | 1.5397 | - |
1205
+ | 0.0822 | 8220 | 1.5438 | - |
1206
+ | 0.0823 | 8230 | 1.5237 | - |
1207
+ | 0.0824 | 8240 | 1.5396 | - |
1208
+ | 0.0825 | 8250 | 1.5365 | - |
1209
+ | 0.0826 | 8260 | 1.5609 | - |
1210
+ | 0.0827 | 8270 | 1.533 | - |
1211
+ | 0.0828 | 8280 | 1.5367 | - |
1212
+ | 0.0829 | 8290 | 1.5316 | - |
1213
+ | 0.083 | 8300 | 1.5386 | 0.5528 |
1214
+ | 0.0831 | 8310 | 1.5259 | - |
1215
+ | 0.0832 | 8320 | 1.5205 | - |
1216
+ | 0.0833 | 8330 | 1.5561 | - |
1217
+ | 0.0834 | 8340 | 1.533 | - |
1218
+ | 0.0835 | 8350 | 1.5684 | - |
1219
+ | 0.0836 | 8360 | 1.5475 | - |
1220
+ | 0.0837 | 8370 | 1.5195 | - |
1221
+ | 0.0838 | 8380 | 1.5388 | - |
1222
+ | 0.0839 | 8390 | 1.564 | - |
1223
+ | 0.084 | 8400 | 1.5572 | 0.5490 |
1224
+ | 0.0841 | 8410 | 1.5567 | - |
1225
+ | 0.0842 | 8420 | 1.5383 | - |
1226
+ | 0.0843 | 8430 | 1.5645 | - |
1227
+ | 0.0844 | 8440 | 1.5499 | - |
1228
+ | 0.0845 | 8450 | 1.5267 | - |
1229
+ | 0.0846 | 8460 | 1.5538 | - |
1230
+ | 0.0847 | 8470 | 1.5635 | - |
1231
+ | 0.0848 | 8480 | 1.5365 | - |
1232
+ | 0.0849 | 8490 | 1.5374 | - |
1233
+ | 0.085 | 8500 | 1.5453 | 0.5507 |
1234
+ | 0.0851 | 8510 | 1.5155 | - |
1235
+ | 0.0852 | 8520 | 1.5505 | - |
1236
+ | 0.0853 | 8530 | 1.5381 | - |
1237
+ | 0.0854 | 8540 | 1.5337 | - |
1238
+ | 0.0855 | 8550 | 1.5475 | - |
1239
+ | 0.0856 | 8560 | 1.5421 | - |
1240
+ | 0.0857 | 8570 | 1.5318 | - |
1241
+ | 0.0858 | 8580 | 1.5404 | - |
1242
+ | 0.0859 | 8590 | 1.5227 | - |
1243
+ | 0.086 | 8600 | 1.5323 | 0.5498 |
1244
+ | 0.0861 | 8610 | 1.5245 | - |
1245
+ | 0.0862 | 8620 | 1.5435 | - |
1246
+ | 0.0863 | 8630 | 1.5516 | - |
1247
+ | 0.0864 | 8640 | 1.5394 | - |
1248
+ | 0.0865 | 8650 | 1.5141 | - |
1249
+ | 0.0866 | 8660 | 1.5289 | - |
1250
+ | 0.0867 | 8670 | 1.5191 | - |
1251
+ | 0.0868 | 8680 | 1.5349 | - |
1252
+ | 0.0869 | 8690 | 1.5507 | - |
1253
+ | 0.087 | 8700 | 1.5337 | 0.5532 |
1254
+ | 0.0871 | 8710 | 1.5471 | - |
1255
+ | 0.0872 | 8720 | 1.5267 | - |
1256
+ | 0.0873 | 8730 | 1.5308 | - |
1257
+ | 0.0874 | 8740 | 1.5576 | - |
1258
+ | 0.0875 | 8750 | 1.5424 | - |
1259
+ | 0.0876 | 8760 | 1.5518 | - |
1260
+ | 0.0877 | 8770 | 1.5316 | - |
1261
+ | 0.0878 | 8780 | 1.5369 | - |
1262
+ | 0.0879 | 8790 | 1.5412 | - |
1263
+ | 0.088 | 8800 | 1.5407 | 0.5487 |
1264
+ | 0.0881 | 8810 | 1.5257 | - |
1265
+ | 0.0882 | 8820 | 1.5318 | - |
1266
+ | 0.0883 | 8830 | 1.5214 | - |
1267
+ | 0.0884 | 8840 | 1.5321 | - |
1268
+ | 0.0885 | 8850 | 1.5282 | - |
1269
+ | 0.0886 | 8860 | 1.5262 | - |
1270
+ | 0.0887 | 8870 | 1.5545 | - |
1271
+ | 0.0888 | 8880 | 1.5407 | - |
1272
+ | 0.0889 | 8890 | 1.564 | - |
1273
+ | 0.089 | 8900 | 1.5287 | 0.5518 |
1274
+ | 0.0891 | 8910 | 1.5353 | - |
1275
+ | 0.0892 | 8920 | 1.5155 | - |
1276
+ | 0.0893 | 8930 | 1.5416 | - |
1277
+ | 0.0894 | 8940 | 1.546 | - |
1278
+ | 0.0895 | 8950 | 1.5349 | - |
1279
+ | 0.0896 | 8960 | 1.5203 | - |
1280
+ | 0.0897 | 8970 | 1.5282 | - |
1281
+ | 0.0898 | 8980 | 1.5111 | - |
1282
+ | 0.0899 | 8990 | 1.5121 | - |
1283
+ | 0.09 | 9000 | 1.5209 | 0.5519 |
1284
+ | 0.0901 | 9010 | 1.5333 | - |
1285
+ | 0.0902 | 9020 | 1.5305 | - |
1286
+ | 0.0903 | 9030 | 1.5397 | - |
1287
+ | 0.0904 | 9040 | 1.523 | - |
1288
+ | 0.0905 | 9050 | 1.5446 | - |
1289
+ | 0.0906 | 9060 | 1.5378 | - |
1290
+ | 0.0907 | 9070 | 1.533 | - |
1291
+ | 0.0908 | 9080 | 1.5271 | - |
1292
+ | 0.0909 | 9090 | 1.5201 | - |
1293
+ | 0.091 | 9100 | 1.526 | 0.5524 |
1294
+ | 0.0911 | 9110 | 1.5307 | - |
1295
+ | 0.0912 | 9120 | 1.572 | - |
1296
+ | 0.0913 | 9130 | 1.5016 | - |
1297
+ | 0.0914 | 9140 | 1.526 | - |
1298
+ | 0.0915 | 9150 | 1.5326 | - |
1299
+ | 0.0916 | 9160 | 1.5189 | - |
1300
+ | 0.0917 | 9170 | 1.5298 | - |
1301
+ | 0.0918 | 9180 | 1.5211 | - |
1302
+ | 0.0919 | 9190 | 1.5237 | - |
1303
+ | 0.092 | 9200 | 1.5121 | 0.5497 |
1304
+ | 0.0921 | 9210 | 1.4938 | - |
1305
+ | 0.0922 | 9220 | 1.5094 | - |
1306
+ | 0.0923 | 9230 | 1.5265 | - |
1307
+ | 0.0924 | 9240 | 1.5278 | - |
1308
+ | 0.0925 | 9250 | 1.5255 | - |
1309
+ | 0.0926 | 9260 | 1.4975 | - |
1310
+ | 0.0927 | 9270 | 1.5117 | - |
1311
+ | 0.0928 | 9280 | 1.5378 | - |
1312
+ | 0.0929 | 9290 | 1.5248 | - |
1313
+ | 0.093 | 9300 | 1.5222 | 0.5531 |
1314
+ | 0.0931 | 9310 | 1.5056 | - |
1315
+ | 0.0932 | 9320 | 1.5361 | - |
1316
+ | 0.0933 | 9330 | 1.5426 | - |
1317
+ | 0.0934 | 9340 | 1.5023 | - |
1318
+ | 0.0935 | 9350 | 1.5056 | - |
1319
+ | 0.0936 | 9360 | 1.5058 | - |
1320
+ | 0.0937 | 9370 | 1.5299 | - |
1321
+ | 0.0938 | 9380 | 1.5178 | - |
1322
+ | 0.0939 | 9390 | 1.532 | - |
1323
+ | 0.094 | 9400 | 1.5248 | 0.5577 |
1324
+ | 0.0941 | 9410 | 1.5374 | - |
1325
+ | 0.0942 | 9420 | 1.518 | - |
1326
+ | 0.0943 | 9430 | 1.5299 | - |
1327
+ | 0.0944 | 9440 | 1.5432 | - |
1328
+ | 0.0945 | 9450 | 1.5164 | - |
1329
+ | 0.0946 | 9460 | 1.5252 | - |
1330
+ | 0.0947 | 9470 | 1.5327 | - |
1331
+ | 0.0948 | 9480 | 1.5519 | - |
1332
+ | 0.0949 | 9490 | 1.5077 | - |
1333
+ | 0.095 | 9500 | 1.5322 | 0.5550 |
1334
+ | 0.0951 | 9510 | 1.5358 | - |
1335
+ | 0.0952 | 9520 | 1.5362 | - |
1336
+ | 0.0953 | 9530 | 1.5262 | - |
1337
+ | 0.0954 | 9540 | 1.5286 | - |
1338
+ | 0.0955 | 9550 | 1.5205 | - |
1339
+ | 0.0956 | 9560 | 1.5372 | - |
1340
+ | 0.0957 | 9570 | 1.5248 | - |
1341
+ | 0.0958 | 9580 | 1.5457 | - |
1342
+ | 0.0959 | 9590 | 1.5087 | - |
1343
+ | 0.096 | 9600 | 1.531 | 0.5523 |
1344
+ | 0.0961 | 9610 | 1.5057 | - |
1345
+ | 0.0962 | 9620 | 1.5295 | - |
1346
+ | 0.0963 | 9630 | 1.52 | - |
1347
+ | 0.0964 | 9640 | 1.5131 | - |
1348
+ | 0.0965 | 9650 | 1.5272 | - |
1349
+ | 0.0966 | 9660 | 1.5161 | - |
1350
+ | 0.0967 | 9670 | 1.5178 | - |
1351
+ | 0.0968 | 9680 | 1.5452 | - |
1352
+ | 0.0969 | 9690 | 1.5216 | - |
1353
+ | 0.097 | 9700 | 1.5471 | 0.5541 |
1354
+ | 0.0971 | 9710 | 1.5233 | - |
1355
+ | 0.0972 | 9720 | 1.5388 | - |
1356
+ | 0.0973 | 9730 | 1.5173 | - |
1357
+ | 0.0974 | 9740 | 1.5223 | - |
1358
+ | 0.0975 | 9750 | 1.5193 | - |
1359
+ | 0.0976 | 9760 | 1.5143 | - |
1360
+ | 0.0977 | 9770 | 1.5245 | - |
1361
+ | 0.0978 | 9780 | 1.5368 | - |
1362
+ | 0.0979 | 9790 | 1.5237 | - |
1363
+ | 0.098 | 9800 | 1.5077 | 0.5545 |
1364
+ | 0.0981 | 9810 | 1.5276 | - |
1365
+ | 0.0982 | 9820 | 1.5117 | - |
1366
+ | 0.0983 | 9830 | 1.5174 | - |
1367
+ | 0.0984 | 9840 | 1.5359 | - |
1368
+ | 0.0985 | 9850 | 1.5145 | - |
1369
+ | 0.0986 | 9860 | 1.5355 | - |
1370
+ | 0.0987 | 9870 | 1.4959 | - |
1371
+ | 0.0988 | 9880 | 1.5106 | - |
1372
+ | 0.0989 | 9890 | 1.5567 | - |
1373
+ | 0.099 | 9900 | 1.5102 | 0.5508 |
1374
+ | 0.0991 | 9910 | 1.5255 | - |
1375
+ | 0.0992 | 9920 | 1.4878 | - |
1376
+ | 0.0993 | 9930 | 1.522 | - |
1377
+ | 0.0994 | 9940 | 1.5296 | - |
1378
+ | 0.0995 | 9950 | 1.4935 | - |
1379
+ | 0.0996 | 9960 | 1.5081 | - |
1380
+ | 0.0997 | 9970 | 1.5163 | - |
1381
+ | 0.0998 | 9980 | 1.5267 | - |
1382
+ | 0.0999 | 9990 | 1.5361 | - |
1383
+ | 0.1 | 10000 | 1.5067 | 0.5510 |
1384
+
1385
+ </details>
1386
+
1387
+ ### Framework Versions
1388
+ - Python: 3.12.12
1389
+ - Sentence Transformers: 5.2.0
1390
+ - Transformers: 4.57.3
1391
+ - PyTorch: 2.9.0+cu128
1392
+ - Accelerate: 1.12.0
1393
+ - Datasets: 4.4.2
1394
+ - Tokenizers: 0.22.1
1395
+
1396
+ ## Citation
1397
+
1398
+ ### BibTeX
1399
+
1400
+ #### Sentence Transformers
1401
+ ```bibtex
1402
+ @inproceedings{reimers-2019-sentence-bert,
1403
+ title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
1404
+ author = "Reimers, Nils and Gurevych, Iryna",
1405
+ booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
1406
+ month = "11",
1407
+ year = "2019",
1408
+ publisher = "Association for Computational Linguistics",
1409
+ url = "https://arxiv.org/abs/1908.10084",
1410
+ }
1411
+ ```
1412
+
1413
+ #### CachedMultipleNegativesRankingLoss
1414
+ ```bibtex
1415
+ @misc{gao2021scaling,
1416
+ title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
1417
+ author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
1418
+ year={2021},
1419
+ eprint={2101.06983},
1420
+ archivePrefix={arXiv},
1421
+ primaryClass={cs.LG}
1422
+ }
1423
+ ```
1424
+
1425
+ <!--
1426
+ ## Glossary
1427
+
1428
+ *Clearly define terms in order to be accessible across audiences.*
1429
+ -->
1430
+
1431
+ <!--
1432
+ ## Model Card Authors
1433
+
1434
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
1435
+ -->
1436
+
1437
+ <!--
1438
+ ## Model Card Contact
1439
+
1440
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
1441
+ -->
added_tokens.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|box_end|>": 151649,
9
+ "<|box_start|>": 151648,
10
+ "<|endoftext|>": 151643,
11
+ "<|file_sep|>": 151664,
12
+ "<|fim_middle|>": 151660,
13
+ "<|fim_pad|>": 151662,
14
+ "<|fim_prefix|>": 151659,
15
+ "<|fim_suffix|>": 151661,
16
+ "<|im_end|>": 151645,
17
+ "<|im_start|>": 151644,
18
+ "<|image_pad|>": 151655,
19
+ "<|object_ref_end|>": 151647,
20
+ "<|object_ref_start|>": 151646,
21
+ "<|quad_end|>": 151651,
22
+ "<|quad_start|>": 151650,
23
+ "<|repo_name|>": 151663,
24
+ "<|video_pad|>": 151656,
25
+ "<|vision_end|>": 151653,
26
+ "<|vision_pad|>": 151654,
27
+ "<|vision_start|>": 151652
28
+ }
chat_template.jinja ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- if tools %}
2
+ {{- '<|im_start|>system\n' }}
3
+ {%- if messages[0].role == 'system' %}
4
+ {{- messages[0].content + '\n\n' }}
5
+ {%- endif %}
6
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
7
+ {%- for tool in tools %}
8
+ {{- "\n" }}
9
+ {{- tool | tojson }}
10
+ {%- endfor %}
11
+ {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
12
+ {%- else %}
13
+ {%- if messages[0].role == 'system' %}
14
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
15
+ {%- endif %}
16
+ {%- endif %}
17
+ {%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
18
+ {%- for message in messages[::-1] %}
19
+ {%- set index = (messages|length - 1) - loop.index0 %}
20
+ {%- if ns.multi_step_tool and message.role == "user" and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}
21
+ {%- set ns.multi_step_tool = false %}
22
+ {%- set ns.last_query_index = index %}
23
+ {%- endif %}
24
+ {%- endfor %}
25
+ {%- for message in messages %}
26
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
27
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
28
+ {%- elif message.role == "assistant" %}
29
+ {%- set content = message.content %}
30
+ {%- set reasoning_content = '' %}
31
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
32
+ {%- set reasoning_content = message.reasoning_content %}
33
+ {%- else %}
34
+ {%- if '</think>' in message.content %}
35
+ {%- set content = message.content.split('</think>')[-1].lstrip('\n') %}
36
+ {%- set reasoning_content = message.content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
37
+ {%- endif %}
38
+ {%- endif %}
39
+ {%- if loop.index0 > ns.last_query_index %}
40
+ {%- if loop.last or (not loop.last and reasoning_content) %}
41
+ {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
42
+ {%- else %}
43
+ {{- '<|im_start|>' + message.role + '\n' + content }}
44
+ {%- endif %}
45
+ {%- else %}
46
+ {{- '<|im_start|>' + message.role + '\n' + content }}
47
+ {%- endif %}
48
+ {%- if message.tool_calls %}
49
+ {%- for tool_call in message.tool_calls %}
50
+ {%- if (loop.first and content) or (not loop.first) %}
51
+ {{- '\n' }}
52
+ {%- endif %}
53
+ {%- if tool_call.function %}
54
+ {%- set tool_call = tool_call.function %}
55
+ {%- endif %}
56
+ {{- '<tool_call>\n{"name": "' }}
57
+ {{- tool_call.name }}
58
+ {{- '", "arguments": ' }}
59
+ {%- if tool_call.arguments is string %}
60
+ {{- tool_call.arguments }}
61
+ {%- else %}
62
+ {{- tool_call.arguments | tojson }}
63
+ {%- endif %}
64
+ {{- '}\n</tool_call>' }}
65
+ {%- endfor %}
66
+ {%- endif %}
67
+ {{- '<|im_end|>\n' }}
68
+ {%- elif message.role == "tool" %}
69
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
70
+ {{- '<|im_start|>user' }}
71
+ {%- endif %}
72
+ {{- '\n<tool_response>\n' }}
73
+ {{- message.content }}
74
+ {{- '\n</tool_response>' }}
75
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
76
+ {{- '<|im_end|>\n' }}
77
+ {%- endif %}
78
+ {%- endif %}
79
+ {%- endfor %}
80
+ {%- if add_generation_prompt %}
81
+ {{- '<|im_start|>assistant\n' }}
82
+ {%- if enable_thinking is defined and enable_thinking is false %}
83
+ {{- '<think>\n\n</think>\n\n' }}
84
+ {%- endif %}
85
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3Model"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 151643,
8
+ "dtype": "float32",
9
+ "eos_token_id": 151643,
10
+ "head_dim": 128,
11
+ "hidden_act": "silu",
12
+ "hidden_size": 2048,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 6144,
15
+ "layer_types": [
16
+ "full_attention",
17
+ "full_attention",
18
+ "full_attention",
19
+ "full_attention",
20
+ "full_attention",
21
+ "full_attention",
22
+ "full_attention",
23
+ "full_attention",
24
+ "full_attention",
25
+ "full_attention",
26
+ "full_attention",
27
+ "full_attention",
28
+ "full_attention",
29
+ "full_attention",
30
+ "full_attention",
31
+ "full_attention",
32
+ "full_attention",
33
+ "full_attention",
34
+ "full_attention",
35
+ "full_attention",
36
+ "full_attention",
37
+ "full_attention",
38
+ "full_attention",
39
+ "full_attention",
40
+ "full_attention",
41
+ "full_attention",
42
+ "full_attention",
43
+ "full_attention"
44
+ ],
45
+ "max_position_embeddings": 32768,
46
+ "max_window_layers": 28,
47
+ "model_type": "qwen3",
48
+ "num_attention_heads": 16,
49
+ "num_hidden_layers": 28,
50
+ "num_key_value_heads": 8,
51
+ "rms_norm_eps": 1e-06,
52
+ "rope_scaling": null,
53
+ "rope_theta": 1000000,
54
+ "sliding_window": null,
55
+ "tie_word_embeddings": true,
56
+ "transformers_version": "4.57.3",
57
+ "use_cache": true,
58
+ "use_sliding_window": false,
59
+ "vocab_size": 151936
60
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "SentenceTransformer",
3
+ "__version__": {
4
+ "sentence_transformers": "5.2.0",
5
+ "transformers": "4.57.3",
6
+ "pytorch": "2.7.1+cu126"
7
+ },
8
+ "prompts": {
9
+ "query": "",
10
+ "document": ""
11
+ },
12
+ "default_prompt_name": null,
13
+ "similarity_fn_name": "cosine"
14
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model-00001-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfa6a033edc25bfb2704bcbcd69cec1dac2d9ea9e491b30cddc0eb744ec5ed6c
3
+ size 4969538328
model-00002-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b2bd434fbda72bb62d87de7ad875e989d3fb921321301b96fb74a3e13329eb5
3
+ size 1912795064
model.safetensors.index.json ADDED
@@ -0,0 +1,318 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_parameters": 1720574976,
4
+ "total_size": 6882299904
5
+ },
6
+ "weight_map": {
7
+ "embed_tokens.weight": "model-00001-of-00002.safetensors",
8
+ "layers.0.input_layernorm.weight": "model-00001-of-00002.safetensors",
9
+ "layers.0.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
10
+ "layers.0.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
11
+ "layers.0.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
12
+ "layers.0.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
13
+ "layers.0.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
14
+ "layers.0.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
15
+ "layers.0.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
16
+ "layers.0.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
17
+ "layers.0.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
18
+ "layers.0.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
19
+ "layers.1.input_layernorm.weight": "model-00001-of-00002.safetensors",
20
+ "layers.1.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
21
+ "layers.1.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
22
+ "layers.1.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
23
+ "layers.1.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
24
+ "layers.1.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
25
+ "layers.1.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
26
+ "layers.1.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
27
+ "layers.1.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
28
+ "layers.1.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
29
+ "layers.1.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
30
+ "layers.10.input_layernorm.weight": "model-00001-of-00002.safetensors",
31
+ "layers.10.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
32
+ "layers.10.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
33
+ "layers.10.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
34
+ "layers.10.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
35
+ "layers.10.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
36
+ "layers.10.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
37
+ "layers.10.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
38
+ "layers.10.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
39
+ "layers.10.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
40
+ "layers.10.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
41
+ "layers.11.input_layernorm.weight": "model-00001-of-00002.safetensors",
42
+ "layers.11.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
43
+ "layers.11.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
44
+ "layers.11.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
45
+ "layers.11.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
46
+ "layers.11.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
47
+ "layers.11.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
48
+ "layers.11.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
49
+ "layers.11.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
50
+ "layers.11.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
51
+ "layers.11.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
52
+ "layers.12.input_layernorm.weight": "model-00001-of-00002.safetensors",
53
+ "layers.12.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
54
+ "layers.12.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
55
+ "layers.12.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
56
+ "layers.12.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
57
+ "layers.12.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
58
+ "layers.12.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
59
+ "layers.12.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
60
+ "layers.12.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
61
+ "layers.12.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
62
+ "layers.12.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
63
+ "layers.13.input_layernorm.weight": "model-00001-of-00002.safetensors",
64
+ "layers.13.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
65
+ "layers.13.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
66
+ "layers.13.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
67
+ "layers.13.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
68
+ "layers.13.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
69
+ "layers.13.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
70
+ "layers.13.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
71
+ "layers.13.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
72
+ "layers.13.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
73
+ "layers.13.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
74
+ "layers.14.input_layernorm.weight": "model-00001-of-00002.safetensors",
75
+ "layers.14.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
76
+ "layers.14.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
77
+ "layers.14.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
78
+ "layers.14.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
79
+ "layers.14.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
80
+ "layers.14.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
81
+ "layers.14.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
82
+ "layers.14.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
83
+ "layers.14.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
84
+ "layers.14.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
85
+ "layers.15.input_layernorm.weight": "model-00001-of-00002.safetensors",
86
+ "layers.15.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
87
+ "layers.15.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
88
+ "layers.15.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
89
+ "layers.15.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
90
+ "layers.15.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
91
+ "layers.15.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
92
+ "layers.15.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
93
+ "layers.15.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
94
+ "layers.15.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
95
+ "layers.15.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
96
+ "layers.16.input_layernorm.weight": "model-00001-of-00002.safetensors",
97
+ "layers.16.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
98
+ "layers.16.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
99
+ "layers.16.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
100
+ "layers.16.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
101
+ "layers.16.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
102
+ "layers.16.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
103
+ "layers.16.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
104
+ "layers.16.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
105
+ "layers.16.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
106
+ "layers.16.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
107
+ "layers.17.input_layernorm.weight": "model-00001-of-00002.safetensors",
108
+ "layers.17.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
109
+ "layers.17.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
110
+ "layers.17.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
111
+ "layers.17.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
112
+ "layers.17.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
113
+ "layers.17.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
114
+ "layers.17.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
115
+ "layers.17.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
116
+ "layers.17.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
117
+ "layers.17.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
118
+ "layers.18.input_layernorm.weight": "model-00002-of-00002.safetensors",
119
+ "layers.18.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
120
+ "layers.18.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
121
+ "layers.18.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
122
+ "layers.18.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
123
+ "layers.18.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
124
+ "layers.18.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
125
+ "layers.18.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
126
+ "layers.18.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
127
+ "layers.18.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
128
+ "layers.18.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
129
+ "layers.19.input_layernorm.weight": "model-00002-of-00002.safetensors",
130
+ "layers.19.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
131
+ "layers.19.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
132
+ "layers.19.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
133
+ "layers.19.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
134
+ "layers.19.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
135
+ "layers.19.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
136
+ "layers.19.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
137
+ "layers.19.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
138
+ "layers.19.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
139
+ "layers.19.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
140
+ "layers.2.input_layernorm.weight": "model-00001-of-00002.safetensors",
141
+ "layers.2.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
142
+ "layers.2.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
143
+ "layers.2.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
144
+ "layers.2.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
145
+ "layers.2.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
146
+ "layers.2.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
147
+ "layers.2.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
148
+ "layers.2.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
149
+ "layers.2.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
150
+ "layers.2.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
151
+ "layers.20.input_layernorm.weight": "model-00002-of-00002.safetensors",
152
+ "layers.20.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
153
+ "layers.20.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
154
+ "layers.20.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
155
+ "layers.20.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
156
+ "layers.20.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
157
+ "layers.20.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
158
+ "layers.20.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
159
+ "layers.20.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
160
+ "layers.20.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
161
+ "layers.20.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
162
+ "layers.21.input_layernorm.weight": "model-00002-of-00002.safetensors",
163
+ "layers.21.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
164
+ "layers.21.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
165
+ "layers.21.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
166
+ "layers.21.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
167
+ "layers.21.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
168
+ "layers.21.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
169
+ "layers.21.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
170
+ "layers.21.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
171
+ "layers.21.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
172
+ "layers.21.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
173
+ "layers.22.input_layernorm.weight": "model-00002-of-00002.safetensors",
174
+ "layers.22.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
175
+ "layers.22.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
176
+ "layers.22.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
177
+ "layers.22.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
178
+ "layers.22.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
179
+ "layers.22.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
180
+ "layers.22.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
181
+ "layers.22.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
182
+ "layers.22.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
183
+ "layers.22.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
184
+ "layers.23.input_layernorm.weight": "model-00002-of-00002.safetensors",
185
+ "layers.23.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
186
+ "layers.23.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
187
+ "layers.23.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
188
+ "layers.23.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
189
+ "layers.23.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
190
+ "layers.23.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
191
+ "layers.23.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
192
+ "layers.23.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
193
+ "layers.23.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
194
+ "layers.23.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
195
+ "layers.24.input_layernorm.weight": "model-00002-of-00002.safetensors",
196
+ "layers.24.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
197
+ "layers.24.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
198
+ "layers.24.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
199
+ "layers.24.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
200
+ "layers.24.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
201
+ "layers.24.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
202
+ "layers.24.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
203
+ "layers.24.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
204
+ "layers.24.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
205
+ "layers.24.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
206
+ "layers.25.input_layernorm.weight": "model-00002-of-00002.safetensors",
207
+ "layers.25.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
208
+ "layers.25.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
209
+ "layers.25.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
210
+ "layers.25.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
211
+ "layers.25.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
212
+ "layers.25.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
213
+ "layers.25.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
214
+ "layers.25.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
215
+ "layers.25.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
216
+ "layers.25.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
217
+ "layers.26.input_layernorm.weight": "model-00002-of-00002.safetensors",
218
+ "layers.26.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
219
+ "layers.26.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
220
+ "layers.26.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
221
+ "layers.26.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
222
+ "layers.26.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
223
+ "layers.26.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
224
+ "layers.26.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
225
+ "layers.26.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
226
+ "layers.26.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
227
+ "layers.26.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
228
+ "layers.27.input_layernorm.weight": "model-00002-of-00002.safetensors",
229
+ "layers.27.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
230
+ "layers.27.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
231
+ "layers.27.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
232
+ "layers.27.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
233
+ "layers.27.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
234
+ "layers.27.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
235
+ "layers.27.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
236
+ "layers.27.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
237
+ "layers.27.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
238
+ "layers.27.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
239
+ "layers.3.input_layernorm.weight": "model-00001-of-00002.safetensors",
240
+ "layers.3.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
241
+ "layers.3.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
242
+ "layers.3.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
243
+ "layers.3.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
244
+ "layers.3.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
245
+ "layers.3.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
246
+ "layers.3.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
247
+ "layers.3.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
248
+ "layers.3.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
249
+ "layers.3.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
250
+ "layers.4.input_layernorm.weight": "model-00001-of-00002.safetensors",
251
+ "layers.4.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
252
+ "layers.4.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
253
+ "layers.4.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
254
+ "layers.4.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
255
+ "layers.4.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
256
+ "layers.4.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
257
+ "layers.4.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
258
+ "layers.4.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
259
+ "layers.4.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
260
+ "layers.4.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
261
+ "layers.5.input_layernorm.weight": "model-00001-of-00002.safetensors",
262
+ "layers.5.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
263
+ "layers.5.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
264
+ "layers.5.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
265
+ "layers.5.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
266
+ "layers.5.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
267
+ "layers.5.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
268
+ "layers.5.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
269
+ "layers.5.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
270
+ "layers.5.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
271
+ "layers.5.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
272
+ "layers.6.input_layernorm.weight": "model-00001-of-00002.safetensors",
273
+ "layers.6.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
274
+ "layers.6.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
275
+ "layers.6.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
276
+ "layers.6.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
277
+ "layers.6.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
278
+ "layers.6.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
279
+ "layers.6.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
280
+ "layers.6.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
281
+ "layers.6.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
282
+ "layers.6.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
283
+ "layers.7.input_layernorm.weight": "model-00001-of-00002.safetensors",
284
+ "layers.7.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
285
+ "layers.7.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
286
+ "layers.7.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
287
+ "layers.7.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
288
+ "layers.7.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
289
+ "layers.7.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
290
+ "layers.7.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
291
+ "layers.7.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
292
+ "layers.7.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
293
+ "layers.7.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
294
+ "layers.8.input_layernorm.weight": "model-00001-of-00002.safetensors",
295
+ "layers.8.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
296
+ "layers.8.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
297
+ "layers.8.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
298
+ "layers.8.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
299
+ "layers.8.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
300
+ "layers.8.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
301
+ "layers.8.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
302
+ "layers.8.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
303
+ "layers.8.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
304
+ "layers.8.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
305
+ "layers.9.input_layernorm.weight": "model-00001-of-00002.safetensors",
306
+ "layers.9.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
307
+ "layers.9.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
308
+ "layers.9.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
309
+ "layers.9.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
310
+ "layers.9.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
311
+ "layers.9.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
312
+ "layers.9.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
313
+ "layers.9.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
314
+ "layers.9.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
315
+ "layers.9.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
316
+ "norm.weight": "model-00002-of-00002.safetensors"
317
+ }
318
+ }
modules.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ }
14
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 32768,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|object_ref_start|>",
6
+ "<|object_ref_end|>",
7
+ "<|box_start|>",
8
+ "<|box_end|>",
9
+ "<|quad_start|>",
10
+ "<|quad_end|>",
11
+ "<|vision_start|>",
12
+ "<|vision_end|>",
13
+ "<|vision_pad|>",
14
+ "<|image_pad|>",
15
+ "<|video_pad|>"
16
+ ],
17
+ "eos_token": {
18
+ "content": "<|endoftext|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ "pad_token": {
25
+ "content": "<|endoftext|>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ }
31
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aed98cff73772352c260a48579f3b212cb2b06ce0553446799ebf0b5465b0673
3
+ size 11422922
tokenizer_config.json ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>"
228
+ ],
229
+ "bos_token": null,
230
+ "clean_up_tokenization_spaces": false,
231
+ "eos_token": "<|endoftext|>",
232
+ "errors": "replace",
233
+ "extra_special_tokens": {},
234
+ "max_length": 32768,
235
+ "model_max_length": 32768,
236
+ "pad_to_multiple_of": null,
237
+ "pad_token": "<|endoftext|>",
238
+ "pad_token_type_id": 0,
239
+ "padding_side": "right",
240
+ "split_special_tokens": false,
241
+ "stride": 0,
242
+ "tokenizer_class": "Qwen2Tokenizer",
243
+ "truncation_side": "right",
244
+ "truncation_strategy": "longest_first",
245
+ "unk_token": null
246
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff