Jerteh355SENTPOS4

This is a positive-polarity classifier for Serbian WordNet synset glosses, fine-tuned from the Jerteh-355 model family. It is a component of the S7 sentiment-lexicon construction method described in:

Saša Petalinkar, Ranka M. Stanković, and Milica Ikonić Nešić (2025). Comparative analysis of methods for creating a sentiment lexicon of the Serbian WordNet. The Electronic Library, 43(4), 547–577. Paper and DOI.

Companion code and sentiment lexicons · Paired classifier · Original base model

Model identity and task

Field	Value
Model ID	Tanor/Jerteh355SENTPOS4
Architecture	RobertaForSequenceClassification
Original base model	jerteh/Jerteh-355
Input	A Serbian synset gloss, representing one lexical meaning
Target	Positive vs non-positive polarity
Dataset expansion iteration	4 (T4)
Label 0	NON-POSITIVE
Label 1	POSITIVE
Derived lexicon family	S7
Paired classifier, same iteration	Tanor/Jerteh355SENTNEG4

The linked training script initializes the classifier from jerteh/Jerteh-355.

A non-positive label is the complement of the target class. It does not by itself mean that the gloss has the opposite polarity. A separate classifier handles that polarity.

Training data and construction method

The paper constructs polarity-labeled synsets from Serbian WordNet, starting from curated positive, negative, and objective seed sets and expanding through semantic relations. The initial sets reported in the paper contain 149 positive, 219 negative, and 19,475 objective synsets. Polarity-preserving relations expand the corresponding set; antonymy contributes to the opposite polarity. The selected datasets are T0, T2, T4, and T6, after zero, two, four, and six expansion iterations.

This checkpoint is associated with T4 and the POS classification task. Its numerical suffix is a dataset-expansion iteration, not an epoch count or a lexicon identifier.

The training script reads Sysnet from X_train_UPPOS4.csv and the target POS from y_train_UPPOS4.csv, replaces missing text with an empty string, and creates a stratified validation subset of 10% of that training CSV, with random_state=42. The UP inputs are the non-lemmatized gloss variant in the dataset-generation script.

The paper and code snapshot have different split descriptions: the paper describes an 80/10/10 split for neural models, while the scripts split existing training CSV files and create_sets.py leaves the initial split size at the library default. Exact checkpoint-specific sample assignments are not supplied in the public revision. The train_sets/ files referenced by the scripts are absent from that revision. Reconstructing the experiment requires the relevant lexical resources and saved preparation/split information; the paper's proportions alone do not establish this checkpoint's split.

Use in sentiment lexicon S7

For each iteration, the POS model estimates positive-class probability p_pos and the NEG model estimates negative-class probability p_neg. The lexicon-building code combines them as:

POS = p_pos * (1 - p_neg)
NEG = p_neg * (1 - p_pos)
OBJ = 1 - POS - NEG

It averages each score across the four iteration-specific pairs. A single checkpoint is one component of this construction; its two class probabilities are not the final three lexicon scores.

Iteration	POS classifier	NEG classifier
0	Jerteh355SENTPOS0	Jerteh355SENTNEG0
2	Jerteh355SENTPOS2	Jerteh355SENTNEG2
4	Jerteh355SENTPOS4	Jerteh355SENTNEG4
6	Jerteh355SENTPOS6	Jerteh355SENTNEG6

Usage

This example reads one gloss and returns both class probabilities. It pins the model to the weights revision present before the documentation update.

import torch
from transformers import AutoModelForSequenceClassification, AutoTokenizer

MODEL_ID = "Tanor/Jerteh355SENTPOS4"
WEIGHTS_REVISION = "c14a556fff4cb20c4910f3f138e522ec0b2fd41c"
tokenizer = AutoTokenizer.from_pretrained(MODEL_ID, revision=WEIGHTS_REVISION)
model = AutoModelForSequenceClassification.from_pretrained(
    MODEL_ID, revision=WEIGHTS_REVISION
)
model.eval()

# An illustrative gloss, not a benchmark item or a claimed prediction.
inputs = tokenizer(
    "koji oseća radost i zadovoljstvo",
    return_tensors="pt", truncation=True, max_length=300,
)
with torch.inference_mode():
    probabilities = model(**inputs).logits.softmax(dim=-1)[0]
scores = {model.config.id2label[i]: float(p) for i, p in enumerate(probabilities)}
print(scores)

The model uses standard PyTorch/Transformers sequence-classification classes, without custom remote code. The example requires PyTorch and Transformers. Where a Trainer record is available below, it includes software versions from the original run. No example prediction or benchmark score was generated for this documentation update.

Evaluation and provenance

Archived test report

The companion repository contains an evaluation report for Jerteh355, POS, T4. It is preserved below, with class 0 = NON-POSITIVE and class 1 = POSITIVE. Metric values retain the source's rounding; support values are sample counts. The confusion matrix uses that class order.

[[4428    6]
 [  40   32]]

              precision    recall  f1-score   support

           0       0.99      1.00      0.99      4434
           1       0.84      0.44      0.58        72

    accuracy                           0.99      4506
   macro avg       0.92      0.72      0.79      4506
weighted avg       0.99      0.99      0.99      4506

This is an archived experiment artifact, not a new evaluation. The report does not record a model-weight SHA, so its exact correspondence to the currently hosted weights has not been independently re-established. These binary-classification metrics are separate from evaluation of the derived lexicon and from sentiment evaluation of full sentences.

Preserved Trainer record

The following validation summary and training log are retained from the previous model card, without recomputing them. The recorded F1 is a training-validation metric, separate from the archived test report above and from lexicon or sentence-level sentiment evaluation. The source training code uses binary F1 for target label 1 when eval="f1" is selected.

• Loss: 0.0761
• F1: 0.3889

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 64
• eval_batch_size: 16
• seed: 42
• gradient_accumulation_steps: 4
• total_train_batch_size: 256
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 32

Training results

Training Loss	Epoch	Step	Validation Loss	F1
No log	0.9843	47	0.0492	0.24
No log	1.9895	95	0.0440	0.5143
No log	2.9948	143	0.0577	0.4571
No log	4.0	191	0.0611	0.4737
No log	4.9843	238	0.0761	0.3889

Framework versions

• Transformers 4.40.1
• Pytorch 2.2.2
• Datasets 2.19.0
• Tokenizers 0.19.1

The Trainer record and the linked source script are separate provenance sources. In particular, the recorded optimizer may differ from the script's adafactor setting; the historical record is retained without asserting that the linked script reproduces that exact run.

Settings in the archived training source

These settings describe the linked code revision, not a replacement for the per-run Trainer record.

Setting	Source-code value
Maximum tokenized input length	300
Learning rate	2e-5
Training batch size per device	64
Evaluation batch size per device	16
Gradient accumulation	4 steps
Optimizer	Adafactor
Weight decay	0.01
Validation split seed	42
Evaluation and saving	Each epoch
Early stopping patience	5 evaluation calls
Epoch budget in experiment notebooks	Up to 32

The paper reports early-stopping patience of 3. The preserved Jerteh355 script uses 5; this discrepancy is recorded rather than merged into one run description.

Intended use and limitations

• Intended for research on polarity of Serbian WordNet meanings and construction or analysis of Serbian sentiment lexicons.
• Training inputs are glosses. Performance on reviews, news, social media, and documents requires separate evaluation; this checkpoint is not documented as a general sentence-sentiment benchmark model.
• Class imbalance is visible in the archived report. Read accuracy and weighted averages alongside target-class precision, recall, F1, and support.
• Labels depend on seed selection and semantic-relation expansion. Polysemy, domain-specific polarity, and propagation errors can affect predictions. English-to-Serbian alignment alone does not establish polarity in Serbian.
• Softmax outputs are model scores; probability calibration is not established by this card.
• The model performs no sense selection for a word in context. Applying the lexicon to text requires a separate choice or aggregation of meanings.

License

This fine-tuned model is distributed under Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) (cc-by-sa-4.0), matching the license declared for its original base model, jerteh/Jerteh-355. Read the full LICENSE and NOTICE for attribution and the description of the fine-tuning changes.

The license permits sharing and adaptation, including commercial use, subject to its terms. Give appropriate credit, link to the license, and indicate changes. When sharing adapted material, apply the same license or a license permitted by its ShareAlike provisions.

Scope and training-resource permissions

The model license covers the model distribution and accompanying documentation within the rights the licensors can grant. External lexical resources, training datasets, and companion code retain their own terms.

An earlier description of Serbian WordNet reports CC BY-NC terms for the downloadable resource (Developing and Maintaining a WordNet: Procedures and Tools, 2014). The terms of the exact SrpWN release used for this fine-tuning, and any separate permission covering it, have not been verified in this documentation update. That historical statement alone does not determine the license of the trained weights. This model-license declaration does not grant rights to redistribute SrpWN or establish that every third-party permission for a particular use has been cleared. The remaining check is to identify the training release and record the applicable permission from its rights holders. See also Creative Commons guidance on AI training.

License declaration history

The existing cc-by-sa-4.0 declaration was retained and expanded with the full license text and attribution on 23 September 2026.

Citation

When using this model family or the resulting lexicon-construction method, cite the paper and record the model ID and revision used.

@article{petalinkar2025sentimentlexicon,
  author = {Petalinkar, Saša and Stanković, Ranka M. and Ikonić Nešić, Milica},
  title = {Comparative analysis of methods for creating a sentiment lexicon of the Serbian WordNet},
  journal = {The Electronic Library},
  year = {2025},
  volume = {43},
  number = {4},
  pages = {547--577},
  doi = {10.1108/EL-08-2024-0253},
  url = {https://doi.org/10.1108/EL-08-2024-0253}
}

Version and documentation sources

• Weights/configuration revision documented here: c14a556fff4cb20c4910f3f138e522ec0b2fd41c. This pins the hosted checkpoint; it does not prove which weights produced every table in the paper.
• Companion code revision: 833582dbbf561a902fc5b872248db12bf529b3d9.
• BERTić initialization is recorded in Prepare and load models.ipynb; GPT2-Orao and Jerteh-355 initialization is recorded in their training scripts.
• Documentation expanded on 23 September 2026 using the paper, model configuration, repository source, archived evaluation report, and any pre-existing Trainer record. Weights, tokenizer files, and model configuration were not changed by this documentation update.