OloriBern/musique-mixer-50

CrossEncoder based on BAAI/bge-reranker-v2-m3

This is a Cross Encoder model finetuned from BAAI/bge-reranker-v2-m3 using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Model Details

Model Description

• Model Type: Cross Encoder
• Base model: BAAI/bge-reranker-v2-m3
• Maximum Sequence Length: 1024 tokens
• Number of Output Labels: 1 label

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Cross Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Cross Encoders on Hugging Face

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import CrossEncoder

# Download from the 🤗 Hub
model = CrossEncoder("cross_encoder_model_id")
# Get scores for pairs of texts
pairs = [
    ['Who is the spouse of the original singer of My Way?', 'My Way. ``My Way \'\'German vinyl release Single by Frank Sinatra from the album My Way B - side`` Blue Lace\'\' Released 1969 Recorded December 30, 1968, Los Angeles Genre Traditional pop Length 4: 35 Label Reprise Songwriter (s) Claude François and Jacques Revaux; English lyrics by Paul Anka Producer (s) Sonny Burke</s>A cappella. A cappella [a kapˈpɛlla] (Italian for "in the manner of the chapel") music is specifically group or solo singing without instrumental accompaniment, or a piece intended to be performed in this way. It contrasts with cantata, which is accompanied singing. The term "a cappella" was originally intended to differentiate between Renaissance polyphony and Baroque concertato style. In the 19th century a renewed interest in Renaissance polyphony coupled with an ignorance of the fact that vocal parts were often doubled by instrumentalists led to the term coming to mean unaccompanied vocal music. The term is also used, albeit rarely, as a synonym for alla breve.</s>(What Can I Say) To Make You Love Me. ``(What Can I Say) To Make You Love Me \'\'is a song written by Jimmy Jam and Terry Lewis and recorded by American recording artist Alexander O\'Neal. It is the fifth single from the singer\'s second solo album, Hearsay (1987). The song\'s distinctive backing vocals were performed by Lisa Keith. Following the successful chart performances of the Hearsay singles`` Fake\'\', ``Criticize \'\',`` Never Knew Love Like This\'\', and ``The Lovers \'\',`` (What Can I Say) To Make You Love Me\'\' was released as the album\'s fifth single.</s>The Night We Called It a Day (film). The Night We Called It a Day, also known as All the Way, is a 2003 Australian-American comedy drama film directed by Paul Goldman and starring Dennis Hopper as Frank Sinatra and Melanie Griffith as Barbara Marx. It also features Portia de Rossi, Joel Edgerton, Rose Byrne and David Hemmings. The movie is based on the true events surrounding Sinatra\'s 1974 tour in Australia. When the singer calls a local reporter (de Rossi) a "two-bit hooker", every union in the country black-bans the star until he issues an apology.'],
    ['When did the name Black Death officially take root in the country where the author of Remains of Elmet is from?', 'At This Moment (album). At This Moment is the debut album of American country music artist Neal McCoy, released in 1990 on Atlantic Records Nashville. "If I Built You a Fire", "Hillbilly Blue" and "This Time I Hurt Her More Than She Loves Me" were all released as singles from this album. Although "Hillbilly Blue" did not chart, the other two singles both entered the lower regions of the Hot Country Songs charts. "If I Built You a Fire" was a Top 20 country hit in Canada as well.</s>Remains of Elmet. Remains of Elmet is a collection of poems by Ted Hughes published in 1979. In this book Hughes has poetically covered the region of Elmet. The book contains black and white photographs by Fay Godwin, taken in the barren hill country of West Yorkshire, Hughes\'s birthplace.</s>Say Hello 2 Heaven. Cornell wrote ``Say Hello 2 Heaven \'\'as a tribute to his roommate, Mother Love Bone vocalist Andrew Wood, who at the time had recently died of a heroin overdose.</s>Black Death. Gasquet (1908) claimed that the Latin name atra mors (Black Death) for the 14th-century epidemic first appeared in modern times in 1631 in a book on Danish history by J.I. Pontanus: "Vulgo & ab effectu atram mortem vocatibant. ("Commonly and from its effects, they called it the black death"). The name spread through Scandinavia and then Germany, gradually becoming attached to the mid 14th-century epidemic as a proper name. In England, it was not until 1823 that the medieval epidemic was first called the Black Death.'],
    ['When did Chopin return to the city where he grew up?', 'Frédéric Chopin. Back in Warsaw that year, Chopin heard Niccolò Paganini play the violin, and composed a set of variations, Souvenir de Paganini. It may have been this experience which encouraged him to commence writing his first Études, (1829–32), exploring the capacities of his own instrument. On 11 August, three weeks after completing his studies at the Warsaw Conservatory, he made his debut in Vienna. He gave two piano concerts and received many favourable reviews—in addition to some commenting (in Chopin\'s own words) that he was "too delicate for those accustomed to the piano-bashing of local artists". In one of these concerts, he premiered his Variations on Là ci darem la mano, Op. 2 (variations on an aria from Mozart\'s opera Don Giovanni) for piano and orchestra. He returned to Warsaw in September 1829, where he premiered his Piano Concerto No. 2 in F minor, Op. 21 on 17 March 1830.</s>Frédéric Chopin. Frédéric François Chopin (/ˈʃoʊpæn/; French pronunciation: \u200b[fʁe.de.ʁik fʁɑ̃.swa ʃɔ.pɛ̃]; 22 February or 1 March 1810 – 17 October 1849), born Fryderyk Franciszek Chopin,[n 1] was a Polish and French (by citizenship and birth of father) composer and a virtuoso pianist of the Romantic era, who wrote primarily for the solo piano. He gained and has maintained renown worldwide as one of the leading musicians of his era, whose "poetic genius was based on a professional technique that was without equal in his generation." Chopin was born in what was then the Duchy of Warsaw, and grew up in Warsaw, which after 1815 became part of Congress Poland. A child prodigy, he completed his musical education and composed his earlier works in Warsaw before leaving Poland at the age of 20, less than a month before the outbreak of the November 1830 Uprising.</s>Château d\'Aubiry. French industrialist Pierre Bardou-Job became wealthy selling rolling paper and decided to have a château built for each of his three children, all designed by the Danish architect Viggo Dorph-Petersen. The Château d\'Aubiry was for his son Justin and was built from 1893 to 1904. Pierre Bardou-Job himself never saw it, as he died suddenly in 1892 just before the start of the construction.</s>HD 11506 b. HD 11506 b is an extrasolar planet that orbits the star HD 11506 167 light years away in the constellation of Cetus. This planet was discovered in 2007 by the N2K Consortium using the Keck telescope to detect the radial velocity variation of the star caused by the planet. A second planet, HD 11506 c, was discovered in 2015.'],
    ['When did the continent where the largest country also hosted the football tournament take form that it has today?', 'Exhibition game. National Basketball Association teams play eight preseason games per year. Today, NBA teams almost always play each other in the preseason, but mainly at neutral sites within their market areas in order to allow those who can\'t usually make a trip to a home team\'s arena during the regular season to see a game close to home; for instance the Minnesota Timberwolves will play games in arenas in North Dakota and South Dakota, while the Phoenix Suns schedule one exhibition game outdoors at Indian Wells Tennis Garden in Indian Wells, California yearly, the only such instance an NBA game takes place in an outdoor venue.</s>1989 Copa América. The Copa América 1989 football tournament was hosted by Brazil, from 1 to 16 July. All ten CONMEBOL member nations participated.</s>Garry Tallent. Garry Wayne Tallent (born October 27, 1949 in Detroit, Michigan), sometimes billed as Garry W. Tallent, is an American musician and record producer, best known for being bass player and founding member of the E Street Band, Bruce Springsteen\'s primary backing band since 1972. As of 2013, and not counting Springsteen himself, Tallent is the only original member of the E Street Band remaining in the band. Tallent was inducted as a member of the E Street Band into the Rock and Roll Hall of Fame.</s>Haarla. Haarla (Finnish; "Harlax" in Swedish) is a district and a suburb of the city of Turku, in Finland. It is located in the southern part of the island of Hirvensalo, off the city\'s coastline. The bridge between Hirvensalo and Satava is located in Haarla.'],
    ['How long is the border with the country where the orchestrator of Chopiniana is a citizen?', "Belyayev circle. The Belyayev circle () was a society of Russian musicians who met in Saint Petersburg, Russia between 1885 and 1908, and whose members included Nikolai Rimsky-Korsakov, Alexander Glazunov, Vladimir Stasov, Anatoly Lyadov, Alexander Ossovsky, Witold Maliszewski, Nikolai Tcherepnin, Nikolay Sokolov, Alexander Winkler among others. The circle was named after Mitrofan Belyayev, a timber merchant and amateur musician who became a music philanthropist and publisher after hearing the music of the teenage Glazunov.</s>Kazakhstan. It shares borders of 6,846 kilometres (4,254 mi) with Russia, 2,203 kilometres (1,369 mi) with Uzbekistan, 1,533 kilometres (953 mi) with China, 1,051 kilometres (653 mi) with Kyrgyzstan, and 379 kilometres (235 mi) with Turkmenistan. Major cities include Nur-Sultan, Almaty, Karagandy, Shymkent, Atyrau, and Oskemen. It lies between latitudes 40° and 56° N, and longitudes 46° and 88° E. While located primarily in Asia, a small portion of Kazakhstan is also located west of the Urals in Eastern Europe.Kazakhstan's terrain extends west to east from the Caspian Sea to the Altay Mountains and north to south from the plains of Western Siberia to the oases and deserts of Central Asia. The Kazakh Steppe (plain), with an area of around 804,500 square kilometres (310,600 sq mi), occupies one-third of the country and is the world's largest dry steppe region. The steppe is characterised by large areas of grasslands and sandy regions. Major seas, lakes and rivers include the Aral Sea, Lake Balkhash and Lake Zaysan, the Charyn River and gorge and the Ili, Irtysh, Ishim, Ural and Syr Darya rivers.</s>Frédéric Chopin. Chopin's music was used in the 1909 ballet Chopiniana, choreographed by Michel Fokine and orchestrated by Alexander Glazunov. Sergei Diaghilev commissioned additional orchestrations—from Stravinsky, Anatoly Lyadov, Sergei Taneyev and Nikolai Tcherepnin—for later productions, which used the title Les Sylphides.</s>Trinidad and Tobago passport. The Oath of Citizenship or officially Oath of Allegiance, is a statement recited by individuals wishing to become citizens of the Republic of Trinidad and Tobago. Individuals who wish to become a citizen of Trinidad and Tobago do so through the Ministry of National Security's Citizenship and Immigration Section. The Oath of Allegiance is a mandatory step to becoming a citizen of Trinidad and Tobago."],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)

# Or rank different texts based on similarity to a single text
ranks = model.rank(
    'Who is the spouse of the original singer of My Way?',
    [
        'My Way. ``My Way \'\'German vinyl release Single by Frank Sinatra from the album My Way B - side`` Blue Lace\'\' Released 1969 Recorded December 30, 1968, Los Angeles Genre Traditional pop Length 4: 35 Label Reprise Songwriter (s) Claude François and Jacques Revaux; English lyrics by Paul Anka Producer (s) Sonny Burke</s>A cappella. A cappella [a kapˈpɛlla] (Italian for "in the manner of the chapel") music is specifically group or solo singing without instrumental accompaniment, or a piece intended to be performed in this way. It contrasts with cantata, which is accompanied singing. The term "a cappella" was originally intended to differentiate between Renaissance polyphony and Baroque concertato style. In the 19th century a renewed interest in Renaissance polyphony coupled with an ignorance of the fact that vocal parts were often doubled by instrumentalists led to the term coming to mean unaccompanied vocal music. The term is also used, albeit rarely, as a synonym for alla breve.</s>(What Can I Say) To Make You Love Me. ``(What Can I Say) To Make You Love Me \'\'is a song written by Jimmy Jam and Terry Lewis and recorded by American recording artist Alexander O\'Neal. It is the fifth single from the singer\'s second solo album, Hearsay (1987). The song\'s distinctive backing vocals were performed by Lisa Keith. Following the successful chart performances of the Hearsay singles`` Fake\'\', ``Criticize \'\',`` Never Knew Love Like This\'\', and ``The Lovers \'\',`` (What Can I Say) To Make You Love Me\'\' was released as the album\'s fifth single.</s>The Night We Called It a Day (film). The Night We Called It a Day, also known as All the Way, is a 2003 Australian-American comedy drama film directed by Paul Goldman and starring Dennis Hopper as Frank Sinatra and Melanie Griffith as Barbara Marx. It also features Portia de Rossi, Joel Edgerton, Rose Byrne and David Hemmings. The movie is based on the true events surrounding Sinatra\'s 1974 tour in Australia. When the singer calls a local reporter (de Rossi) a "two-bit hooker", every union in the country black-bans the star until he issues an apology.',
        'At This Moment (album). At This Moment is the debut album of American country music artist Neal McCoy, released in 1990 on Atlantic Records Nashville. "If I Built You a Fire", "Hillbilly Blue" and "This Time I Hurt Her More Than She Loves Me" were all released as singles from this album. Although "Hillbilly Blue" did not chart, the other two singles both entered the lower regions of the Hot Country Songs charts. "If I Built You a Fire" was a Top 20 country hit in Canada as well.</s>Remains of Elmet. Remains of Elmet is a collection of poems by Ted Hughes published in 1979. In this book Hughes has poetically covered the region of Elmet. The book contains black and white photographs by Fay Godwin, taken in the barren hill country of West Yorkshire, Hughes\'s birthplace.</s>Say Hello 2 Heaven. Cornell wrote ``Say Hello 2 Heaven \'\'as a tribute to his roommate, Mother Love Bone vocalist Andrew Wood, who at the time had recently died of a heroin overdose.</s>Black Death. Gasquet (1908) claimed that the Latin name atra mors (Black Death) for the 14th-century epidemic first appeared in modern times in 1631 in a book on Danish history by J.I. Pontanus: "Vulgo & ab effectu atram mortem vocatibant. ("Commonly and from its effects, they called it the black death"). The name spread through Scandinavia and then Germany, gradually becoming attached to the mid 14th-century epidemic as a proper name. In England, it was not until 1823 that the medieval epidemic was first called the Black Death.',
        'Frédéric Chopin. Back in Warsaw that year, Chopin heard Niccolò Paganini play the violin, and composed a set of variations, Souvenir de Paganini. It may have been this experience which encouraged him to commence writing his first Études, (1829–32), exploring the capacities of his own instrument. On 11 August, three weeks after completing his studies at the Warsaw Conservatory, he made his debut in Vienna. He gave two piano concerts and received many favourable reviews—in addition to some commenting (in Chopin\'s own words) that he was "too delicate for those accustomed to the piano-bashing of local artists". In one of these concerts, he premiered his Variations on Là ci darem la mano, Op. 2 (variations on an aria from Mozart\'s opera Don Giovanni) for piano and orchestra. He returned to Warsaw in September 1829, where he premiered his Piano Concerto No. 2 in F minor, Op. 21 on 17 March 1830.</s>Frédéric Chopin. Frédéric François Chopin (/ˈʃoʊpæn/; French pronunciation: \u200b[fʁe.de.ʁik fʁɑ̃.swa ʃɔ.pɛ̃]; 22 February or 1 March 1810 – 17 October 1849), born Fryderyk Franciszek Chopin,[n 1] was a Polish and French (by citizenship and birth of father) composer and a virtuoso pianist of the Romantic era, who wrote primarily for the solo piano. He gained and has maintained renown worldwide as one of the leading musicians of his era, whose "poetic genius was based on a professional technique that was without equal in his generation." Chopin was born in what was then the Duchy of Warsaw, and grew up in Warsaw, which after 1815 became part of Congress Poland. A child prodigy, he completed his musical education and composed his earlier works in Warsaw before leaving Poland at the age of 20, less than a month before the outbreak of the November 1830 Uprising.</s>Château d\'Aubiry. French industrialist Pierre Bardou-Job became wealthy selling rolling paper and decided to have a château built for each of his three children, all designed by the Danish architect Viggo Dorph-Petersen. The Château d\'Aubiry was for his son Justin and was built from 1893 to 1904. Pierre Bardou-Job himself never saw it, as he died suddenly in 1892 just before the start of the construction.</s>HD 11506 b. HD 11506 b is an extrasolar planet that orbits the star HD 11506 167 light years away in the constellation of Cetus. This planet was discovered in 2007 by the N2K Consortium using the Keck telescope to detect the radial velocity variation of the star caused by the planet. A second planet, HD 11506 c, was discovered in 2015.',
        'Exhibition game. National Basketball Association teams play eight preseason games per year. Today, NBA teams almost always play each other in the preseason, but mainly at neutral sites within their market areas in order to allow those who can\'t usually make a trip to a home team\'s arena during the regular season to see a game close to home; for instance the Minnesota Timberwolves will play games in arenas in North Dakota and South Dakota, while the Phoenix Suns schedule one exhibition game outdoors at Indian Wells Tennis Garden in Indian Wells, California yearly, the only such instance an NBA game takes place in an outdoor venue.</s>1989 Copa América. The Copa América 1989 football tournament was hosted by Brazil, from 1 to 16 July. All ten CONMEBOL member nations participated.</s>Garry Tallent. Garry Wayne Tallent (born October 27, 1949 in Detroit, Michigan), sometimes billed as Garry W. Tallent, is an American musician and record producer, best known for being bass player and founding member of the E Street Band, Bruce Springsteen\'s primary backing band since 1972. As of 2013, and not counting Springsteen himself, Tallent is the only original member of the E Street Band remaining in the band. Tallent was inducted as a member of the E Street Band into the Rock and Roll Hall of Fame.</s>Haarla. Haarla (Finnish; "Harlax" in Swedish) is a district and a suburb of the city of Turku, in Finland. It is located in the southern part of the island of Hirvensalo, off the city\'s coastline. The bridge between Hirvensalo and Satava is located in Haarla.',
        "Belyayev circle. The Belyayev circle () was a society of Russian musicians who met in Saint Petersburg, Russia between 1885 and 1908, and whose members included Nikolai Rimsky-Korsakov, Alexander Glazunov, Vladimir Stasov, Anatoly Lyadov, Alexander Ossovsky, Witold Maliszewski, Nikolai Tcherepnin, Nikolay Sokolov, Alexander Winkler among others. The circle was named after Mitrofan Belyayev, a timber merchant and amateur musician who became a music philanthropist and publisher after hearing the music of the teenage Glazunov.</s>Kazakhstan. It shares borders of 6,846 kilometres (4,254 mi) with Russia, 2,203 kilometres (1,369 mi) with Uzbekistan, 1,533 kilometres (953 mi) with China, 1,051 kilometres (653 mi) with Kyrgyzstan, and 379 kilometres (235 mi) with Turkmenistan. Major cities include Nur-Sultan, Almaty, Karagandy, Shymkent, Atyrau, and Oskemen. It lies between latitudes 40° and 56° N, and longitudes 46° and 88° E. While located primarily in Asia, a small portion of Kazakhstan is also located west of the Urals in Eastern Europe.Kazakhstan's terrain extends west to east from the Caspian Sea to the Altay Mountains and north to south from the plains of Western Siberia to the oases and deserts of Central Asia. The Kazakh Steppe (plain), with an area of around 804,500 square kilometres (310,600 sq mi), occupies one-third of the country and is the world's largest dry steppe region. The steppe is characterised by large areas of grasslands and sandy regions. Major seas, lakes and rivers include the Aral Sea, Lake Balkhash and Lake Zaysan, the Charyn River and gorge and the Ili, Irtysh, Ishim, Ural and Syr Darya rivers.</s>Frédéric Chopin. Chopin's music was used in the 1909 ballet Chopiniana, choreographed by Michel Fokine and orchestrated by Alexander Glazunov. Sergei Diaghilev commissioned additional orchestrations—from Stravinsky, Anatoly Lyadov, Sergei Taneyev and Nikolai Tcherepnin—for later productions, which used the title Les Sylphides.</s>Trinidad and Tobago passport. The Oath of Citizenship or officially Oath of Allegiance, is a statement recited by individuals wishing to become citizens of the Republic of Trinidad and Tobago. Individuals who wish to become a citizen of Trinidad and Tobago do so through the Ministry of National Security's Citizenship and Immigration Section. The Oath of Allegiance is a mandatory step to becoming a citizen of Trinidad and Tobago.",
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

Evaluation

Metrics

Cross Encoder Correlation

• Datasets: validation and train_subset
• Evaluated with CECorrelationEvaluator

Metric	validation	train_subset
pearson	0.9141	0.9319
spearman	0.9136	0.9368

Training Details

Training Dataset

Unnamed Dataset

• Size: 166 training samples
• Columns: sentence_0, sentence_1, and label
• Approximate statistics based on the first 166 samples:

  	sentence_0	sentence_1	label
  type	string	string	float
  details	min: 39 characters mean: 94.43 characters max: 173 characters	min: 1010 characters mean: 2022.19 characters max: 3951 characters	min: 0.0 mean: 0.5 max: 1.0

• Samples:

  sentence_0	sentence_1	label
  Who is the spouse of the original singer of My Way?	My Way. My Way ''German vinyl release Single by Frank Sinatra from the album My Way B - side Blue Lace'' Released 1969 Recorded December 30, 1968, Los Angeles Genre Traditional pop Length 4: 35 Label Reprise Songwriter (s) Claude François and Jacques Revaux; English lyrics by Paul Anka Producer (s) Sonny BurkeA cappella. A cappella [a kapˈpɛlla] (Italian for "in the manner of the chapel") music is specifically group or solo singing without instrumental accompaniment, or a piece intended to be performed in this way. It contrasts with cantata, which is accompanied singing. The term "a cappella" was originally intended to differentiate between Renaissance polyphony and Baroque concertato style. In the 19th century a renewed interest in Renaissance polyphony coupled with an ignorance of the fact that vocal parts were often doubled by instrumentalists led to the term coming to mean unaccompanied vocal music. The term is also used, albeit rarely, as a synonym for alla breve.(What...	1.0
  When did the name Black Death officially take root in the country where the author of Remains of Elmet is from?	At This Moment (album). At This Moment is the debut album of American country music artist Neal McCoy, released in 1990 on Atlantic Records Nashville. "If I Built You a Fire", "Hillbilly Blue" and "This Time I Hurt Her More Than She Loves Me" were all released as singles from this album. Although "Hillbilly Blue" did not chart, the other two singles both entered the lower regions of the Hot Country Songs charts. "If I Built You a Fire" was a Top 20 country hit in Canada as well.Remains of Elmet. Remains of Elmet is a collection of poems by Ted Hughes published in 1979. In this book Hughes has poetically covered the region of Elmet. The book contains black and white photographs by Fay Godwin, taken in the barren hill country of West Yorkshire, Hughes's birthplace.Say Hello 2 Heaven. Cornell wrote ``Say Hello 2 Heaven ''as a tribute to his roommate, Mother Love Bone vocalist Andrew Wood, who at the time had recently died of a heroin overdose.Black Death. Gasquet (1908) claime...	0.6666666666666666
  When did Chopin return to the city where he grew up?	Frédéric Chopin. Back in Warsaw that year, Chopin heard Niccolò Paganini play the violin, and composed a set of variations, Souvenir de Paganini. It may have been this experience which encouraged him to commence writing his first Études, (1829–32), exploring the capacities of his own instrument. On 11 August, three weeks after completing his studies at the Warsaw Conservatory, he made his debut in Vienna. He gave two piano concerts and received many favourable reviews—in addition to some commenting (in Chopin's own words) that he was "too delicate for those accustomed to the piano-bashing of local artists". In one of these concerts, he premiered his Variations on Là ci darem la mano, Op. 2 (variations on an aria from Mozart's opera Don Giovanni) for piano and orchestra. He returned to Warsaw in September 1829, where he premiered his Piano Concerto No. 2 in F minor, Op. 21 on 17 March 1830.Frédéric Chopin. Frédéric François Chopin (/ˈʃoʊpæn/; French pronunciation: ​[fʁe.de.ʁik fʁɑ̃....	1.0

• Loss: BinaryCrossEntropyLoss with these parameters:

  {
      "activation_fn": "torch.nn.modules.linear.Identity",
      "pos_weight": null
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 2
• per_device_eval_batch_size: 2

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 2
• per_device_eval_batch_size: 2
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1
• num_train_epochs: 3
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• eval_use_gather_object: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	validation_spearman	train_subset_spearman
1.0	83	0.8939	-
1.2048	100	0.9121	0.9256
2.0	166	0.9084	-
2.4096	200	0.9148	0.9368
3.0	249	0.9136	-

Framework Versions

• Python: 3.11.6
• Sentence Transformers: 5.2.0
• Transformers: 4.44.2
• PyTorch: 2.9.1+cu128
• Accelerate: 1.12.0
• Datasets: 4.0.0
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}