# Finetune GPT2on ATOMIC2020

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-gpt2on-atomic2020%2F7168%3E%5C
**Category:** Flax/JAX Projects\
**Created:** [June 23, 2021, 7:45pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-gpt2on-atomic2020%2F7168 "2021-06-23T19:45:52Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![LouisCastricato](https://avatars.discourse-cdn.com/v4/letter/l/9de0a6/32.png) [@LouisCastricato](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FLouisCastricato)%5C
**Post date:** [June 23, 2021, 7:45pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-gpt2on-atomic2020%2F7168%2F1 "2021-06-23T19:45:52Z")

</div>

Description: We will finetune GPT2-JAX on ATOMIC2020 so that we can generate vertices for knowledge graphs

Model: [GPT2-Large](https://huggingface.co/gpt2-large)

Dataset: [ATOMIC2020](https://github.com/allenai/comet-atomic-2020/tree/f5fe091810539707dfbc962f6a6c04f557575d5b)

Training scripts: Training scripts and data processing scripts will be written as part of the project

Expected result: An adaptable JAX pipeline for training knowledge graph systems.