# Question about Tokenization for text classification

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-tokenization-for-text-classification%2F775%3E%5C
**Category:** Beginners\
**Created:** [August 19, 2020, 5:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-tokenization-for-text-classification%2F775 "2020-08-19T17:40:45Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![afractalthought](https://avatars.discourse-cdn.com/v4/letter/a/ad7895/32.png) [@afractalthought](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fafractalthought)%5C
**Post date:** [August 19, 2020, 5:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-tokenization-for-text-classification%2F775%2F1 "2020-08-19T17:40:45Z")

</div>

Can anyone answer [this question](https://datascience.stackexchange.com/questions/80523/am-i-tokenizing-correctly-for-text-classification-using-the-bert-hugging-face-l) I posted on stack exchange?

---

<div class="post-metadata">

**Author:** ![thomwolf](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/thomwolf/32/2198_2.png) [@thomwolf](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fthomwolf)%5C
**Post date:** [August 19, 2020, 8:07pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-tokenization-for-text-classification%2F775%2F2 "2020-08-19T20:07:33Z")

</div>

The padding should be on the right for Bert.

But you can do all of that a lot simpler now! You should take a look at the [preprocessing tutorial](https://huggingface.co/transformers/preprocessing.html).

---

<div class="post-metadata">

**Author:** ![afractalthought](https://avatars.discourse-cdn.com/v4/letter/a/ad7895/32.png) [@afractalthought](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fafractalthought)%5C
**Post date:** [August 19, 2020, 8:12pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-tokenization-for-text-classification%2F775%2F3 "2020-08-19T20:12:59Z")

</div>

Thank you for responding!
