# Error: ‘AlbertModel’ object has no attribute ‘bias’

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-albertmodel-object-has-no-attribute-bias%2F9266%3E%5C
**Category:** 🤗Transformers\
**Created:** [August 16, 2021, 12:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-albertmodel-object-has-no-attribute-bias%2F9266 "2021-08-16T12:10:20Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Che](https://avatars.discourse-cdn.com/v4/letter/c/d78d45/32.png) [@Che](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FChe)%5C
**Post date:** [August 16, 2021, 12:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-albertmodel-object-has-no-attribute-bias%2F9266%2F1 "2021-08-16T12:10:20Z")

</div>

simply trying to extract use a an albert model pretrained on custom vocab:

I get the error - **‘AlbertModel’ object has no attribute ‘bias’** can someone provide some guidance I am using transformers 4.9.2?

ptcfg = AlbertConfig.from\_json\_file(prt\_config)  
modelprt = Albertmodel(ptcfg)  
modelprt = load\_tf\_weights\_in\_albert(modelprt, self.ptcfg, prot\_model)