عکس AminTaheri23
IMDB sentiment classification with GPT2 pre trainingJupyter Notebook
موضوع‌ها
۰
فورک‌ها
۱
ستاره‌ها
۹
تاریخ ایجاد
۱۸ اردیبهشت ۱۳۹۹
آخرین بروزرسانی
بیشتر از ۲ سال قبل
لایسنس
GNU General Public License v3.0

IMDB sentiment classification GPT2

:GPT2 Versions:

IMDB sentiment classification with GPT2 pre training. The main file is here

You can refresh your knowledge about GPT2 from this awesome blog

Running in Google Colab

you can run a similar notebook in colab from here

We don't have CLS token!

what is a cls token? it is a token for classification. BERT has this token and it is retrieved from pooling and some other functions such as sigmoid, etc. it is not precisely said in the paper (if you found it please show me so i can edit this). some other folks on github found that it is ok to average each word vector to make and CLS token. so we are adapting to this approach here.

Refrences