NLP News Cypher | 02.02.20

The Die Is Cast

Today is 02.02.20 - the first global palindrome day in 909 years. 👀

How was your week?

Well, if you live anywhere near the NLP universe, you’ve probably stumbled on the NLP database. If you haven’t, you should!

Next, I want to give a shout-out to two database contributors from the past week: Kiril Gashteovski and Chandra Sekhar. Thank You! Thus far, we have amassed 239 NLP datasets.

If you know of a dataset that you see missing or have an edit request, please contact us on the database’s web page.

This Week:

– BERTs Lingua Franca
– Deep Learning Boot Camp
– Meena is Perplexing
– The Conscious Mind
– A Token of Appreciation
– S&P Global NLP White Papers
– Deployment Headaches
– Dataset of the Week: QA-SRL Bank

BERTs Lingua Franca

On Twitter, Sebastian Ruder shared just how many international BERT models we already have! Then Hugging Face shared some more. In total, there’s a lot of country flags on display! This is good to see for the international community!

Transfer learning is increasingly going multilingual with language-specific BERT models:

– 🇩🇪 German BERT https://t.co/M6Mo1drsgo
– 🇫🇷 CamemBERT https://t.co/flzuE9zNJN, FlauBERT https://t.co/xXlSeytUjj
– 🇮🇹 AlBERTo https://t.co/1nhchd2PG1
– 🇳🇱 RobBERT https://t.co/wR2Bln1Fyx
— Sebastian Ruder (@seb_ruder) January 27, 2020

Hugging Face:

Looking at the replies, there are a lot of BERT models that I missed:
– 🇷🇺 RuBERT https://t.co/SOh4N3qDD7
– 🇪🇸 BETO https://t.co/rpfvl9Pw3v
– 🇳🇱 BERTje https://t.co/SOh4N3qDD7
– 🇧🇷 Portuguese BERT https://t.co/2EanC75nSK
– 🇩🇪https://t.co/ea4LIe3ImO

Thanks everyone! 🙌
— Sebastian Ruder (@seb_ruder) January 27, 2020

Me:

via GIPHY

Deep Learning Boot Camp

Beyond the footsteps of the next killer robot and Lex Fridman’s dark suits, and way beyond the deepest reaches of MIT, there lies a 1-week deep learning boot-camp. And it’s on YouTube: