NLP News Cypher | 05.24.20

NLP News Cypher | 05.24.20

One for the Road

ACL 2020 coming in July to a computer near you. Papers and accepted demos/frameworks are already on display:

System Demonstrations

ADVISER: A Toolkit for Developing Multi-modal, Multi-domain and Socially-engaged Conversational Agents Chia-Yu Li, Daniel Ortega, Dirk Väth, Florian Lux, Lindsey Vanderlyn, Maximilian Schmidt, Michael Neumann, Moritz Völkel, Pavel Denisov, Sabrina Jenne, Zorica Kacarevic and Ngoc Thang Vu

Facebook AI released their Blender chatbot earlier this month. I was playing around with the 2.7B model and it talks fairly well 👇. A common problem with chit chat dialogue systems usually involves a model’s disregard for a user’s statement which disrupts continuity. But as you can see, Blender does a great job of maintaining continuity.

declassified

Here’s the 90M param model to run inference via Colab (the larger models make Colab explode):

Google Collaboratory

Blender – Open Domain Chatbot – ParlAI

Paper:

Open-domain Chatbot

Happy Memorial Day Weekend! 🌭

&

Eid Mubarak

This Week:

– The Stormy Seas of Deployment
– BERTweet
– Microsoft Build Recap
– HackerEarth Survey
– Hugging Reformer
– Dataset of the Week: ATOMIC
– The Stormy Seas of Deployment

AI2 and company companies put out great research in NLP. And this week, one of their engineers wrote a blog post on how they manage to deploy all their great demos. They let us into their world of mass deployment and how they are able to run such a complex back-end to deploy real-time inference at scale. You don’t get to see inside the machine very often, so have look at their architecture (Kubernetes alert💥):

Continue Reading…