COVID update: Due to the pandemic the course will be online. The classes will be broadcasted live online. The practical labs will be also held online, in two split groups with one lecturer in each. Given our online teaching experience this last year, we will offer a high-quality and engaging course, both at the theoretical and hands-on practical sessions.
Deep Learning neural network models have been successfully applied to natural language processing, and are now changing radically how we interact with machines (Siri, Amazon Alexa, Google Home, Skype translator, Google Translate, or the Google search engine). These models are able to infer a continuous representation for words and sentences, instead of using hand-engineered features as in other machine learning approaches. The seminar will introduce the main deep learning models used in natural language processing, allowing the attendees to gain hands-on understanding and implementation of them in Keras.
This course is a 20 hour introduction to the main deep learning models used in text processing, covering the latest developments, including Transformers and pre-trained (multilingual) language models like GPT, BERT and XLM-R. It combines theoretical and practical hands-on classes. Attendants will be able to understand and implement the models in Keras.