COVID update: Due to the pandemic the course will be online, both theory sessions and practical labs. We will try offer an engaging course, both at the theoretical and hands-on practical sessions.

Language Technology is increasingly present in many of the applications we use in our everyday activities (Google Home, Amazon Alexa, Siri, Google Translate, Grammar checkers, Google search engine...) and the need of experts that can develop applications based on Language Technology is an ever growing demand both in the industry and academia. This course will introduce the most commonly used techniques to build applications based on Language Technology. Thus, the attendees will learn how to apply techniques such as document classification, sequence labeling, as well as vector-based word representations (embeddings) and pretrained language models for core applications such as Opinion Mining, Named Entity Recognition, Fake News Detection or Question Answering.

The course will have a practical focus (laboratories and practical tasks) learning to use readily available LT toolkits (Spacy, Flair, etc.) based on machine and deep learning in a multilingual and multi-domain setting. The aim is to allow attendees to acquire the required autonomy to solve practical problems by applying and developing Language Technology applications. The course will be taught in English.

The course is part of the NLP master hosted by the Ixa NLP research group at the HiTZ research center of the University of the Basque Country (UPV/EHU).

Student profile

This course is targeted to graduate students and professionals from a range of disciplines (linguistics, journalism, computer science, sociology, etc.) that need an applied introduction to Language Technology. This involves identifying the required linguistic resources, appropriate tools/libraries and techniques with the aim of acquiring the required autonomy to solve practical problems by applying and developing applications based on Language Technology in different and creative ways.

For the practical content (coding exercises) some experience in python programming is recommended. Previous attendance to the Deep Learning for Natural Language Processing course might be useful although not required.

Contents

Introduction to Applications of Language Technology

Natural Language Processing
Cross-lingual Information Extraction
LABORATORY: Stance detection with logistic regression
. Features
. Static Word Embeddings
Introduction to Flair
Introduction to Spacy

Text Classification

Fake News, Stance and Propaganda
Detection
. Fake News
. Hyperpartisanism
. Hate speech
Inference
. Fact-checking
. Stance
. Argumentation
LABORATORY: Stance Detection
. Training with Flair and Spacy

Sequence Labelling

Named Entity Recognition
. Contextual Word Representations
. Datasets
. Evaluation
Morphology
. Contextual and neural lemmatization
. Evaluation and application to high-inflected languages
LABORATORY: Train language independent neural sequence taggers with Flair
. Named Entity Recognition
. Contextual lemmatization.

Opinion Mining

Fine-grained Sentiment Analysis
Aspect-based Sentiment Analysis
Multidomain and multilingual issues
LABORATORY:
Sentiment Analysis
. Text Classification
Opinion Targets and Aspects
. Sequence Labelling

Question Answering

Redefining NLP tasks as QA
Pre-trained language models, Transformers
Multilingual transfer learning
Last words
LABORATORY Build and train a Question Answering system.

Instructors

Person 1

Rodrigo Agerri

Ramon y Cajal researcher, member of Ixa
and HiTZ

Person 2

Joseba Fernandez de Landa

FPI researcher, member of Ixa
and HiTZ

Person 3

Iker Garcia

FPI researcher, member of Ixa
and HiTZ

Practical details

General information

The classes will be held live online. The practical labs will also be online, in two split groups with one lecturer in each.

Part of the Language Analysis and Processing master program.
5 theoretical sessions with corresponding programming labs (20 hours).
July 12th to 16th 2021, 15:00-19:00.

Course language: English.
Capacity: 60 attendants (First-come first-served).
Cost: 274 euros (270 for UPV/EHU members).

Registration

Registration open: now to the 27th of June 2021 (or until room is full).
Please register by email to amaia.lorenzo@ehu.eus (subject "Registration to ILTAPP" and CC rodrigo.agerri@ehu.eus).
Also for any enquiry you might have.
The university provides official certificates. Please apply AFTER completing the course.
Public universities are not allowed to produce invoices, but we can provide a payment certificate.


Prerequisites
Basic Python programming experience.
Not a requirement but, previous attendance to the Deep Learning for Natural Language Processing course held the previous week will help students to better understand the underlying algorithms of Language Technology applications.
Bring your own laptop (no need to install anything).