Task-dependent Optimal Weight Combinations for Static Embeddings

A variety of NLP applications use word2vec skip-gram, GloVe, and fastText word embeddings. These models learn two sets of embedding vectors, but most practitioners use only one of them, or alternately an unweighted sum of both. This is the first study to systematically explore a range of linear com...

Full description

Saved in:
Bibliographic Details
Main Authors: Nathaniel Robinson, Nathaniel Carlson, David Mortensen, Elizabeth Vargas, Thomas Fackrell, Nancy Fulda
Format: Article
Language:English
Published: Linköping University Electronic Press 2022-11-01
Series:Northern European Journal of Language Technology
Online Access:https://nejlt.ep.liu.se/article/view/4438
Tags: Add Tag
No Tags, Be the first to tag this record!