Linguistic Regularities in Sparse and Explicit Word Representations.
Omer Levy and Yoav Goldberg. CoNLL 2014. [pdf] [slides]
This fascinating result raises a question: to what extent are the relational semantic properties a result of the embedding process? Experiments show that the RNN-based embeddings are superior to other dense representations, but how crucial is it for a representation to be dense and low-dimensional at all?
.
.
.
.
.
Omer Levy 