The Interplay Between Loss Functions and Structural Constraints in Dependency Parsing
Dependency parsing can be cast as a combinatorial optimization problem with the objective to find the highest-scoring graph, where edge scores are learnt from data. Several of the decoding algorithms that have been applied to this task employ structural restrictions on candidate solutions, such as...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Linköping University Electronic Press
2019-12-01
|
| Series: | Northern European Journal of Language Technology |
| Online Access: | https://nejlt.ep.liu.se/article/view/1037 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832590620856680448 |
|---|---|
| author | Robin Kurtz Marco Kuhlmann |
| author_facet | Robin Kurtz Marco Kuhlmann |
| author_sort | Robin Kurtz |
| collection | DOAJ |
| description |
Dependency parsing can be cast as a combinatorial optimization problem with the objective to find the highest-scoring graph, where edge scores are learnt from data. Several of the decoding algorithms that have been applied to this task employ structural restrictions on candidate solutions, such as the restriction to projective dependency trees in syntactic parsing, or the restriction to noncrossing graphs in semantic parsing. In this paper we study the interplay between structural restrictions and a common loss function in neural dependency parsing, the structural hingeloss. We show how structural constraints can make networks trained under this loss function diverge and propose a modified loss function that solves this problem. Our experimental evaluation shows that the modified loss function can yield improved parsing accuracy, compared to the unmodified baseline.
|
| format | Article |
| id | doaj-art-9cebc0fa74794ffe859aa1bf738321cb |
| institution | Kabale University |
| issn | 2000-1533 |
| language | English |
| publishDate | 2019-12-01 |
| publisher | Linköping University Electronic Press |
| record_format | Article |
| series | Northern European Journal of Language Technology |
| spelling | doaj-art-9cebc0fa74794ffe859aa1bf738321cb2025-01-23T10:36:32ZengLinköping University Electronic PressNorthern European Journal of Language Technology2000-15332019-12-01610.3384/nejlt.2000-1533.19643The Interplay Between Loss Functions and Structural Constraints in Dependency ParsingRobin Kurtz0Marco Kuhlmann1Department of Computer and Information Science, Linköpng University, SwedenDepartment of Computer and Information Science, Linköpng University, Sweden Dependency parsing can be cast as a combinatorial optimization problem with the objective to find the highest-scoring graph, where edge scores are learnt from data. Several of the decoding algorithms that have been applied to this task employ structural restrictions on candidate solutions, such as the restriction to projective dependency trees in syntactic parsing, or the restriction to noncrossing graphs in semantic parsing. In this paper we study the interplay between structural restrictions and a common loss function in neural dependency parsing, the structural hingeloss. We show how structural constraints can make networks trained under this loss function diverge and propose a modified loss function that solves this problem. Our experimental evaluation shows that the modified loss function can yield improved parsing accuracy, compared to the unmodified baseline. https://nejlt.ep.liu.se/article/view/1037 |
| spellingShingle | Robin Kurtz Marco Kuhlmann The Interplay Between Loss Functions and Structural Constraints in Dependency Parsing Northern European Journal of Language Technology |
| title | The Interplay Between Loss Functions and Structural Constraints in Dependency Parsing |
| title_full | The Interplay Between Loss Functions and Structural Constraints in Dependency Parsing |
| title_fullStr | The Interplay Between Loss Functions and Structural Constraints in Dependency Parsing |
| title_full_unstemmed | The Interplay Between Loss Functions and Structural Constraints in Dependency Parsing |
| title_short | The Interplay Between Loss Functions and Structural Constraints in Dependency Parsing |
| title_sort | interplay between loss functions and structural constraints in dependency parsing |
| url | https://nejlt.ep.liu.se/article/view/1037 |
| work_keys_str_mv | AT robinkurtz theinterplaybetweenlossfunctionsandstructuralconstraintsindependencyparsing AT marcokuhlmann theinterplaybetweenlossfunctionsandstructuralconstraintsindependencyparsing AT robinkurtz interplaybetweenlossfunctionsandstructuralconstraintsindependencyparsing AT marcokuhlmann interplaybetweenlossfunctionsandstructuralconstraintsindependencyparsing |