A dependency-based parser evaluation method

Abstract

As the emergence of broad-coverage parsers, the "automated quantitative parser evaluation" becomes more important to parser researches. Dependency-based parser evaluation method, one of automated quantitative parser evaluation method, is based on dependency syntax theory and provides a better solution to parser evaluation problem than other evaluation schemes. This thesis explores the area of dependency-based parser evaluation. Several problems are addressed. Among those are evaluation metrics, modification tools, and evaluation for ambiguous sentences. An experiment of the dependency-based evaluation method is also performed. The result is reported in this thesis.