Predicting Grammaticality on an Ordinal Scale

نویسندگان

  • Michael Heilman
  • Aoife Cahill
  • Nitin Madnani
  • Melissa Lopez
  • Matthew Mulholland
  • Joel R. Tetreault
چکیده

Automated methods for identifying whether sentences are grammatical have various potential applications (e.g., machine translation, automated essay scoring, computer-assisted language learning). In this work, we construct a statistical model of grammaticality using various linguistic features (e.g., misspelling counts, parser outputs, n-gram language model scores). We also present a new publicly available dataset of learner sentences judged for grammaticality on an ordinal scale. In evaluations, we compare our system to the one from Post (2011) and find that our approach yields state-of-the-art performance.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Predicting design induced pilot error using HET (human error template) – A new formal human error identification method for flight decks

χ Value in the Chi-square distribution used to test for significant differences between three (or more) independent groups when using the Kruskall-Wallis non-parametric analysis of variance where the dependent variable is measured on an ordinal scale. p Probability of making a type I decision error. U Critical value in the Mann-Whitney U test to test for significant differences between two inde...

متن کامل

Ordinal convolutional neural networks for predicting RDoC positive valence psychiatric symptom severity scores.

BACKGROUND The CEGS N-GRID 2016 Shared Task in Clinical Natural Language Processing (NLP) provided a set of 1000 neuropsychiatric notes to participants as part of a competition to predict psychiatric symptom severity scores. This paper summarizes our methods, results, and experiences based on our participation in the second track of the shared task. OBJECTIVE Classical methods of text classif...

متن کامل

Tag-Aware Ordinal Sparse Factor Analysis for Learning and Content Analytics

Machine learning offers novel ways and means to design personalized learning systems wherein each student’s educational experience is customized in real time depending on their background, learning goals, and performance to date. SPARse Factor Analysis (SPARFA) is a novel framework for machine learning-based learning analytics, which estimates a learner’s knowledge of the concepts underlying a ...

متن کامل

Support Vector Learning for Ordinal Regression

We investigate the problem of predicting variables of ordinal scale. This taks is referred to as ordinal regression and is complementary to the standard machine learning tasks of classification and metric regression. In contrast to statistical models we present a distribution independent formulation of the problem together with uniform bounds of the risk functional. The approach presented is ba...

متن کامل

A Comparison of Imputation Strategies for Ordinal Missing Data on Likert Scale Variables.

This article compares a variety of imputation strategies for ordinal missing data on Likert scale variables (number of categories = 2, 3, 5, or 7) in recovering reliability coefficients, mean scale scores, and regression coefficients of predicting one scale score from another. The examined strategies include imputing using normal data models with naïve rounding/without rounding, using latent va...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014