NAACL HLT 2009 Software Engineering , Testing , and Quality Assurance for Natural Language Processing ( SETQA - NLP 2009 )
نویسندگان
چکیده
We summarize our experiences building a comprehensive suite of tests for a statistical natural language processing toolkit, ClearTK. We describe some of the challenges we encountered, introduce a software project that emerged from these efforts, summarize our resulting test suite, and discuss some of the les-
منابع مشابه
ACL - 08 : HLT Software Engineering , Testing , and Quality Assurance for Natural Language Processing
Software engineering in general is a first-class research object in computer science, but generally has not been treated as such within the natural language processing community. This is despite the fact that natural language as an input type has unique characteristics that present special problems for software testing, quality assurance, and even requirements specification. The goals of this w...
متن کاملSoftware Engineering of NLP-based Computer-assisted Coding Applications
The development of production-quality natural language processing (NLP)-based computer-assisted coding (CAC) applications requires a process-driven approach to software development and quality assurance. This should include a well-defined software engineering process, with the specific phases and milestones typically consisting of requirements analysis, preliminary design, detailed design, impl...
متن کاملLearning Combination Features with L1 Regularization
When linear classifiers cannot successfully classify data, we often add combination features, which are products of several original features. The searching for effective combination features, namely feature engineering, requires domain-specific knowledge and hard work. We present herein an efficient algorithm for learning an L1 regularized logistic regression model with combination features. W...
متن کاملA Quagmire of Terminology: Verification and Validation, Testing, and Evaluation
Software engineering literature presents multiple definitions for the terms verification, validation and testing. The ensuing diA~culties carry into research on the verification and validation (V&V) of intelligent systems. We explore both these areas and then address the additional terminology problems faced when attempting to carry out V&V work in a new domain such as natural language processi...
متن کامل