We present a method for objective quality evaluation of noise-reduced speech. The experimental results indicate that residual noise and the distortion of speech and noise influence the perceived degradation of speech quality. Therefore, the proposed method is developed based on the relationship among three factors and subjective quality. We verify the validity of the method by comparing subject...

Security issue has become a new hotspot in cyber-physical systems (CPS) research field in recent years due to the vulnerability of CPS to security threats. This paper focuses on stealthy deception attack in remote state estimation, which is one typical attack in CPS. From the standpoint of deception attacker, we investigates how to design proper deception attack strategy to degrade the state es...

Software engineering is the discipline which paves the road map for the development of software within the given schedule and effort with the desired quality. The process begins with estimating the size, effort and time required for the development of the software and ends with the product. In most existing research on the effort estimation, the Function Point Analysis (FPA) method is used to e...

Users of Voice over IP (VoIP) applications are sensitive to the quality of an ongoing call. We hypothesize that the quality of a VoIP session can be estimated from the first few seconds of the session and this can be generalized to other VoIP calls. Our approach is an in-band probing mechanism and does not require any external monitoring schemes or network support. We show by post processing Vo...

We address the problem of estimating the quality of Automatic Speech Recognition (ASR) output at utterance level, without recourse to manual reference transcriptions and when information about system’s confidence is not accessible. Given a source signal and its automatic transcription, we approach this problem as a regression task where the word error rate of the transcribed utterance has to be...

This paper describes our submission to the shared task on word/phrase level Quality Estimation (QE) in the First Conference on Statistical Machine Translation (WMT16). The objective of the shared task was to predict if the given word/phrase is a correct/incorrect (OK/BAD) translation in the given sentence. In this paper, we propose a novel approach for word level Quality Estimation using Recurr...

Quality estimation evaluation commonly takes the form of measurement of the error that exists between predictions and gold standard labels for a particular test set of translations. Issues can arise during comparison of quality estimation prediction score distributions and gold label distributions, however. In this paper, we provide an analysis of methods of comparison and identify areas of con...

We revisit data fusion, i.e., the problem of integrating noisy data from multiple sources by estimating the source accuracies, and show that the simple model of logistic regression can capture most existing approaches for solving data fusion. This allows us to put data fusion on a solid statistical footing and obtain solutions with rigorous theoretical guarantees. Expanding on logistic regressi...

We describe the submissions of the University of Sheffield (USFD) for the phraselevel Quality Estimation (QE) shared task of WMT16. We test two different approaches for phrase-level QE: (i) we enrich the provided set of baseline features with information about the context of the phrases, and (ii) we exploit predictions at other granularity levels (word and sentence). These approaches perform cl...

The development and adoption of standard image quality measurement and analysis methods have helped both the evaluation of competing imaging products and in technologies. Inherent in the interpretation of results from any particular evaluation, however, are the variation of the method itself, the sampling of test images, equipment, and test conditions. Here we take a statistical approach to mea...