The Mean Magnitude of Relative Error, MMRE, is probably the most widely used evaluation criterion for assessing the performance of competing software prediction models. It seems obvious that the purpose of MMRE is to assist us to select the best model. In this paper, we have performed a simulation study demonstrating that MMRE does not select the best model. The consequences are dramatic for a ...

As the wireless nodes are having limited battery life, energy efficiency is the most important design consideration in mobile ad hoc networks. Many multipath routing schemes are possibly exploiting multiple disjoint routes between any pair of source and destination in order to provide aggregated bandwidth, fault-tolerance and load-balancing properties. Hence we propose an optimized energy effic...

Dan Port (UHawaii) Vu Nguyen (USc) Tim Menzies (WVU) [email protected], [email protected], [email protected] Jan 19, 2009 ABSTRACT Confidence in cost estimation is different than model accuracy. It is related to the significance of results based on model accuracy measures such as MMRE and PRED. A lack of confidence places uncertainty in the accuracy for predicted values and the conclusions based on ...

Software estimation accuracy is among the greatest challenges for software developers. This study aimed at building and evaluating a neuro-fuzzy model to estimate software projects development time. The forty-one modules developed from ten programs were used as dataset. Our proposed approach is compared with fuzzy logic and neural network model and Results show that the value of MMRE (Mean of M...

This paper aims to provide the software estimation research community with a better understanding of the meaning of, and relationship between, two statistics that are often used to assess the accuracy of predictive models: the mean magnitude relative error, MMRE, and the number of predictions within 25% of the actuals, pred(25). We demonstrate that MMRE and pred(25) are, respectively, measures ...

The prediction level at x (PRED(x)) and mean magnitude of relative error (MMRE) are measured based on the between real predicted values. They standard metrics that evaluate accurate effort estimates. However, these values might not reveal over-/under-estimation. This study aims to define additional information associated with PRED(x) MMRE help practitioners better interpret those We propose for...

The Magnitude of Relative Error, MRE, is probably the most widely used basic metric in common evaluation criteria, e.g. MMRE and PRED, to assess the performance of software prediction models. The implicit rationale of using a relative error measure, rather than an absolute one, is to have a measure that is independent of scale. In this paper, we investigate if this implicit claim holds true usi...

Dementia due to Alzheimer's Disease (AD) is a neurodegenerative disease for which treatment strategies at an early stage are of great clinical importance. So far, there is still a lack of non-invasive diagnostic tools to sensitively detect AD in early stages and to predict individual disease progression. Magnetic resonance elastography (MRE) of the brain may be a promising novel tool. In this p...

Software development effort estimation is among one of the most challenging jobs that software developers need to perform. Due to the lack of information during the early stages of software development, the developers often express their inability to estimate accurately the effort, cost and schedule of the software under consideration. This inaccuracy in estimation leads to monetary losses as w...