Changepoint Detection over Graphs with the Spectral Scan Statistic
نویسندگان
چکیده
We consider the change-point detection problem of deciding, based on noisy measurements, whether an unknown signal over a given graph is constant or is instead piecewise constant over two induced subgraphs of relatively low cut size. We analyze the corresponding generalized likelihood ratio (GLR) statistic and relate it to the problem of finding a sparsest cut in a graph. We develop a tractable relaxation of the GLR statistic based on the combinatorial Laplacian of the graph, which we call the spectral scan statistic, and analyze its properties. We show how its performance as a testing procedure depends directly on the spectrum of the graph, and use this result to explicitly derive its asymptotic properties on few graph topologies. Finally, we demonstrate both theoretically and by simulations that the spectral scan statistic can outperform naive testing procedures based on edge thresholding and χ testing.
منابع مشابه
Changepoint Detection over Graphs with the Spectral Scan Statistic
Proof of Theorem 5 (2). We will begin by constructing from our set, C′, a new set, S, of clusters which are difficult to distinguish in the sense that the Bayes risk for the uniform prior over those in the alternative is bounded away from 0. Enumerate C′ such that C′ = {Ci} ′| i=1. We will build S by unioning k elements of C′, then draw S, S′ uniformly from S. Specifically, let k = b √ |C′|c (r...
متن کاملNear-optimal Anomaly Detection in Graphs using Lovasz Extended Scan Statistic
The detection of anomalous activity in graphs is a statistical problem that arises in many applications, such as network surveillance, disease outbreak detection, and activity monitoring in social networks. Beyond its wide applicability, graph structured anomaly detection serves as a case study in the difficulty of balancing computational complexity with statistical power. In this work, we deve...
متن کاملThe use of cumulative sums for detection of changepoints in the rate parameter of a Poisson Process
This paper studies the problem of multiple changepoints in rate parameter of a Poisson process. We propose a binary segmentation algorithm in conjunction with a cumulative sums statistic for detection of changepoints such that in each step we need only to test the presence of a simple changepoint. We derive the asymptotic distribution of the proposed statistic, prove its consistency and obtain ...
متن کاملTHE UNIVERSITY OF BRITISH COLUMBIA DEPARTMENT OF STATISTICS TECHNICAL REPORT #236 On-line Changepoint Detection and Parameter Estimation for Genome-wide Transcript Analysis
We consider the problem of identifying novel RNA transcripts using tiling arrays. Standard approaches to this problem rely on the calculation of a sliding window statistic or on simple changepoint models. These methods suffer from several drawbacks including the need to determine a threshold to label transcript regions and/or specify the number of transcripts. In this paper, we propose a Bayesi...
متن کاملApproximate Recovery in Changepoint Problems, from `2 Estimation Error Rates
In the 1-dimensional multiple changepoint detection problem, we prove that any procedure with a fast enough `2 error rate, in terms of its estimation of the underlying piecewise constant mean vector, automatically has an (approximate) changepoint screening property—specifically, each true jump in the underlying mean vector has an estimated jump nearby. We also show, again assuming only knowledg...
متن کامل