Fused Multi-Sensor Image Mining for Feature Foundation Data

1 This work was sponsored by the U.S. National Imagery and Mapping Agency, under Air Force Contract F19628-95-C-0002. Opinions, interpretations, conclusions, and recommendations are those of the authors and not necessarily endorsed by the U.S. Air Force Abstract – We present work on methods and user interfaces developed for interactive mining for Feature Foundation Data (e.g. roads, rivers, orchards, forests) in fused multi-sensor imagery. A suite of client-server based tools, including the Site Mining Tool and Image Map Interface, enable image analysts (IA) to mine multisensor imagery for feature foundation data and to share trainable search agents, search results, and image annotations with other IAs connected via a computer network. We discuss extensions to the Fuzzy ARTMAP neural network which enable the Site Mining Tool to report confidence measures for detected search targets and to automatically select the critical features in the input vector which are most relevant for particular searches. Examples of the use of the Site Mining Tool and Image Map Interface are shown for an EO, IR, SAR data set derived from Landsat and Radarsat imagery, as well as multispectral (4-band) and hyperspectral (224band) data sets. In addtion, we present an architecture for the enhancement of hyperspectral fused imagery that utilizes internal category activity maps of a trained Fuzzy ARTMAP network to enhance the visualization of targets in the color-fused imagery.