Virtual Integration systems require a crawling tool able to navigate and reach relevant pages in the Deep Web in an efficient way. Existing proposals in the crawling area fulfill some of these requirements, but most of them need to download pages in order to classify them as relevant or not. We propose a crawler supported by a web page classifier that uses solely a page URL to determine page re...

In this work we present a soft crawler fabricated using magneto-active elastomer. The is controlled by an external magnetic field to produce two locomotion patterns: peristaltic and caterpillar crawling. Due its structural simplicity, low mass, wirelessly actuation compliant body the design of has potential address key challenges faced existing crawling robots. Experimental data were gathered e...

Trovatore is an ongoing project aimed at realizing an efficient distributed and highly scalable web crawler. This poster illustrates the main ideas behind its design.

ABSTRAK Crawler track merupakan sistem roda rantai pada kendaraan yang difungsikan untuk dapat melalui berbagai kondisi jalan sulit dilalui beroda. System diterapkan ringan digunakan transportasi daerah mempunyai dilalui. Pada system tersebut diperlukan komponen frame mampu menahan beban-beban kendaraan. Tujuan dari penelitian ini adalah merancang Frame crawler melewati berkontur tanah. Peranca...

Focused web crawling traverses theWeb to collect documents on a specific topic. This is not an easy task, since focused crawlers need to identify the next most promising link to follow based on the topic and the content and links of previously crawled pages. In this paper, we present a framework based on Maximum Entropy Markov Models(MEMMs) for an enhanced focused web crawler to take advantage ...

Focused crawling aims to search only the relevant subset of the WWW for a specific topic of user interest; leading to the necessity to decide about the relevancy of a document to the topic of interest; especially when the user is not perfect in specifying the exact context of the topic. This paper provides a novel framework of a context based distributed focused crawler that maintains an index ...