Many studies on detection and classification of web robots have focused their attention mostly on text crawlers, and empirical experiments used relatively small data collected at universities. In this paper, we analyzed more than one billion requests to www.microsoft. com in 24 h. Web logs were made anonymous to eliminate potential privacy concerns while preserving essential characteristics (e....

Robots are deployed by a Web search engine for collecting information from diierent Web servers in order to maintain the currency of its data base of Web pages. In this paper, we investigate the number of robots to be used by a search engine so as to maximize the currency of the data base without putting an unnecessary load on the network. We use a queueing model to represent the system. The ar...

In recent years, it is becoming increasingly diÆcult to ignore the impact of Web robots on both commercial and institutional Web sites. Not only do Web robots consume valuable bandwidth and Web server resources, they are also making it more diÆcult to apply Web Mining techniques e ectively on the Web logs. E-commerce Web sites are also concern about unauthorized deployment of shopbots for the p...

ÐThis paper describes a framework for developing mobile software robots by using the PLANET mobile object system, which is characterized by language-neutral layered architecture, the native code execution of mobile objects, and asynchronous object passing. We propose an approach to implementing mobile Web search robots that takes full advantage of these characteristics, and we base our discussi...

The internet has become the most important network for communication and the biggest data storage. However, real interaction through this fast growing network is only possible through robots connected to it. This paper discusses the approach and preliminary results of interdisciplinary projects in Internet-robotics. After a discussion of the basic issues, our modular framework for mobile robots...

although construction has been known as a highly complex application field for autonomous robotic systems, recent advances in this field offer great hope for using robotic capabilities to develop automated construction. today, space research agencies seek to build infrastructures without human intervention, and construction companies look to robots with the potential to improve construction qua...

Exposing software and hardware computing resources as services through a cloud is increasingly emerging in the recent years. This comes as a result of extending the service-oriented architecture (SOA) paradigm to virtualize computing resources. In this paper, we extend the paradigm of the SOA approach to virtualize robotic hardware and software resources to expose them as services through the W...

This paper presents a viable solution for the development of service robots by leveraging cloud and Web services technologies, modular software architecture design, and Robot Operating System (ROS). The contributions of this paper are twofolded (1) Design of ROS Web services to provide new abstract interfaces to service robots that makes easier the interaction with and the development of servic...

An increasing number of robots harvest information on the world wide web for a wide variety of purposes. Protocols developed at the inception of the web laid out voluntary procedures in order to identify robot behaviour, and exclude it if necessary. Few robots now follow this protocol and it is now increasingly difficult to filter for this activity in reports of on-site activity. This paper see...

Robots are deployed by a Web search engine for collecting information from diierent Web servers in order to maintain the currency of its data base of Web pages. In this paper, we investigate the number of robots to be used by a search engine so as to maximize the currency of the data base without putting an unnecessary load on the network. We use a queue-ing model to represent the system. The a...