Application for Data De-duplication Algorithm Based on Mobile Devices

With the rapid development of Mobile Devices, coupled with the rise of the personal cloud service, the business of Cloud Storage and Cloud Synchronization grows rapidly in recent years. As a result, it imposes pressure on the space of the network storage and the network bandwidth, especially in the field of the Mobile Internet. Data De-duplication algorithm can reduce the data redundancy in the method of deleting the same file or the same data chunk in data storage systems so that the space of network storage could be saved and the utilization ratio of network bandwidth could be improved. The algorithm which takes Fixed-size Partition as chunking strategy has been applied in systems of Cloud Storage and Cloud Synchronization in the Mobile Internet field. Though this method is simple and efficient, it is so sensitive to the operation of adding or deleting data that the Data Deduplication Rate is lower than expected. An application for Data De-duplication algorithm based on Content-Defined Chunking is proposed to provide basis in the field of Cloud Storage and Cloud Synchronization through mobile devices. In this way, a file is divided into chunks of different sizes instead of a pre-fixed size based on file contents. Key steps of Data De-duplication algorithm were optimized to make it accommodate to mobile devices. Experimental results showed that the approach brought relatively higher Data De-duplication Rate and lower machine overhead.