Adaptive Replica Synchronizationfor Distributed File Systems

Abstract:

This paper presents an adaptive replica synchronization mechanism among storage servers (SSs) without the interference from the metadata server (MDS) in a distributed file system. This mechanism employs a chunk list data structure, which holds the information about the relevant chunk replicas and is stored on the associated SSs corresponding to the replicas. Combined with version-based update replay technique, our proposed mechanism can ensure data consistency from the viewpoint of clients and help the SSs to conduct replica synchronization proactively with a per-chunk granularity. In contrast to conventional approaches of replica synchronization that are reliant on the MDS to trigger the synchronization, our proposed mechanism can side step the cumbersome centralized synchronization process to accomplish the same synchronization job. Moreover, a deferred update approach for replica synchronization has been adopted by the newly proposed mechanism for contributing to I/O data rate in write-intensive workloads. The evaluation experiments show that this newly presented mechanism can achieve attractive I/O performance enhancement with less synchronization overhead in specific application contexts.

Existing System:

In these days a single server handles the multiple requests from the user. Here the server has to process the request from the user simultaneously, so the processing time will be high.

This may leads to loss of data and packets may be delayed and corrupted.

On doing this the server cannot process the query from the user in a proper manner.So the processing time gets increased.

It may leads to traffic and congestion. To overcome these problems we are going for the concept called “cloud computing”. In this cloud computing we are going to implement the chunk server to avoid these problems.

Proposed System:

MDS in a distributed file system is responsible for managing information about all chunk replicas and triggering replica synchronization when one of the replicas has been updated.

The system based on the new architecture has better scalability and fault tolerance. A Cluster consists of a single master and multiple chunk servers and is accessed by multiple clients.

Chunk servers store chunks on local disks and read or write chunk data specified by a chunk handle and byte range. The master maintains all file system metadata.

Advantages:

Lazy replica synchronization approach to shorten the write latency for enhancing write data throughput and an adaptive replica synchronization approach to fulfill concurrent read requests for improving read data throughput.

System requirements:

Software requirements:

  • Operating System : Windows Xp
  • Database : MySql
  • IDE : Net Beans 7.0.1
  • Language :Java

Hardware requirements:

  • Processor : Pentium –III
  • Speed : 1.1 Ghz
  • Hard Disk : 20 GB