Today we are in a highly informative and digital era, comparatively large amount of data are generated simultaneously day to day. All these data must be stored for processing the result and for future references. As the availability of data increases, we have to invest more amounts in maintaining the storage devices. To meet the cost on storage devices and to enhance storage efficiency. It is mandatory use a creative technique to store maximum data within the available storage devices. This can be achieved by data deduplication method. It eliminates redundant copies of data in order to minimize the storage requirement and achieves cost efficiency on storage devices. This paper will analyze various deduplication methods and give an ample survey.

Keywords— Deduplication, genetic algorithm, Hash algorithm, bandwidth, chunking, compression, Jenkins hash function, file similarity

[1] Young Chan Moon1, Ho Min Jung1, Chuck Yoo2, and Young Woong Ko1 “Data Deduplication Using Dynamic Chunking Algorithm”, Springer ICCI 2012.
[2] RavikanthM*1,Dr.D.Vasumathi*2, B.Mallikarjuna Reddy*3, ”Enhanced Duplicate Detection Using Genetic Algorithm With Particle Swarm Optimization”, IJCSIET— International Journal of Computer Science information and Engg., Technologies ISSN 2277- 4408
[3] R.Supriya1, K. Sathyaseelan2,” Secure Deduplication Using Jenkins Hash Function” Ncraccess -2015.
[4] Sunita Sarawagi, Anuradha Bhamidipaty,” Interactive Deduplication using Active Learning”
[5] Amanpreet Kaur, 2Sonia Sharma “An Efficient Framework and Techniques of Data Deduplication in Cloud Computing ”, IJCST Vol. 8, Iss ue 2, April - June 2017.
[6] Lalitha. L1, Maheswari.B2,Dr.Karthik.S3, “A Detailed Survey on Various Record Deduplication Methods”, International Journal of Advanced Research in Computer Engineering & Technology (IJARCET)Volume 1, Issue 8, October 2012
[7] R.Supriya1, K. Sathyaseelan2,” Secure Deduplication Using Jenkins Hash Function” Ncraccess -2015.
[8] Amanpreet Kaur, 2Sonia Sharma “An Efficient Framework and Techniques of Data Deduplication in Cloud Computing ”, IJCST Vol. 8, Iss ue 2, April - June 2017.
[9] Lalitha. L1, Maheswari.B2,Dr.Karthik.S3, “A Detailed Survey on Various Record Deduplication Methods”, International Journal of Advanced Research in Computer Engineering & Technology (IJARCET)Volume 1, Issue 8, October 2012.
[10] Poonam R. Wagh, Amol D. Potgantwar, "Providing Security to Data Stored on HDFS Using Security Protocol", International Journal of Scientific Research in Network Security and Communication, Vol.5, Issue.4, pp.20-25, 2017.