Hadoop Mapreduce Outline in Big Figures Analytics
M. Dhivya1 , D. Ragupathi2 , V.R. Kumar3
Section:Research Paper, Product Type: Journal Paper
Volume-2 ,
Issue-9 , Page no. 100-104, Sep-2014
Online published on Oct 04, 2014
Copyright © M. Dhivya, D. Ragupathi, V.R. Kumar . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
View this paper at Google Scholar | DPI Digital Library
How to Cite this Paper
- IEEE Citation
- MLA Citation
- APA Citation
- BibTex Citation
- RIS Citation
IEEE Style Citation: M. Dhivya, D. Ragupathi, V.R. Kumar, “Hadoop Mapreduce Outline in Big Figures Analytics,” International Journal of Computer Sciences and Engineering, Vol.2, Issue.9, pp.100-104, 2014.
MLA Style Citation: M. Dhivya, D. Ragupathi, V.R. Kumar "Hadoop Mapreduce Outline in Big Figures Analytics." International Journal of Computer Sciences and Engineering 2.9 (2014): 100-104.
APA Style Citation: M. Dhivya, D. Ragupathi, V.R. Kumar, (2014). Hadoop Mapreduce Outline in Big Figures Analytics. International Journal of Computer Sciences and Engineering, 2(9), 100-104.
BibTex Style Citation:
@article{Dhivya_2014,
author = {M. Dhivya, D. Ragupathi, V.R. Kumar},
title = {Hadoop Mapreduce Outline in Big Figures Analytics},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {9 2014},
volume = {2},
Issue = {9},
month = {9},
year = {2014},
issn = {2347-2693},
pages = {100-104},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=262},
publisher = {IJCSE, Indore, INDIA},
}
RIS Style Citation:
TY - JOUR
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=262
TI - Hadoop Mapreduce Outline in Big Figures Analytics
T2 - International Journal of Computer Sciences and Engineering
AU - M. Dhivya, D. Ragupathi, V.R. Kumar
PY - 2014
DA - 2014/10/04
PB - IJCSE, Indore, INDIA
SP - 100-104
IS - 9
VL - 2
SN - 2347-2693
ER -
VIEWS | XML | |
3578 | 3456 downloads | 3513 downloads |
Abstract
As Hadoop is a Substantial scale, exposed basis software design scheme dedicated to adaptable, disseminated, info concentrated processing. Hadoop [1] mapreduce is a software design construction for professionally composing requisitions which prepare boundless events of info (multi-terabyte info sets) in parallel on extensive bunches (many hubs) of merchandise fittings in a dependable, shortcoming tolerant way. A mapreduce [6] skeleton comprises of two parts. They are "mapper" and "reducer" which consume remained inspected in this paper. Fundamentally this newspaper saves tabs on mapreduce adapting model, preparation undertakings, overseeing and re-execution of the fizzled assignments. Workflow of mapreduce is designated in this exchange.
Key-Words / Index Term
Framework, HDFS, Mapreduce, Shuffle, Workflow
References
[1] Yuan Bao ; Lei Ren ; Lin Zhang ; Xuesong Zhang ; Yongliang Luo �Massive sensor data management framework in Cloud manufacturing based on Hadoop� Industrial Informatics (INDIN), 2012 10th IEEE International Conference on Publication Year: 2012 , Page(s): 397 - 401
[2] Abbasi, A. ; Khunjush, F. ; Azimi, R. �A preliminary study of incorporating GPUs in the Hadoop framework� Computer Architecture and Digital Systems (CADS), 2012 16th CSI International Symposium on Publication Year: 2012 , Page(s): 178 � 185
[3] R.K. ; Manimegalai, R. ; Kumar, S.S. �Medical Image Retrieval System in Grid Using Hadoop Framework Grace�, Computational Science and Computational Intelligence (CSCI), 2014 International Conference on Volume: 1 Publication Year: 2014 , Page(s): 144 � 148
[4] Tomar, Anuradha ; Bodhankar, Jahnavi ; Kurariya, Pavan ; Jain, Priyanka ; Lele, Anuradha ; Darbari, Hemant ; Bhavsar, Virendrakumar C. �Translation Memory for a Machine Translation System Using the Hadoop Framework� Advances in Computing and Communications (ICACC), 2014 Fourth International Conference on Publication Year: 2014 , Page(s): 203 � 207
[5] Lan Huang ; Wang Xiao-wei ; Zhai Yan-dong ; Bin Yang �Extraction of User Profile Based on the Hadoop Framework Wireless Communications�, Networking and Mobile Computing, 2009. WiCom `09. 5th International Conference on Publication Year: 2009 , Page(s): 1 - 6
[6] Therdphapiyanak, J. ; Piromsopa, K. �An analysis of suitable parameters for efficiently applying K-means clustering to large TCPdump data set using Hadoop framework� Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), 2013 10th International Conference on Publication Year: 2013 , Page(s): 1 � 6
[7] Sethi, Priyanka, Kumar, Prakash �Leveraging hadoop framework to develop duplication detector and analysis using Mapreduce, Hive and Pig� Contemporary Computing (IC3), 2014 Seventh International Conference on Publication Year: 2014 , Page(s): 454 � 460
[8] Jai-Andaloussi, S. ; Elabdouli, A. ; Chaffai, A. ; Madrane, N. ;Sekkaki, A. �Medical content based image retrieval by using the Hadoop framework� Telecommunications (ICT), 2013 20th International Conference on Publication Year: 2013 , Page(s): 1 � 5
[9] Hui Li ; Chunmei Liu �Prediction of protein structures using a map-reduce Hadoop framework based simulated annealing algorithm� Bioinformatics and Biomedicine (BIBM), 2013 IEEE International Conference on Publication Year: 2013 , Page(s): 6 � 10
[10] Weikuan Yu ; Yandong Wang ; Xinyu Que �Design and Evaluation of Network-Levitated Merge forHadoop Acceleration� Parallel and Distributed Systems, IEEE Transactions on Volume: 25 , Issue: 3 Publication Year: 2014 , Page(s): 602 � 611
[11] Shen Li ; Shaohan Hu ; Shiguang Wang ; Lu Su ; Abdelzaher, T. ;Gupta, I. ; Pace, R. �WOHA: Deadline-Aware Map-Reduce Workflow Scheduling Framework over Hadoop Clusters Distributed Computing Systems (ICDCS)�, 2014 IEEE 34th International Conference on Publication Year: 2014 , Page(s): 93 � 103
[12] Lightweight workflow engine based on HADOOP and OSGI Shengmei Luo ; Lixia Liu ; Juan Yang ; Di Zhang Broadband Network & Multimedia Technology (IC-BNMT), 2013 5th IEEE International Conference on Publication Year: 2013 , Page(s): 262 � 267
[13] Wenjun Wu ; Hui Zhang ; Yaokuan Mao ; Liang Luo GreenPipe,�A Hadoop Based Workflow System on Energy-efficient Clouds� Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2012 IEEE 26th International Publication Year: 2012 , Page(s): 2211 - 2219
[14] Sethi, M. ; Sachindran, N. ; Raghavan, S. �SASH: Enabling continuous incremental analytic workflowson Hadoop Data Engineering (ICDE), 2013 IEEE 29th International Conference on Publication Year: 2013 , Page(s): 1219 � 1230
[15] Gattiker, A. ; Gebara, F.H. ; Hofstee, H.P. ; Hayes, J.D. ; Hylick, A. �Big Data text-oriented benchmark creation for Hadoop� IBM Journal of Research and Development Volume: 57 , Issue: 3/4 Publication Year: 2013 , Page(s): 10:1 - 10:6
[16] Liu, Yewei ; Xiao, Guirong ; Wu, Jianwei ; Lin, Jianfeng CSWf: A cloud service workflow system Information Science and Technology (ICIST), 2013 International Conference on Publication Year: 2013 , Page(s): 408 � 413
[17] Zhuoyao Zhang ; Cherkasova, L. ; Boon Thau Loo Getting more for less in optimized MapReduce workflows Integrated Network Management (IM 2013), 2013 IFIP/IEEE International Symposium on Publication Year: 2013 , Page(s): 93 � 100
[18] Altintas, I.�Workflow-driven programming paradigms for distributed analysis of biological big data� Computational Advances in Bio and Medical Sciences (ICCABS), 2013 IEEE 3rd International Conference Publication Year: 2013 ,
Page(s): 1-5
[19] Rongrong Gu ; Shaochun Wu ; Han Dong ; Yongquan Xu ; Gaozhao Chen ; Lingyu Xu A Modeling Method of Scientific Workflow Based on Cloud Environment Computer and Information Science (ICIS), 2012 IEEE/ACIS 11th International Conference on Publication Year: 2012 , Page(s): 31 � 36
[20] Tudoran, R. ; Costan, A. ; Rad, R.R. ; Brasche, G. ; Antoniu, G. �Adaptive file management for scientific workflows on the Azure cloud Big Data�, 2013 IEEE International Conference on Publication Year: 2013 , Page(s): 273 - 281
[21] Jingui Li ; Xuelian Lin ; Xiaolong Cui ; Yue Ye �Improving the Shuffle of Hadoop MapReduce Cloud Computing Technology and Science (CloudCom)�, 2013 IEEE 5th International Conference on Volume: 1 Publication Year: 2013 , Page(s): 266 � 273
[22] Yandong Wang ; Cong Xu ; Xiaobing Li ; Weikuan Yu �JVM-Bypass for Efficient Hadoop Shuffling� Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on Publication Year: 2013 , Page(s): 569 � 578
[23] Mandal, A. ; Yufeng Xin ; Baldine, I. ; Ruth, P. ; Heerman, C. ; Chase, J. ; Orlikowski, V. ; Yumerefendi, A. �Provisioning and Evaluating Multi-domain Networked Clouds for Hadoop-based Applications Cloud Computing Technology and Science (CloudCom)�, 2011 IEEE Third International Conference on Publication Year: 2011 , Page(s): 690 - 697
[24] Wasi-Ur-Rahman, M. ; Islam, N.S. ; Xiaoyi Lu ; Jose, J. ; Subramoni, H. ; Hao Wang ; Panda, D.K.D. �High-Performance RDMA-based Design of HadoopMapReduce over InfiniBand� Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2013 IEEE 27th International Publication Year: 2013 , Page(s): 1908 � 1917
[25] Hadoop Acceleration in an OpenFlow-Based Cluster Narayan, S. ; Bailey, S. ; Daga, A. High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion: Publication Year: 2012 , Page(s): 535 - 538