Research ArticleOpen AccessGoogle Scholar indexed
Hadoop and Its Role in Modern Image Processing
Bozorgmehr University, Ghayen, Iran
Birjand University of Technology, Birjand, Iran
- 1 Bozorgmehr University, Ghayen, Iran
- 2 Birjand University of Technology, Birjand, Iran
Open Journal of Marine Science·Volume 04 (2014)·Pages 239–245·Published 15 October 2014·DOI10.4236/ojms.2014.44022
Copy link · social · email
Abstract
This paper introduces MapReduce as a distributed data processing model using open source Hadoop framework for manipulating large volume of data. The huge volume of data in the modern world, particularly multimedia data, creates new requirements for processing and storage. As an open source distributed computational framework, Hadoop allows for processing large amounts of images on an infinite set of computing nodes by providing necessary infrastructures. This paper introduces this framework, current works and its advantages and disadvantages.
KeywordsCloud ComputingHadoopBig DataImage ProcessingMapReduce Model
- Gartner Reserch (2012) Top 10 Strategic Technologies for 2012. http://www.gartner.com/it/page.jsp?id=1826214
- Bakshi, K. (2012) Considerations for Big Data: Architecture and Approach. Aerospace Conference-Big Sky, MT, 3-10 March 2012.
- Michael, K. and Miller, K.W. (2013) Big Data: New Opportunities and New Challenges. Journal of IEEE Computer Society, 46, 22-24.
- White, B., Tom, Y., Jimmy, L. and Davis, L.S. (2010) Web-Scale Computer Vision Using MapReduce for Multimedia Data Mining. Proceedings of the 10th International Workshop on Multimedia Data Mining, Washington DC, 25-28 July 2010, 1-10.
- Dean, J. and Ghemawat, S. (2008) MapReduce: Simplified Data Processing on Large Clusters. Communications of the ACM, 51, 107-114.
- The New York Times Blog (2007) http://open.blogs.nytimes.com/2007/11/01/self-service-prorated-super-computing-fun/
- Kalagiakos, P. (2011) Cloud Computing Learning. Application of Information and Communication Technologies (AICT). 5th International Conference, 12-14 October 2011.
- Hadoop. http://hadoop.apache.org/
- http://en.wikipedia.org/wiki/Apache_Hadoop
- HDFS. http://hadoop.apache.org/hdfs/
- MapReduce. http://en.wikipedia.org/wiki/MapReduce
- Bhandarkar, M. (2010) MapReduce Programming with Apache Hadoop. Parallel &Distributed Processing (IPDPS) IEEE, 19-23 April 2010.
- Kelly, J. (2012) Big Data: Hadoop, Business Analytics and Beyond. Wikibon Whitepaper, 27 August 2012. http://wikibon.org/wiki/v/Big_Data:_Hadoop,_Business_Analytics_and_Beyond
- http://hadooper.blogspot.com/
- Twister. http://www.iterativemapreduce.org/
- The Phoenix System for MapReduce Programming. http://mapreduce.stanford.edu/
- Qura Question and Answer Website. http://www.quora.com/What-are-some-promising-open-source-alternatives-to-Hadoop-MapReduce-for-map-reduce
- Li, Y., Crandall, D.J. and Huttenlocher, D.P. (2009) Landmark Classification in Large-Scale Image Collections. ICCV, 1957-1964.
- Kennedy, L., Slaney, M. and Weinberger, K. (2009) Reliable Tags Using Image Similarity: Mining Specificity and Expertise from Large-Scale Multimedia Databases. Proceedings of the 1st Workshop on Web-Scale Multimedia Corpus, Beijing, 23-23 October 2009, 17-24.