Abstract

Aim of study to extend the implementation of Matlab to Mapreduce translation based on the M2M translation technique. Cloud computing is a service which provides services by handling massive amount of data. To handle it effectively it needs some technology like Hadoop. Hadoop is an open source project written in java. It is optimised to handle massive amount of data (structured, unstructured, semi-structured) through parallelism. Thus to achieve this parallelism Hadoop Distributed File System (HDFS) uses Mapreduce as a programming index. Here proposing a translator which converts Matlab commands to Mapreduce commands especially concentrated in executing some basic commands in Mapreduce environment to access large datasets. Matlab is a very effective tool for numerical computing since executing this command in a platform independent, distributed environment makes it more efficient.

Keywords:

Cloud computing, hadoop, mapreduce, matlab, parallel computing,

References

1. Beyer, K.S., V. Ercegovac, R. Gemulla, A. Balmi, M. Eltabakhy, C.C. Kanne, F. Ozcan and E.J. Shekita, 2011. Jaql: A scripting language for large scale semistructured data analysis. Proc. PVLDB Endowment, 4(12): 1272-1283.
   
2. Chappell, D., 2014. Microsoft Azure Data Technologies: An Overview. Chappell & Associates, Sponsored by Microsoft Corporation, pp: 1-15.
   PMid:24791949 PMCid:PMC4780985    
3. Chen, C.C., M.H. Hung, N.H.T. Giang, H.C. Lin and T.C. Lin, 2013. Design and implement a mapreduce framework for executing standalone software packages in hadoop-based distributed environments. Smart Sci., 1(2): 99-107.
   CrossRef    
4. Deyhim, P., 2013. Amazon Web Services-Best Practices for Amazon EMR. pp: 1-38. Retrieved from: https://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf.
   Direct Link
5. Lee, R., T. Luo, Y. Huai, F. Wang, Y. He and X. Zhang, 2011. YSmart: Yet another SQL-to-MapReduce translator. Proceeding of the 31st International Conference on Distributed Computing Systems (ICDCS, 2011). Minneapolis, MN, pp: 25-36.
   
6. Olston, C., B. Reed, U. Srivastava, R. Kumar and A. Tomkins, 2008. Pig Latin: A not-so-foreign language for data processing. Proceeding of the 2008 ACM SIGMOD International Conference on Management of Data (SIGMOD '08), pp: 1099-1110.
   CrossRef    
7. Quinn, M.J., A. Malishevsky, N. Seelam and Y. Zhao, 1998. Preliminary results from a parallel MATLAB compiler. Proceeding of the International Parallel Processing Symposium, pp: 81-87.
   CrossRef    
8. Surendran, R. and B.K. Samhitha, 2014. Energy aware grid resource allocation by using a novel negotiation model. J. Theor. Appl. Inform. Technol., 68(3): 485-492.
   
9. Tamilvizhi, T., B. Parvatha Varthini and R. Surendran, 2015. An improved solution for resource management based on elastic cloud balancing and job shop scheduling. ARPN J. Eng. Appl. Sci., 10(18): 8205-8210.
   
10. Thusoo, A., J.S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff and R. Murthy, 2009. Hive: A warehousing solution over a map-reduce framework. Proc. VLDB Endowment, 2(2): 1626-1629.
    CrossRef    
11. Wang, L., G. von Laszewski, A. Younge, X. He, M. Kunze, J. Tao and C. Fu, 2010. Cloud computing: A perspective study. New Generat. Comput., 28(2): 137-146.
    CrossRef    
12. White, T., 2011. Hadoop: The Definitive Guide. 2nd Edn., O'Reilly, Farnham, pp: 1-625.
    PMCid:PMC4798252    Direct Link
13. Zhang, J., D. Xiang, T. Li and Y. Pan, 2013. M2M: A simple matlab-to-mapReduce translator for cloud computing. Tsinghua Sci. Technol., 18(1): 1-9.
    CrossRef    

Competing interests

The authors have no competing interests.

Open Access Policy

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Copyright

The authors have no competing interests.