Energy-Aware Task Scheduling Using Hybrid Firefly-BAT (FFABAT) in Big Data

Senthilkumar, M.

doi:10.2478/cait-2018-0031

Abstract

In modern times there is an increasing trend of applications for handling Big data. However, negotiating with the concepts of the Big data is an extremely difficult issue today. The MapReduce framework has been in focus recently for serious consideration. The aim of this study is to get the task-scheduling over Big data using Hadoop. Initially, we prioritize the tasks with the help of k-means clustering algorithm. Then, the MapReduce framework is employed. The available resource is optimally selected using optimization technique in map-phase. The proposed method uses the FireFly Algorithm and BAT algorithms (FFABAT) for choosing the optimal resource with minimum cost value. The bat-inspired algorithm is a meta-heuristic optimization method developed by Xin-She Yang (2010). This bat algorithm is established on the echo-location behaviour of micro-bats with variable pulse rates of emission and loudness. Finally, the tasks are scheduled with the optimal resource in reducer-phase and stored in the cloud. The performance of the algorithm is analysed, based on the total cost, time and memory utilization.

References

1. Fister, I., X. S. Yang, J. Brest. A Comprehensive Review of Firefly Algorithms. – Swarm Evol. Comput., Vol. 13, 2013, pp. 34-46.10.1016/j.swevo.2013.06.001
Search in Google Scholar Back to article
2. Fister, I., D. Fister, X. S. Yang. A Hybrid Bat Algorithm. – Elektroteh. Vestnik/Electrotechnical Rev., Vol. 80, 2013, No 1-2, pp. 1-7.
Search in Google Scholar Back to article
3. Rasooli, A., D. G. Down. A Hybrid Scheduling Approach for Scalable Heterogeneous Hadoop Systems, 2012.10.1109/SC.Companion.2012.155
Search in Google Scholar Back to article
4. Hassanzadeh, T., M. R. Meybodi. A New Hybrid Approach for Data Clustering Using Firefly Algorithm and k-Means. – In: 16th CSI Int. Symp. Artif. Intell. Signal Process. (AISP’12), IEEE, 2012, No Aisp, pp. 7-11.10.1109/AISP.2012.6313708
Search in Google Scholar Back to article
5. Mishra, S., K. Shaw, D. Mishra. A New Meta-Heuristic Bat Inspired Classification Approach for Microarray Data. – Procedia Technol., Vol. 4, 2012, pp. 802-806.10.1016/j.protcy.2012.05.131
Search in Google Scholar Back to article
6. Yilmaz, S., E. U. Küçüksille. A New Modification Approach on Bat Algorithm for Solving Optimization Problems. – Appl. Soft Comput. J., Vol. 28, 2015, pp. 259-275.10.1016/j.asoc.2014.11.029
Search in Google Scholar Back to article
7. Layeb, A., Z. Benayad. A Novel Firefly Algorithm Based Ant Colony Optimization for Solving Combinatorial Optimization Problems. – International Journal of Computer Science and Applications, Technomathematics Research Foundation, Vol. 11, 2014, No 2, pp. 19-37.
Search in Google Scholar Back to article
8. Senthilkumar, M., Dr. P. Ilango. A Survey on Job Scheduling in Big Data. – Cybernetics and Information Technologies, Vol. 16, 2016, No 3.10.1515/cait-2016-0033
Search in Google Scholar Back to article
9. Bok, K., J. Hwang, J. Lim, Y. Kim, J. Yoo. An Efficient MapReduce Scheduling Scheme for Processing Large Multimedia Data. – In: Multimed. Tools Appl., 2016.10.1007/s11042-016-4026-6
Search in Google Scholar Back to article
10. Apostolopoulos, T., A. Vlachos. Application of the Firefly Algorithm for Solving the Economic Emissions Load Dispatch Problem. – Int. J. Comb., Vol. 2011, 2011, pp. 1-23.10.1155/2011/523806
Search in Google Scholar Back to article
11. Paper, C. Artificial Bee Colony. – Firefly and Bat Algorithm in Unconstrained Optimization, No October 2016.
Search in Google Scholar Back to article
12. Yang, X.-S., A. H. Gandomi. Bat Algorithm: A Novel Approach for Global Engineering Optimization. – Eng. Comput. (Swansea, Wales), Vol. 29, 2012, No 5, pp. 464-483.10.1108/02644401211235834
Search in Google Scholar Back to article
13. Yang, X.-S., X. He. Bat Algorithm: Literature Review and Applications. – Int. J. Bio-Inspired Comput., Vol. 5, 2013, No 3, pp. 141-149.10.1504/IJBIC.2013.055093
Search in Google Scholar Back to article
14. Zhou, K., C. Fu, S. Yang. Big Data Driven Smart Energy Management: From Big Data to Big Insights. – Renew. Sustain. Energy Rev., Vol. 56, 2016, pp. 215-225.10.1016/j.rser.2015.11.050
Search in Google Scholar Back to article
15. Satish, K. V. R., N. P. Kavya. Big Data Processing with Harnessing Hadoop – MapReduce for Optimizing Analytical Workloads. – In: Proc. 2014 Int. Conf. Contemp. Comput. Informatics, (IC3I’14), 2014, pp. 49-54.
Search in Google Scholar Back to article
16. Goyal, A., N. S. Chahal. Bio Inspired Approach for Load Balancing to Reduce Energy Consumption in Cloud Data Center. – Int. Conf. Commun. Control Intell. Syst. CCIS 2015, 2016, pp. 406-410.10.1109/CCIntelS.2015.7437950
Search in Google Scholar Back to article
17. Kar, A. K. Bio Inspired Computing – A Review of Algorithms and Scope of Applications. – Expert Syst. Appl., Vol. 59, 2016, No April, pp. 20-32.10.1016/j.eswa.2016.04.018
Search in Google Scholar Back to article
18. Breast Cancer Detection Based on a Hybrid Approach of Firefly Algorithm and Intelligent Systems. – Indian Journal of Fundamental and Applied Life Sciences, Vol. 5, 2015, pp. 468-472.
Search in Google Scholar Back to article
19. Agarwal, P., S. Mehta. Comparative Analysis of Nature Inspired Algorithms on Data Clustering. – In: Proc. of 2015 IEEE Int. Conf. Res. Comput. Intell. Commun. Networks (ICRCICN’15), 2016, pp. 119-124.10.1109/ICRCICN.2015.7434221
Search in Google Scholar Back to article
20. Chen, C. L. P., C. Y. Zhang. Data-Intensive Applications, Challenges, Techniques and Technologies: A Survey on Big Data. – Inf. Sci. (Ny)., Vol. 275, 2014, pp. 314-347.10.1016/j.ins.2014.01.015
Search in Google Scholar Back to article
21. Thippa Reddy, G., N. Khare. FFBAT-Optimized Rule Based Fuzzy Logic Classifier for Diabetes. – Int. J. Eng. Res. Africa, Vol. 24, 2016, No October, pp. 137-152.10.4028/www.scientific.net/JERA.24.137
Search in Google Scholar Back to article
22. Yang, X. S., X. He. Firefly Algorithm: Recent Advances and Applications. – Int. J. Swarm Intell., Vol. 1, 2013, No 1, p. 36.10.1504/IJSI.2013.055801
Search in Google Scholar Back to article
23. Yang, X.-S. Firefly Algorithms for Multimodal Optimization. – In: Proc. of 5th Int. Conf. Stoch. Algorithms Found. Appl., 2009, pp. 169-178.10.1007/978-3-642-04944-6_14
Search in Google Scholar Back to article
24. Baker, T., B. Al-Dawsari, H. Tawfik, D. Reid, Y. Ngoko. GreeDi: An Energy Efficient Routing Algorithm for Big Data on Cloud. – Ad Hoc Networks, Vol. 35, 2015, pp. 83-96.10.1016/j.adhoc.2015.06.008
Search in Google Scholar Back to article
25. Hybrid Bat Algorithm for Overlapping Community Detection Overlapping Hybrid. – IFAC-Paper Online, 2016-Elsevier, No October, 2016.
Search in Google Scholar Back to article
26. Kora, P., S. R. Kalva. Improved Bat Algorithm for the Detection of Myocardial Infarction. – Springerplus, Vol. 4, 2015, No 1, p. 666.10.1186/s40064-015-1379-7463183926558169
Search in Google Scholar Back to article
27. Senthilkumar, M., N. Manikandan, U. Senthilkumaran, R. Samy. Weather Data Analysis Using Hadoop. – International Journal of Pharmacy and Technology, Vol. 8, 2016, No 4, pp. 21827-21834.
Search in Google Scholar Back to article
28. Gandomi, A. H., X. S. Yang, A. H. Alavi. Mixed Variable Structural Optimization Using Firefly Algorithm. – Comput. Struct., Vol. 89, 2011, No 23-24, pp. 2325-2336.10.1016/j.compstruc.2011.08.002
Search in Google Scholar Back to article
29. Parpinelli, R. S., H. S. Lopes. New Inspirations in Swarm Intelligence: A Survey. – Int. J. Bio-Inspired Comput., Vol. 3, 2011, No 1, p. 1.10.1504/IJBIC.2011.038700
Search in Google Scholar Back to article
30. Chaturbhuj, K. S. Parallel Clustering of Large Data Set on Hadoop Using Data Mining Techniques. – In: Proc. of World Conference on Futuristic Trends in Research and Innovation for Social Welfare (Startup Conclave), IEEE, Coimbatore, India, 2016, pp. 5-8.10.1109/STARTUP.2016.7583955
Search in Google Scholar Back to article
31. Feller, E., L. Ramakrishnan, C. Morin. Performance and Energy Efficiency of Big Data Applications in Cloud Environments: A Hadoop Case Study. – J. Parallel Distrib. Comput., Vol. 79-80, 2015, pp. 80-89.10.1016/j.jpdc.2015.01.001
Search in Google Scholar Back to article
32. Yang, X. Research and Development in Intelligent Systems XXVI. – Development, Springer, 2010.
Search in Google Scholar Back to article
33. Overview, A., I. Applications, B. S. Mienda, A. Yahya, I. A. Galadima, M. S. Shamsir. Research Journal of Pharmaceutical, Biological and Chemical Sciences. – Res. J. Pharm. Biol. Chem. Sci., Vol. 5, No 388, pp. 388-396.
Search in Google Scholar Back to article
34. Chen, J. Research on Resource Scheduling in Cloud Computing Based on Firefly Genetic Algorithm. – Int. J. of Grid and Distributed Computing, Vol. 9, 2016, No 7, pp. 141-148.10.14257/ijgdc.2016.9.7.15
Search in Google Scholar Back to article
35. Singh, S., I. Chana, M. Singh, R. Buyya. SOCCER: Self-Optimization of Energy-Efficient Cloud Resources. – Cluster Comput., Vol. 19, 2016, No 4, pp. 1787-1800.10.1007/s10586-016-0623-4
Search in Google Scholar Back to article
36. Satapathy, S., A. Naik. Social Group Optimization (SGO): A New Population Evolutionary Optimization Technique. – Complex Intell. Syst., Vol. 2, 2016, No 3, pp. 173-203.10.1007/s40747-016-0022-8
Search in Google Scholar Back to article
37. Liang, X., W. Li, P. Liu, Y. Zhang, A. A. Agbo. Social Network Based on Swarm Optimization Algorithm. – Semantic Scholar, 2015, pp. 360-365.10.1109/ICNSC.2015.7116063
Search in Google Scholar Back to article
38. Cheng, S., B. Liu, T. O. Ting, Q. Qin, Y. Shi, K. Huang. Survey on Data Science with Population-Based Algorithms. – Big Data Anal., Vol. 1, 2016, No 1, p. 3.10.1186/s41044-016-0003-3
Search in Google Scholar Back to article
39. Brahmwar, M., M. Kumar, G. Sikka. Tolhit – A Scheduling Algorithm for Hadoop Cluster. – Procedia Comput. Sci., Vol. 89, 2016, pp. 203-208.10.1016/j.procs.2016.06.043
Search in Google Scholar Back to article
40. Senthikumar, M., P. Ilango. Big Data Optimization for Social Networking Tweet. – International Journal of Soft Computing, Vol. 11, 2016, No 5, pp. 305-311. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85011357358&doi=10.3923%2fijscomp.2016.305.311&partnerID=40&md5=aa1f3c8b978a2ec629ac50f180a2f3ac DOI: 10.3923/ijscomp.2016.305.311
Search in Google Scholar Back to article
41. Senthilkumar, M., P. Ilango. Analysis of DNA Data Using Hadoop Distributed File System. – Research Journal of Pharmaceutical, Biological and Chemical Sciences, Vol. 7, 2016, No 3, pp. 796-803.
Search in Google Scholar Back to article

Energy-Aware Task Scheduling Using Hybrid Firefly-BAT (FFABAT) in Big Data

Abstract

Paradigm

My account