Abstract

Grid technologies have brought the promise of flawless combination of distributed heterogeneous resources. Scheduling in Grid computing is the hot topic of research and challenging to manage task, job in efficient manner. For instance, tasks are assumed to include all data needed for its computation or tasks are just the processes and data is assumed to be available in Grid nodes. All the existing works doesn’t focus on the data aware scheduling framework and it is almost impossible to make an optimal or approximate optimal scheduling for the end-to-end workflow with considering the intermediate data movement in grid computing environment. In order to solve this problem in this study a novel Community Scheduler Framework (CSF) approach is proposed for solving the job and data aware scheduling problem together and it can be integrated to grid host environment. The system is able to find data-affinity hosts for user requested jobs and to adjust the data replicas dynamically according to the job load. The proposed work reviews the policies for scheduling of grid jobs in the context of data and task aware-intensive applications. Proposed data and task aware CSF Meta scheduler framework makes it possible for job requests to set data needs not only as absolute requirements but also as functions for resource ranking. As the experimental results show that, this makes it more flexible than currently used resource brokers to implement different data-aware scheduling algorithms. The experimentation of the proposed Meta scheduler work is implemented with the help of grid simulation toolkit.

Keywords:

Community Scheduler Framework (CSF), data aware scheduling, grid computing, grid simulation toolkit, Job aware scheduling, scheduling,

References

1. Banino, C., O. Beaumont, L. Carter, J. Ferrante, A. Legrand and Y. Robert, 2004. Scheduling strategies for master-slave tasking on heterogeneous processor platforms. IEEE T. Parall. Distr., 15: 319-330.
   CrossRef    
2. Braun, T.D., H.J. Siegel, N. Beck, L.L. Boloni, M. Maheswaran, A.I. Reuther, J.P. Robertson, M.D. Theys, B. Yao, D. Hensgen and R.F. Freund, 2000. A comparison study of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. Technical Report TR-ECE-00-4, School of Electrical and Computer Engineering, Purdue University.
   
3. Broberg, J., S. Venugopal and R. Buyya, 2008. Market-oriented Grid and utility computing: The state-of-the-art and future directions. J. Grid Comput., 3(6): 255-276.
   CrossRef    
4. Cao, J., S.A. Jarvis, S. Saini and G.R. Nudd, 2003. GridFlow: Workflow management for grid computing. Proceeding of the 3rd International Symposium on Cluster Computing and the Grid (CCGrid'03), pp: 198-205.
   
5. Casavant, T.L. and J.G. Kuhl, 1988. A taxonomy of scheduling in general-purpose distributed computing systems. IEEE T. Software Eng., 14(2): 141-154.
   CrossRef    
6. Christodoulopoulos, K., V. Sourlas, I. Mpakolas and E. Varvarigos, 2009. A comparison of centralized and distributed meta-scheduling architectures for computation and communication tasks in Grid networks. Comput. Commun., 29: 1172-1184.
   CrossRef    
7. Foster, Y.Z., I. Raicu and S. Lu, 2008. Cloud computing and grid computing 360-degree compared. Proceeding of the IEEE Grid Computing Environments Workshop (GCE'2008). Austin, TX, pp: 1-10.
   CrossRef    PMCid:PMC2650228    
8. Gandotra, I., P. Abrol, P. Gupta, R. Uppa and S. Singh, 2011. Cloud computing over cluster, grid computing: A comparative analysis. J. Grid Distr. Comput., 1(1): 1-4.
   
9. Heymann, E., M.A. Senar, E. Luque and M. Livny, 2000. Adaptive scheduling for master-worker applications on the computational grid. Proceeding of the 1st IEEE/ACM International Workshop on Grid Computing (GRID 2000), Springer-Verlag, London, U.K., pp: 214-227.
   CrossRef    
10. Kosar, T. and M. Livny, 2004. Stork: Making data placement a first class citizen in the grid. Proceeding of the 24th International Conference on Distributed Computing Systems, pp: 342-349.
    CrossRef    
11. Kosar, T. and M. Balman, 2008. A new paradigm: Data-aware scheduling in grid computing. Future Gener. Comp. Sy., 25(4): 406-413.
    CrossRef    
12. Platform Computing Co., 2004. Open Source Metascheduling for Virtual Organizations with the Community Scheduler Framework (CSF)[WP].
    Direct Link
13. Radha, B. and V. Sumathy, 2009. Comparison of ACO and PSO in grid job scheduling. CIIT Int. J. Network. Commun. Eng., ISSN 0974-9713 and Online: ISSN 0974-9616, DOI: NCE102009003.
    
14. Yu, J. and R. Buyya, 2006. A taxonomy of workflow management systems for grid computing. J. Grid Comput., 3(3): 171-200.
    CrossRef    

Competing interests

The authors have no competing interests.

Open Access Policy

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Copyright

The authors have no competing interests.