Abstract
In the existing economy based models of grid resource allocation and management, just as commodity market model and posted price model, sharing resource is based on negotiating about the usage duration or time, the usage fee, QoS (Quality of Service) and some other items between the owner or his broker and the consumer of grid resource. That will cost so much time for a great deal of grid users no matter whether they are grid resource owners or grid resource consumers, which reduced the sharing efficiency in the grid environment and some time is even unacceptable. In this paper, for solving the problem as described above, we present a scheme which is combined by 3 aspects: one is GRS (Grid Resource Supermarket), the second one is posted price model based on GRS, the third one is optimization based on MOGAP (Multi-Objects Generalized Assignment Problem). In the end, three examples are given to show the feasibility of our scheme.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Grid resource allocation and management is very complicated and difficult problem because the resources are distributed, heterogeneous in nature, owned by different individuals or organizations each having their own resource management policies and different access-and-cost models. Thus, some resource allocation and management models based on market, or economic models in the grid have been proposed such as commodity market, posted price, tenders and auctions, negotiation price model, contract agreement, model of auctioning, employing exchange model of bid [1–3]. Generally, based on these models, resource consumers make use of GRBs (Grid Resource Broker) to submit applications of the resource consumption. GRBs meet the requirements of these resource consumers via grid middleware services. It is obvious that the process of the sharing will cost much time at negotiating about the usage duration or time, the usage fee, QoS and some other items about sharing access. On the other hand, it is also clear that these models are only beneficial to the grid consumer, who can finish their work at the lower cost.
In this paper, we try to solve the efficiency bottleneck of grid resource sharing, which is combined by 3 aspects: one is GRS, the second one is posted price model based on GRS, the third one is optimization based on MOGAP. We also try to be on behalf of GRM (Grid Resource Manager) and propose the idea of GRS to meet the service of grid resource sharing. Supermarket is welcomed by people and fits the habit of people’s consumption. Constructing GRS by GRS user agent and GRS resource agent, serving grid consumer via GRS user agent, organizing the grid resource from their owner and negotiating about the time, the price and the QoS of resource sharing, we get a new idea of GRAM (Grid resource allocation and management) based on economic model. One important thing is that all the negotiating interaction between the resource provider and the GRS resource agent is finished in background instead of foreground before the resource sharing. After construction of GRS, the grid resources consumer shares the resource just as in the posted price model. Of course, the GRS is always changing because grid is dynamic. Furthermore, GRS managers can profit from price difference between the cost and sale price of the GRS resource. Generalized Assignment Problem (GAP) is used to allot the resource in GRS to optimize the allocation of resource.
The paper is organized as follows. In Sect. 2, the related work are presented. Section 3 introduces the posted price model. Section 4 presents the idea of GRS and its construction. In Sect. 5, the GRS-based posted price model is defined. Section 6 discusses the optimization of allocation of resource. There are some examples in Sect. 7. Finally, conclusions and future work are outlined in the last Sect. 8.
2 Related works
Our work is based on GRS built in virtual organization (VO). Foster clarifies the concept about VO in [4]. VO is a set of individuals and institutions defined by uniform sharing rules.
Classifying based on the economic model, our work falls into the category of posted price model. Posted price model is similarly to the commodity market [5], except that special offers are advertised for notifying consumers discounted prices [6, 7]. One recent work about the commodity market is presented by Gunther Stuer etc., where in order to find price equilibria in commodity market, some refinements of Smale’s method application are proposed [8]. Some other related economic models are bargaining, tendering/contract-net, auction, bid-based, bartering, monopoly and oligopoly, and other various forms.
In bargaining, providers and consumers negotiate each other. Providers commonly want to get higher prices but consumers want to get lower prices. This negotiation continues until both providers and consumers all agree a same price which is acceptable to them. When the price is difficult to define, bargaining is a well economic model to achieve a acceptable price [9]. Tendering /contract-net allows a customer announces requirements to potential producers for looking for the desirable provider [10]. Auction allows consumers to submit bids through an auctioneer until a single clearing price appears, this price is higher than the price other customers can accept [11]. A typical bid-based is the resources assigned are in direct proportion to the bids of the consumers [12]. Bartering supports sharing each others’ resources between providers and consumers, if consumers are also providers and thus both contribute and use resources [13]. Monopoly/oligopoly is non-competitive. There are only a single or a number of providers determines the price [14].
In the commodity market model, resource providers specify their service price and charge users according the amount of resource they consume. A provider uses a brokering system where each request is distributed until the accumulated brokerage cost is limited by the budget of the user [5]. The pricing policy can be derived from various parameters and can be flat or variable depending on the resource supply and demand. In general, services are priced in such a way that supply and demand equilibrium is maintained. Logic structure of commodity model is just shown in Fig. 1.
Some in-depth works on posted price model are presented in [15–17]. Anastasiadi etc. present three routing algorithms which are related with expected completion time and required network bandwidth [28]. Based on it, they investigate the load balancing economy occasions in which providers can advertise prices and transaction requests at a bulletin board [15]. Ferguson etc. investigate the load balancing economy occasions in which First-price and Dutch auctions enable each provider to host its independent auction, and enable users to decide which auction they should participate according to last prices advertised in bulletin boards [16]. In [17], when advertising resource request and prices on a bulletin board, currency flow is used to restrict resource usage in order to control potential intrusion attacks and minimize the damages.
3 Posted price model
Posted price model is related on the commodity market model [1–3]. Two key players driving the grid marketplace are GSPs (Grid Service Providers) and GRBs (Grid Resource Brokers). The posted price model is similar to the commodity market model except that it advertises special offers in order to attract (new) consumers to establish market share or motivate users to consider using cheaper slots. Logic structure of posted price model is given in Fig. 2. In this case, brokers need not negotiate directly with GSPs for flat fee, usage duration or time, QoS etc., but use posted prices as they are generally cheaper compared to regular prices. The posted-price offers will have usage conditions, but they might be attractive for some users.
In Figs. 1, 2, consumers interact with their own brokers for managing and scheduling their computations on the grid. The GSPs make their resource grid enabled by running software systems along with GTS (Grid Trading Services), which enables resource trading and execution of consumer requests directly through GRBs. The interaction between GRBs and GSPs during resource trading is mediated through a GMD (Grid Market Directory). They use various economy models or interaction protocol for deciding service access price. As there are much grid resource user and a great deal of resources in grid environment even in a VO (Virtual Organization), time and efficiency will be their problems.
Some researchers have focused on the job scheduling part of a grid management infrastructure [18]. They either proposed a framework for price-based resource allocation and resources pricing algorithm to achieve maximized utilization of grid resources [19], or formalized the resource allocation problem for Service Level Agreement (SLA)-constrained grid applications [20].
4 Constructing GRS based on multi-agents
The GRS is a virtual, logic entity. It consists of information of a great deal of GSPs (Grid Service providers) and grid resources including traditional resources: computer, network, storage system, and highly generic sense resources that means any capability that may be shared and exploited in a networked environment: database, data transfer, simulation [21]. Obviously, the principle of constructing GRS is to serve the grid users whether they are grid resource providers or consumers, and make the managers of GRS get more profits. In other words, GRS gets the permission of grid resource from the providers or owners of resource in lower price and sell it at higher price to the grid consumers. GRS resource agent and GRS user agent play an important role in GRS management. The model of constructing GRS is as Fig. 3. GRS resource agents take charge of collecting the information of grid resource that can be shared by any others, negotiating about the price and the other items with the resource provider. GRS user agents take charge of responding the grid consumers and leading to the consumers sharing the resources in two modes that we will introduce at the next paragraph.
The grid consumer GRS is built in a VO (Virtual Organization) [22]. Of course, there maybe server GRS in some VO. GRS is a dynamic virtual entity while the resource in it can login or logout dynamic.
For ease of understanding, let’s firstly introduce the concept about VO (Virtual Organization). In grid environment, sharing resource coordinately and solving problems in VO mode are two key functions which should be provided. VO is a set of individuals and institutions defined by uniform sharing rules. This sharing is, necessarily, highly controlled, with resource providers and consumers defining clearly and carefully just what is shared, who is allowed to share, and the conditions under which sharing occurs [4]. Most solving and brokering strategies in grid environment are closely related with this sharing.
The profits of GRS is depended on the policy of the resources that how much to buy in and how much to sell out. Therefore, the resource value in GRS needs to be defined as a function of many parameters as follows: Resource Value=Function (Resource strength, Cost of physical resources, Service overhead, Demand, Value perceived by the user, Preferences). It is also obviously that the resource value can vary after a period of time.
The pricing strategy of GRS is a key problem for their manager. It includes two parts in this paper. One is posted price based GRS model. The other is grid resource optimization based Assignment Problem (AP).
5 Posted price model based on GRS
In the posted price model based on GRS, price is negotiated back the stage by GRS resource agent and grid resource provider. Of course, it is different from the model of posted price which the price is negotiated on the stage.
This is a simplified resource mode based on economy. In this model, grid resource consumers share the GRS resource at posted price. It would not spend time to negotiating about the time, the price, the QoS etc. each other. The manager of GRS gains the profits by serving the grid resource provider and grid resource consumer. The grid resource consumers share the resource at posted price according to their plans and pocketbooks. The grid resource provider gains his income for his resource being shared. The description of this mode is as follows. We might as well suppose that our GRS has n pieces of resources, each resource has his ID, resource name, bank account of owner, access time for sharing, resource amount, price etc., which can be formalized as GRS−R i =(R i -ID,R i -name,R i -account,time,amount,R i-price-in ,…,R i -IP) i=1,2,…,n. We also might as well suppose that GRS-Ri is shared by some grid consumers. The homologous item’s formula is \(\mathit{Sell}\mbox{-}\mathit{R_{i}} =( R_{i}\mbox{-}\mathit{ID}, R_{i}\mbox{-}\mathit{name}, R_{i}\mbox{-}\mathit{account}, \mathit{time}, \mathit{amount}, R_{i\mbox{\scriptsize-}\mathit{price}\mbox{\scriptsize-}\mathit{out}}, \dots,R_{i}\mbox{-}\mathit{IP} )~i=1,2, \dots,n\). Therefore, the manager of GRS gains the profits according to the followings:
In general, R i-price-in is bigger than R i-price-out , thus the manager of GRS can get profits.
There are obvious differences between conventional posted price model and GRS-based posted price model. The main difference is that, all the details about resource sharing such as cost fee, usage duration or time, QoS and other items in our approach are negotiated about while the GRS is constructed. That means a foreground task is changed into background task, and an instant task is changed into preparatory one. Time for negotiating is not necessary any more. It is just the advantage of our approach.
6 Optimization based on GAP
The scheme includes two parts. One is the posted price model based on GRS. The other is grid resource optimization based on GAP (Generalized Assignment Problem) in order to maximize the profits for the GRS manager, which will be presented in this section.
The GRS-based posted price model is fit to the sporadic grid consumers. For the group consumers, a optimized approach is proposed as follows.
Generally, assignment problem can be defined as: There are n persons and n pieces of jobs. Any person can be assigned to perform any job, incurring profits that may vary depending on the person-job assignment. If person j finished the job i by efficiency e ij , it is required to perform all tasks by assigning exactly one person to each job in such a way that the total profits of the assignment is maximized. Furthermore, if there are m persons and n pieces of jobs, and m≥n, which means some job can be done by more than one person. The problem is changed into GAP (General Assignment Problem) [22, 23]. Obviously, the two cases are single object and not adapt to allocation of GRS. Thus, for making it fit to our problems, we need to reconstruct GAP and change it into multi-object GAP. The problems are merely divided into the following two cases [24].
Case 1 There are n pieces of resources and m jobs (m≥n). It is required to perform all jobs by assigning one piece of resource to b j (b j ≥1 one or more than one) job(s) in such a way that the total profits of the assignment is maximized. Here b j is an unknown number, and
We might as well suppose that allocation should think about p factor such as router, bandwidth, price, etc. Assume factor k (k=1,2,…,p) that resource j arranged to job i can make GRS economy efficiency e ij (i=1,2,…,m;j=1,2,…,n), the problem is how to allocate the assignment and make the manager of GRS get the maximum profits.
Model 1
Case 2 There are n pieces of resources and m jobs (m≤n). It is required to perform all jobs by assigning a i (a i ≥1 one or more than one) piece of resource(s) to one job in such a way that the total profits of the assignment is maximized. Here a i is an unknown number, and
We might as well suppose that allocation should think about p factor such as router, bandwidth, price, etc.
Model 2
Assume factor k (k=1,2,…,p) that resource j arranged to job i can make GRS economy efficiency e ij (i=1,2,…,m;j=1,2,…,n), the problem is how to allocate the assignment and make the GRS manager get the maximum profits.
7 Performance evaluation
Model 1 & Model 2 is a general model of allocation of GRS. The solution of these two models has been finished. According to the procedure of multi-object GAP1& multi-object GAP2 [23, 24], we can make a program to simulate test with C++. We give three examples to show the feasibility of our scheme.
7.1 The first example
Suppose
as a small scale case just n=4 and m=3, and matrix M_1,M_2,M_3 is such as matrix of time if each resource would allocate each job, matrix of price if each resource would allocate each job and matrix of efficiency if each resource would allocate each job. After calculating we can get the following:
Matrix R is called a compositive matrix about fuzzy relationship. We can also calculate the expand benefit matrix A.
According to the Hungary algorithm [23], we can also calculate the matrix A.
Combining the fuzzy theory with Hungary algorithm which is applied to solve conventional assignment problem, the last allocation of resource is calculated as the following matrix X.
According to the previous four column of matrix X, x 31=1, x 12=1, x 23=1x 54=1, it is easy to decide the allocation of the resources. That is the first resource to the third job, the second resource to the first job but the third and fourth resources together to the third job. That is the optimization of this allocation.
7.2 The second example
Suppose
as a small scale case just n=4 and m=3, and matrix G 1, G 2,G 3 is such as matrix of time if each resource would allocate each job, matrix of price if each resource would allocate each job and matrix of efficiency if each resource would allocate each job. After calculating we can get matrix A:
Combining the fuzzy theory with Hungary algorithm which is applied to solve conventional assignment problem, the last allocation of resource is calculated as the following matrix X.
According to the previous four row of matrix X, it is easy to decide the allocation that makes the profits reach its maximum. The assignment is:
The second resource to the first job;
The third resource to the third job;
The first and the fourth resource are arranged to the second job.
7.3 The third example
Assume profit matrix
According to above X value, Formula (2) can be changed to (3)
The Hungarian algorithm can mainly be described as the follows:
This algorithm depends on two features of the assignment problem:
-
Each resource must be assigned to one and only one job and vice versa.
-
In the coefficient matrix C, a constant can be added or subtracted from all C ij in a row or all C ij in a column without having any effect on the set of optimal assignment. There are three steps in the Hungarian algorithm:
Step 1: Find the opportunity coefficient matrix.
Step 2: Test for an optimal assignment. If an optimal assignment can be made, make it and stop.
Step 3: Revise the opportunity coefficient matrix and return to step 2.
Let us apply Hungarian algorithm to Formula (4), we can get the result of the assignment.
The assignment is
So, the solution of Formula (3) is
and
is the result of Formula (2) either.
8 Conclusions and future work
In this paper, we present a novel economy model based on GRS, which is a new concept to organize and manage the grid resources in VO. Moreover, we optimize the allocation by combining the fuzzy theory with Hungarian algorithm. At the same time, we set up a procedure and algorithm in order to make more gross profits for the manager of GRS. There are some differences between our approach and the other ones which focus on grid resource consumers, not the manager. In terms of response time and wait time, the improvement of efficiency is achieved by our construction of GRS. The proposed method in this paper is an innovation of grid resource allocation from the angle of resource manager. However, the restrictive condition of the model and algorithm brings disadvantage of applications. Complication and efficiency is not evaluated enough while large numbers of resources and consumer exist. The examples are just a small scale situation (only n=4). It may be very difficult when the n is bigger. We plan to investigate approaches to solve it in our GRS-based posted price model as future work.
References
Buyya, R., Abramson, D., & Venugopal, S. (2005). The grid economy, special issue on grid computing. Proceedings of the IEEE, 93(3), 698–714.
Buyya, R., Stockinger, H., Giddy, J., & Abramson, D. (2001). Economic models for management of resources in peer-to-peer and grid computing, technical track on commercial applications for high-performance computing. In SPIE international symposium on the convergence of information technologies and communications (ITCom 2001), August 20–24, Denver, Colorado, USA (pp. 5–8).
Buyya, R., Abramson, D., Giddy, J., & Stockinger, H. (2002). Economic models for resource management and scheduling in grid, concurrency and computation. Software, Practice & Experience, 14(13–15), 1507–1542.
Foster, I., Kesselman, C., & Tuecke, S. (2001). Anatomy of the grid: enabling scalable virtual organizations. Intl. J. Supercomputer Applications., 15(3), 200–222. www.globus.org/research/papers/anatomy.pdf.
Backschat, M., Pfaffinger, A., & Zenger, C. (1996). Economic-based dynamic load distribution in large workstation networks. In Lecture notes in computer science: Vol. 1124. Proceedings of the 2nd international Euro-Par conference (Euro-Par 1996), Lyon, France, August 1996 (pp. 631–634). Heidelberg: Springer.
Yemini, Y., Dailianas, A., Florissi, D., & Huberman, G. (2000). MarketNet: protecting access to information systems through financial market controls. Decision Support Systems, 25(1–2), 205–216.
HP Grid computing. http://www.hp.com/techservers/grid (6 December 2004).
Stuer, G., Vanmechelen, K., & Broeckhove, J. (2007). A commodity market algorithm for pricing substitutable grid resources. Future Generations Computer Systems, 23(5), 688–701.
Eymann, T., Reinicke, M., Ardaiz, O., Artigas, P., Freitag, F., & Navarro, L. (2003). Decentralized resource allocation in application layer networks. In Proceedings of the 3rd international symposium on cluster computing and the grid (CCGrid 2003), Tokyo, Japan, May 2003 (pp. 645–650). Los Alamitos: IEEE Comput. Soc.
Kale, L. V., Kumar, S., Potnuru, M., DeSouza, J., & Bandhakavi, S. (2004). Faucets: efficient resource allocation on the computational grid. In Proceedings of the international conference on parallel processing (ICPP 2004), Montreal, Canada, August 2004 (pp. 396–405). Los Alamitos: IEEE Comput. Soc.
Lai, K., Huberman, B. A., & Tycoon, F. L. (2004). A distributed market-based resource allocation system. Technical report cs.DC/0404013, HP Lab, Palo Alto, April.
Chun, B. N., & Culler, D. E. (2000). Market-based proportional resource sharing for clusters. Technical report CSD-1092, Computer Science Division, University of California at Berkeley, January.
Cooper, B. F., & Garcia-Molina, H. (2002). Bidding for storage space in a peer-to-peer data preservation system. In Proceedings of the 22nd international conference on distributed computing systems (ICDCS 2002), Vienna, Austria, July 2002 (pp. 372–381). Los Alamitos: IEEE Comput. Soc.
Driskill, R., & McCafferty, S. (2001). Monopoly and oligopoly provision of addictive. Goods International Economic Review, 42(1), 43–72.
Anastasiadi, A., Kapidakis, S., Nikolaou, C., & Sairamesh, J. (1998). A computational economy for dynamic load balancing and data replication. In Proceedings of the 1st international conference on information and computation economies (ICE’98), Charleston, SC, October 1998 (pp. 166–180). New York: ACM Press.
Ferguson, D. F., Yemini, Y., & Nikolaou, C. (1988). Microeconomic algorithms for load balancing in distributed computer systems. In Proceedings of the 8th international conference on distributed computing systems (ICDCS’88), San Jose, CA, June 1988 (pp. 491–499). Los Alamitos: IEEE Comput. Soc.
Yemini, Y., Dailianas, A., Florissi, D., & Huberman, G. (2000). MarketNet: protecting access to information systems through financial market controls. Decision Support Systems, 25(1–2), 205–216.
Ernemann, C., Hamscher, V., & Yahyapour, R. (2002). Economic scheduling in grid computing. Lecture Notes in Computer Science, 2537, 128–152.
Yu, J., Li, M., Li, Y., Hong, F., & Gao, M. (2004). A framework for price-based resource allocation on the grid PDCAT. In LNCS: Vol. 3320 (pp. 341–344).
Menasce, D. A., & Casalicchio, E. (2004). A framework for resource allocation in grid computing in Modeling, analysis, and simulation of computer and telecom-munications systems (MASCOTS 2004). In Proceedings of the IEEE computer society’s 12th annual international symposium (pp. 259–267).
Foster, I., & Kesselman, C. (2004). The grid 2 blueprint for a new computing infrastructure. Amsterdam: Elsevier.
Xu, J., Hu, Z., & Wang, W. (2004). Operations research. Science Press (pp. 211–217).
Song, Y., Chen, M., & Zhang, S. (2001). An efficient algorithm for solving two multi-object generalized assignment problems and its application. Journal of Huazhong University of Science & Technology, 29(1), 70–72.
Song, Y., Chen, M., & Zheng, Z. (2000). Fuzzy Hungary algorithm for solving the multi-object generalized assignment problem. Journal of Naval University of Engineering, 5, 77–94.
Li, M., Chen, X., Jiao, F., & Wu, Z. (2007). Optimization of grid resource allocation combining fuzzy theory with generalized assignment problem. In The 6th international conference on grid and cooperative computing (GCC2007), 2007 August
Li, M., Li, J., & Xie, S. (2007). Posted price model based on GRS and its optimization using in grid resource allocation. In The 3th international conference on wireless communications, networking and mobile computing (WilCOM 2007), 2007 September
Li, M. (2007). Improvement of commodity and posted price model based on GRS. In The 2th international conference on computer science & education (ICCSE2007), 2007 July
Lei, S., Zhang, Y., Yang, L. T., Wang, Y., Hauswirth, M., & Xiong, N. (2010). TPGF: geographic routing in wireless multimedia sensor networks. Telecommunications Systems, 44(1–2), 79–95.
Acknowledgement
This research was supported by Zhejiang Provincial Natural Science Foundation of China (Grant No. Y1090328), China Natural Science Foundation (NSF) (Grant No. 60803105, 60863016) and also supported by the MKE (The Ministry of Knowledge Economy), Korea, under the ITRC (Information Technology Research Center) support program supervised by the NIPA (National IT Industry Promotion Agency) (NIPA-2010-C1090-1031-0004).
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
About this article
Cite this article
Li, M., Xiong, N., Yang, B. et al. Posted price model based on GRS and its optimization for improving grid resource sharing efficiency. Telecommun Syst 55, 71–79 (2014). https://doi.org/10.1007/s11235-013-9752-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11235-013-9752-8