One of the key motivations of computational and data grids is the ability to make coordinated use... more One of the key motivations of computational and data grids is the ability to make coordinated use of heterogeneous computing resources which are geographically dispersed. Consequently, the performance of the network linking all the resources present in a grid has a significant impact on the performance of an application. It is therefore essential to consider network characteristics when carrying out tasks such as scheduling, migration or monitoring of jobs. This work focuses on an implementation of an autonomic network-aware meta-scheduling architecture that is capable of adapting its behavior to the current status of the environment, so that jobs can be efficiently mapped to computing resources. The implementation extends the widely used GridWay meta-scheduler and relies on exponential smoothing to predict the execution and transfer times of jobs. An autonomic control loop (which takes account of CPU use and network capability) is used to alter job admission and resource selection criteria to improve overall job completion times and throughput. The implementation has been tested using a real testbed involving heterogeneous computing resources distributed across different national organizations.
Nowadays, the fog computing paradigm is being consolidated as a solution for processing the explo... more Nowadays, the fog computing paradigm is being consolidated as a solution for processing the explosion of data generated by lots of common IoT devices connected to the Internet. In contrast to cloud computing, fog computing achieves efficient data processing without incurring large latencies or data transfers to/from the cloud. The distributed nature of fog computing makes the resource orchestration a challenge. Commonly used centralized solutions are of limited utility in this context. Moreover, fog nodes are usually resource constrained, so the implementation of the management modules should be carefully designed in order not to cause excessive overheads. On the other hand, blockchain has proven its utility beyond cryptocurrencies, to support distributed and reliable information storage. When combined with smart contracts it can provide a distributed computer where all the nodes independently and equally contribute to a common global system state, which must be agreed by consensus. This also provides inherent desirable features, such as immutability and transparency. In this work, a novel architecture called HIDRA is presented, aimed at resource orchestration in fog computing environments based on a Ethereum blockchain implementation. A prototype implementation on a testbed composed of single-board computers has been carried out. Results show the low overhead introduced into the system and its ability to perform a coordinated action among fog nodes without the intervention of any central authority.
Proceedings of the 17th International Symposium on Parallel and Distributed Processing, 2003
The primary objective of the MultiMedia Router (MMR) project is the design and implementation of ... more The primary objective of the MultiMedia Router (MMR) project is the design and implementation of a compact router optimized for multimedia applications. The router is targeted for use in cluster and LAN interconnection networks, which offer different constraints and therefore differing router solutions than WANs. One of the key elements within the router are the algorithms used to decide the forwarding order of the information that traverses it: the link and switch scheduling algorithms. They help greatly to determine the QoS guarantees delivered to the application flows. Also, conventional best-effort traffic should be seamlessly integrated by scheduling algorithms, in such a way that link bandwidth is efficiently used, but without degrading the QoS guarantees of the multimedia connections. In this work, two solutions for switch scheduling are thoroughly evaluated with mixed workloads (i.e., composed of multimedia and best-effort traffic), and their is performance compared to another well-known approach for switch scheduling, that does not consider QoS requirements when performing scheduling decisions. Results show that, when a QoS-aware switch scheduler is used, the QoS received by the multimedia flows is not affected by the presence of best-effort traffic.
Grid technologies have enabled the aggregation of geographically distributed resources, in the co... more Grid technologies have enabled the aggregation of geographically distributed resources, in the context of a particular application. The network remains an important requirement for any Grid application, as entities involved in a Grid system (such as users, services, and data) need to communicate with each other over a network. The performance of the network must therefore be considered when carrying out tasks such as scheduling, migration or monitoring of jobs. Moreover, the interactions between different domains are a key issue in Grid computing, thus their effects should be considered when performing the scheduling task. In this paper, we enhance an existing framework that provides scheduling of jobs to computing resources to allow multi-domain scheduling based on peer-to-peer techniques.
Proceedings of the 9th international conference on Supercomputing - ICS '95, 1995
Page 1. Petri Net Modeling of Intemonnection Networks for Massively Pamllel Amhitectums. JAGregor... more Page 1. Petri Net Modeling of Intemonnection Networks for Massively Pamllel Amhitectums. JAGregorio, F. Vallejo, R. Beivide and C. Carrion Departamento de Electr6nica Universidad de Cantabria 39005 Santander-Spain e-mail: ja@ ctrhp3. unican. es Abstract. ...
Abstract Grid technologies are emerging as the next generation of distributed computing, allowing... more Abstract Grid technologies are emerging as the next generation of distributed computing, allowing the aggregation of resources that are geographically distributed across different locations. One of the key points of grid computing is that the independence and autonomy,of the resources are preserved at all times. This means that the administrator of a resource connected to a grid will make decisions as if the resource were isolated. So he may, e.g., disconnect the resource from the grid. Moreover, resources may suffer failures, and all of this obviously would affect the performance received by the users. In this paper we present an extension to one of the most populars grid simulators, GridSim [11], to support variable resource availability.
Abstract Grid systems are highly variable environments, made of a series of indepen- dent organiz... more Abstract Grid systems are highly variable environments, made of a series of indepen- dent organizations that share their resources, creating what is known as virtual organization, VO. This variability makes network quality of service (QoS) highly desirable, though it is very complex to achieve due to the large scale of inter- connected networks. The provision of network QoS in a Grid environment is the topic of interest of this work. In this paper, a taxonomy that characterizes and classifies various approaches for providing network QoS in Grid systems is presented. Also, the main proposals, developed by various world-wide projects, are surveyed to demonstrate the comprehensiveness of the taxonomy.
2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, 2013
ABSTRACT Providing Quality of Service (QoS) in Grid environments is still a challenging task beca... more ABSTRACT Providing Quality of Service (QoS) in Grid environments is still a challenging task because advance reservation of resources is not always possible. By contrast, scheduling the use of resources in advance is a way of enhancing the provision of QoS, without physically reserving them. However, in a Grid scenario fragmentation may appear as a logic result of the allocation process, leading to poor resource utilization. To try to avoid that problem a rescheduling technique has been developed and applied periodically depending on the existing fragmentation. Nevertheless, reallocating jobs in an optimal way is an NP-Hard problem. Consequently, simple and scalable ways of distributing and allocating those jobs into the resources are presented and evaluated in a real Grid environment involving heterogeneous computing resources distributed across different national organizations, highlighting the benefits of using them to increase the resource usage.
ABSTRACT Energy efficiency is often identified as one of the key reasons for migrating to Cloud e... more ABSTRACT Energy efficiency is often identified as one of the key reasons for migrating to Cloud environments. It is stated that a data centre hosting the Cloud environment is likely to achieve greater energy efficiency (at a reduced cost) compared to a local deployment. With increasing energy prices, it is also estimated that a large percentage of operational costs within a Cloud environment can be attributed to energy. In this work, we investigate and measure energy consumption of a number of virtual machines running the Hadoop system, over an OpenNebula Cloud. Our workload is based on sentiment analysis undertaken over Twitter messages. Our objective is to understand the tradeoff between energy efficiency and performance for such a workload. From our results we generalise and speculate on how such an analysis could be used as a basis to establish a Service Level Agreement (SLA) with a Cloud provider—especially where there is likely to be a high level of variability (both in performance and energy use) over multiple runs of the same application (at different times). Among the service level objectives that might be included in a SLA, Quality of Service (QoS) related metrics (i.e., latency) are one of the most challenging to support. This work provides some insight on the relationship between power consumption and QoS related metrics, describing how a combined consideration of these two metrics could be supported for a particular workload.
2002 IEEE Workshop on Multimedia Signal Processing., 2002
Dept. of Computer Science. Escuela Politkcnica Superior. Univ. de Castilla-La Mancha. 02071 - Alb... more Dept. of Computer Science. Escuela Politkcnica Superior. Univ. de Castilla-La Mancha. 02071 - Albacete, SPAIN. Email:{blanca, carmen, paco}@info-ab.uclm.es t Dept. of Computer Engineering (DISCA). Univ. Politkcnica de Valencia. 46071 - Valencia, SPAIN. E-mail: ...
One of the key motivations of computational and data grids is the ability to make coordinated use... more One of the key motivations of computational and data grids is the ability to make coordinated use of heterogeneous computing resources which are geographically dispersed. Consequently, the performance of the network linking all the resources present in a grid has a significant impact on the performance of an application. It is therefore essential to consider network characteristics when carrying out tasks such as scheduling, migration or monitoring of jobs. This work focuses on an implementation of an autonomic network-aware meta-scheduling architecture that is capable of adapting its behavior to the current status of the environment, so that jobs can be efficiently mapped to computing resources. The implementation extends the widely used GridWay meta-scheduler and relies on exponential smoothing to predict the execution and transfer times of jobs. An autonomic control loop (which takes account of CPU use and network capability) is used to alter job admission and resource selection criteria to improve overall job completion times and throughput. The implementation has been tested using a real testbed involving heterogeneous computing resources distributed across different national organizations.
Nowadays, the fog computing paradigm is being consolidated as a solution for processing the explo... more Nowadays, the fog computing paradigm is being consolidated as a solution for processing the explosion of data generated by lots of common IoT devices connected to the Internet. In contrast to cloud computing, fog computing achieves efficient data processing without incurring large latencies or data transfers to/from the cloud. The distributed nature of fog computing makes the resource orchestration a challenge. Commonly used centralized solutions are of limited utility in this context. Moreover, fog nodes are usually resource constrained, so the implementation of the management modules should be carefully designed in order not to cause excessive overheads. On the other hand, blockchain has proven its utility beyond cryptocurrencies, to support distributed and reliable information storage. When combined with smart contracts it can provide a distributed computer where all the nodes independently and equally contribute to a common global system state, which must be agreed by consensus. This also provides inherent desirable features, such as immutability and transparency. In this work, a novel architecture called HIDRA is presented, aimed at resource orchestration in fog computing environments based on a Ethereum blockchain implementation. A prototype implementation on a testbed composed of single-board computers has been carried out. Results show the low overhead introduced into the system and its ability to perform a coordinated action among fog nodes without the intervention of any central authority.
Proceedings of the 17th International Symposium on Parallel and Distributed Processing, 2003
The primary objective of the MultiMedia Router (MMR) project is the design and implementation of ... more The primary objective of the MultiMedia Router (MMR) project is the design and implementation of a compact router optimized for multimedia applications. The router is targeted for use in cluster and LAN interconnection networks, which offer different constraints and therefore differing router solutions than WANs. One of the key elements within the router are the algorithms used to decide the forwarding order of the information that traverses it: the link and switch scheduling algorithms. They help greatly to determine the QoS guarantees delivered to the application flows. Also, conventional best-effort traffic should be seamlessly integrated by scheduling algorithms, in such a way that link bandwidth is efficiently used, but without degrading the QoS guarantees of the multimedia connections. In this work, two solutions for switch scheduling are thoroughly evaluated with mixed workloads (i.e., composed of multimedia and best-effort traffic), and their is performance compared to another well-known approach for switch scheduling, that does not consider QoS requirements when performing scheduling decisions. Results show that, when a QoS-aware switch scheduler is used, the QoS received by the multimedia flows is not affected by the presence of best-effort traffic.
Grid technologies have enabled the aggregation of geographically distributed resources, in the co... more Grid technologies have enabled the aggregation of geographically distributed resources, in the context of a particular application. The network remains an important requirement for any Grid application, as entities involved in a Grid system (such as users, services, and data) need to communicate with each other over a network. The performance of the network must therefore be considered when carrying out tasks such as scheduling, migration or monitoring of jobs. Moreover, the interactions between different domains are a key issue in Grid computing, thus their effects should be considered when performing the scheduling task. In this paper, we enhance an existing framework that provides scheduling of jobs to computing resources to allow multi-domain scheduling based on peer-to-peer techniques.
Proceedings of the 9th international conference on Supercomputing - ICS '95, 1995
Page 1. Petri Net Modeling of Intemonnection Networks for Massively Pamllel Amhitectums. JAGregor... more Page 1. Petri Net Modeling of Intemonnection Networks for Massively Pamllel Amhitectums. JAGregorio, F. Vallejo, R. Beivide and C. Carrion Departamento de Electr6nica Universidad de Cantabria 39005 Santander-Spain e-mail: ja@ ctrhp3. unican. es Abstract. ...
Abstract Grid technologies are emerging as the next generation of distributed computing, allowing... more Abstract Grid technologies are emerging as the next generation of distributed computing, allowing the aggregation of resources that are geographically distributed across different locations. One of the key points of grid computing is that the independence and autonomy,of the resources are preserved at all times. This means that the administrator of a resource connected to a grid will make decisions as if the resource were isolated. So he may, e.g., disconnect the resource from the grid. Moreover, resources may suffer failures, and all of this obviously would affect the performance received by the users. In this paper we present an extension to one of the most populars grid simulators, GridSim [11], to support variable resource availability.
Abstract Grid systems are highly variable environments, made of a series of indepen- dent organiz... more Abstract Grid systems are highly variable environments, made of a series of indepen- dent organizations that share their resources, creating what is known as virtual organization, VO. This variability makes network quality of service (QoS) highly desirable, though it is very complex to achieve due to the large scale of inter- connected networks. The provision of network QoS in a Grid environment is the topic of interest of this work. In this paper, a taxonomy that characterizes and classifies various approaches for providing network QoS in Grid systems is presented. Also, the main proposals, developed by various world-wide projects, are surveyed to demonstrate the comprehensiveness of the taxonomy.
2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, 2013
ABSTRACT Providing Quality of Service (QoS) in Grid environments is still a challenging task beca... more ABSTRACT Providing Quality of Service (QoS) in Grid environments is still a challenging task because advance reservation of resources is not always possible. By contrast, scheduling the use of resources in advance is a way of enhancing the provision of QoS, without physically reserving them. However, in a Grid scenario fragmentation may appear as a logic result of the allocation process, leading to poor resource utilization. To try to avoid that problem a rescheduling technique has been developed and applied periodically depending on the existing fragmentation. Nevertheless, reallocating jobs in an optimal way is an NP-Hard problem. Consequently, simple and scalable ways of distributing and allocating those jobs into the resources are presented and evaluated in a real Grid environment involving heterogeneous computing resources distributed across different national organizations, highlighting the benefits of using them to increase the resource usage.
ABSTRACT Energy efficiency is often identified as one of the key reasons for migrating to Cloud e... more ABSTRACT Energy efficiency is often identified as one of the key reasons for migrating to Cloud environments. It is stated that a data centre hosting the Cloud environment is likely to achieve greater energy efficiency (at a reduced cost) compared to a local deployment. With increasing energy prices, it is also estimated that a large percentage of operational costs within a Cloud environment can be attributed to energy. In this work, we investigate and measure energy consumption of a number of virtual machines running the Hadoop system, over an OpenNebula Cloud. Our workload is based on sentiment analysis undertaken over Twitter messages. Our objective is to understand the tradeoff between energy efficiency and performance for such a workload. From our results we generalise and speculate on how such an analysis could be used as a basis to establish a Service Level Agreement (SLA) with a Cloud provider—especially where there is likely to be a high level of variability (both in performance and energy use) over multiple runs of the same application (at different times). Among the service level objectives that might be included in a SLA, Quality of Service (QoS) related metrics (i.e., latency) are one of the most challenging to support. This work provides some insight on the relationship between power consumption and QoS related metrics, describing how a combined consideration of these two metrics could be supported for a particular workload.
2002 IEEE Workshop on Multimedia Signal Processing., 2002
Dept. of Computer Science. Escuela Politkcnica Superior. Univ. de Castilla-La Mancha. 02071 - Alb... more Dept. of Computer Science. Escuela Politkcnica Superior. Univ. de Castilla-La Mancha. 02071 - Albacete, SPAIN. Email:{blanca, carmen, paco}@info-ab.uclm.es t Dept. of Computer Engineering (DISCA). Univ. Politkcnica de Valencia. 46071 - Valencia, SPAIN. E-mail: ...
Uploads
Papers by Carmen Carrion