2013 IEEE International Conference on Cluster Computing (CLUSTER), Sep 27, 2013
In this paper, we present JUMMP, the Job Uninterrupted Maneuverable MapReduce Platform, an automa... more In this paper, we present JUMMP, the Job Uninterrupted Maneuverable MapReduce Platform, an automated scheduling platform that provides a customized Hadoop environment within a batch-scheduled cluster environment. JUMMP enables an interactive pseudo-persistent MapReduce platform within the existing administrative structure of an academic high performance computing center by "jumping" between nodes with minimal administrative effort. Jumping is implemented by the synchronization of stopping and starting daemon processes on different nodes in the cluster. Our experimental evaluation shows that JUMMP can be as efficient as a persistent Hadoop cluster on dedicated computing resources, depending on the jump time. Additionally, we show that the cluster remains stable, with good performance, in the presence of jumps that occur as frequently as the average length of reduce tasks of the currently executing MapReduce job. JUMMP provides an attractive solution to academic institutions that desire to integrate Hadoop into their current computing environment within their financial, technical, and administrative constraints.
Abstract—The recent challenges for higher education call for research that can offer a comprehens... more Abstract—The recent challenges for higher education call for research that can offer a comprehensive understanding about the performance and efficiency of higher education institutions in their three primary missions: research, education, and service. In other for this to happen, it is necessary for researchers to have access to a multitude of data sources. However, due to the nature of their academic training, many higher education practitioners do not have access to expertise in working with different data sources.
Abstract This research utilizes several well known forecasting techniques in combination with Emp... more Abstract This research utilizes several well known forecasting techniques in combination with Empirical Mode Decomposition (EMD) to investigate the trade-offs of EMD's decomposition (sifting) step for forecasting the arrival workload of an enterprise cluster. The research is based on earlier work on the forecasting potential of EMD. Results show that EMD helps to improve forecasting results. Parallelization is used to perform extensive investigation across the full range of data.
Abstract: This paper describes a methodology for modeling workload for distributed systems. It de... more Abstract: This paper describes a methodology for modeling workload for distributed systems. It derives concise and descriptive models of workload from the actual workload traces. The job inter-arrival time, runtime, CPU required, and daily arrival pattern are modeled. This methodology has been successfully used in several cases studies to model workloads from enterprise grid systems to supercomputers in academic environments.
Abstract: This paper studies the relationship between investments in High-Performance Computing (... more Abstract: This paper studies the relationship between investments in High-Performance Computing (HPC) instrumentation and research competitiveness. Measures of institutional HPC investment are computed from data that is readily available from the Top 500 list, a list that has been published twice a year since 1993 that lists the fastest 500 computers in the world at that time.
Abstract Shibboleth is an architecture and protocol for allowing users to authenticate and be aut... more Abstract Shibboleth is an architecture and protocol for allowing users to authenticate and be authorized to use a remote resource by logging into the identity management system that is maintained at their home institution. With Shibboleth, a federation of institutions can share resources among users and yet allow the administration of both the user access control to resources and the user identity and attribute information to be performed at the hosting or home institution.
Fatigue damage, appearing due to developing cracks, is considered to be one of the main faults in... more Fatigue damage, appearing due to developing cracks, is considered to be one of the main faults in rotating machinery. The damage in rotating components can be catastrophic, posing a potential hazard and leading to significant economic loss. In the related literature, transverse breathing cracks are considered as a primary mode of damage. Accordingly, a Jeffcott rotor with a transverse breathing crack has been examined here wherein a method for identifying the early crack propagation is proposed. The breathing functions developed in a recent publication to approximate the actual breathing mechanism of the cracked shaft are employed along with the method of empirical mode decomposition (EMD) to identify the crack vibration signature. EMD combined with the wave transform spectrum is used to decompose the measured vibration time series of the cracked rotor system into nearly monochromatic components. It is shown that the variations of the averaged amplitudes of the super-harmonic components in the neighborhood of 1/2 and 1/3 of the first critical rotational speed provide clear and robust vibration signatures indicating the early presence of the breathing crack. This signature is utilized here for early crack detection in the rotor system under consideration.
In this paper, the design of a simulation model for evaluating two alternative supercomputer conf... more In this paper, the design of a simulation model for evaluating two alternative supercomputer configurations in an academic environment is presented. The workload is analyzed and modeled, and its effect on the relative performance of both systems is studied. The Integrated Capacity Planning Environment (ICPE) toolkit, developed for commodity cluster capacity planning, is successfully applied to the target environment. The ICPE is a tool for workload modeling, simulation modeling, and what-if analysis. A new characterization strategy is applied to the workload to more accurately model commodity cluster workloads. Through "what-if" analysis, the sensitivity of the baseline system performance to workload change, and also the relative performance of the two proposed alternative systems are compared and evaluated. This case study demonstrates the usefulness of the methodology and the applicability of the tools in gauging system capacity and making design decisions.
2010 Seventh International Conference …, Jan 1, 2010
This paper demonstrates the feasibility and potential of applying empirical mode decomposition (E... more This paper demonstrates the feasibility and potential of applying empirical mode decomposition (EMD) to forecast the arrival time behaviors in a parallel batch system. An analysis of the workload records shows the existence of daily and weekly patterns within the workload. Results show that the intrinsic mode functions (IMF), products of the sifting/decomposition process of EMD, produce a better prediction than the original arrival histogram when used in a simple weight-matching prediction technique. Promising applications include the implementation of an EMD/neural network combination.
For large and complicated ASIC designs, it is difficult to read and understand the circuits based... more For large and complicated ASIC designs, it is difficult to read and understand the circuits based on schematic drawings alone; as a result, a hardware description language is much needed for a succinct, descriptive, and human-readable summarization of the circuit. In this paper, we explore VHDL, a hardware description language popular in educational environment. Through the design of a 32-bits pipelined CPU as described in "Computer Organization and Design" by John L. Hennessy and David A. Patterson, we present several VHDL compilers, simulators, and synthesizers that are readily accessible for academic environments. Finally, we perform timing and area analysis the MIPS processor using Xilinx's SPARTAN3 FPGA device and Virtex4 FPGA device.
… . ITNG'07. Fourth International Conference on, Jan 1, 2007
Abstract A version control repository structure has been created based on open source utility sof... more Abstract A version control repository structure has been created based on open source utility software. The structure consists of a subversion repository with an Apache Web interface that is protected by a Shibboleth authentication system. This structure can allow authorized and authenticated data sharing between institutions, yet retains simplicity and protects privacy for users. In addition, it also helps local administrators from having to perform extra account management for new users from other institutions
2013 IEEE International Conference on Cluster Computing (CLUSTER), Sep 27, 2013
In this paper, we present JUMMP, the Job Uninterrupted Maneuverable MapReduce Platform, an automa... more In this paper, we present JUMMP, the Job Uninterrupted Maneuverable MapReduce Platform, an automated scheduling platform that provides a customized Hadoop environment within a batch-scheduled cluster environment. JUMMP enables an interactive pseudo-persistent MapReduce platform within the existing administrative structure of an academic high performance computing center by "jumping" between nodes with minimal administrative effort. Jumping is implemented by the synchronization of stopping and starting daemon processes on different nodes in the cluster. Our experimental evaluation shows that JUMMP can be as efficient as a persistent Hadoop cluster on dedicated computing resources, depending on the jump time. Additionally, we show that the cluster remains stable, with good performance, in the presence of jumps that occur as frequently as the average length of reduce tasks of the currently executing MapReduce job. JUMMP provides an attractive solution to academic institutions that desire to integrate Hadoop into their current computing environment within their financial, technical, and administrative constraints.
Abstract—The recent challenges for higher education call for research that can offer a comprehens... more Abstract—The recent challenges for higher education call for research that can offer a comprehensive understanding about the performance and efficiency of higher education institutions in their three primary missions: research, education, and service. In other for this to happen, it is necessary for researchers to have access to a multitude of data sources. However, due to the nature of their academic training, many higher education practitioners do not have access to expertise in working with different data sources.
Abstract This research utilizes several well known forecasting techniques in combination with Emp... more Abstract This research utilizes several well known forecasting techniques in combination with Empirical Mode Decomposition (EMD) to investigate the trade-offs of EMD's decomposition (sifting) step for forecasting the arrival workload of an enterprise cluster. The research is based on earlier work on the forecasting potential of EMD. Results show that EMD helps to improve forecasting results. Parallelization is used to perform extensive investigation across the full range of data.
Abstract: This paper describes a methodology for modeling workload for distributed systems. It de... more Abstract: This paper describes a methodology for modeling workload for distributed systems. It derives concise and descriptive models of workload from the actual workload traces. The job inter-arrival time, runtime, CPU required, and daily arrival pattern are modeled. This methodology has been successfully used in several cases studies to model workloads from enterprise grid systems to supercomputers in academic environments.
Abstract: This paper studies the relationship between investments in High-Performance Computing (... more Abstract: This paper studies the relationship between investments in High-Performance Computing (HPC) instrumentation and research competitiveness. Measures of institutional HPC investment are computed from data that is readily available from the Top 500 list, a list that has been published twice a year since 1993 that lists the fastest 500 computers in the world at that time.
Abstract Shibboleth is an architecture and protocol for allowing users to authenticate and be aut... more Abstract Shibboleth is an architecture and protocol for allowing users to authenticate and be authorized to use a remote resource by logging into the identity management system that is maintained at their home institution. With Shibboleth, a federation of institutions can share resources among users and yet allow the administration of both the user access control to resources and the user identity and attribute information to be performed at the hosting or home institution.
Fatigue damage, appearing due to developing cracks, is considered to be one of the main faults in... more Fatigue damage, appearing due to developing cracks, is considered to be one of the main faults in rotating machinery. The damage in rotating components can be catastrophic, posing a potential hazard and leading to significant economic loss. In the related literature, transverse breathing cracks are considered as a primary mode of damage. Accordingly, a Jeffcott rotor with a transverse breathing crack has been examined here wherein a method for identifying the early crack propagation is proposed. The breathing functions developed in a recent publication to approximate the actual breathing mechanism of the cracked shaft are employed along with the method of empirical mode decomposition (EMD) to identify the crack vibration signature. EMD combined with the wave transform spectrum is used to decompose the measured vibration time series of the cracked rotor system into nearly monochromatic components. It is shown that the variations of the averaged amplitudes of the super-harmonic components in the neighborhood of 1/2 and 1/3 of the first critical rotational speed provide clear and robust vibration signatures indicating the early presence of the breathing crack. This signature is utilized here for early crack detection in the rotor system under consideration.
In this paper, the design of a simulation model for evaluating two alternative supercomputer conf... more In this paper, the design of a simulation model for evaluating two alternative supercomputer configurations in an academic environment is presented. The workload is analyzed and modeled, and its effect on the relative performance of both systems is studied. The Integrated Capacity Planning Environment (ICPE) toolkit, developed for commodity cluster capacity planning, is successfully applied to the target environment. The ICPE is a tool for workload modeling, simulation modeling, and what-if analysis. A new characterization strategy is applied to the workload to more accurately model commodity cluster workloads. Through "what-if" analysis, the sensitivity of the baseline system performance to workload change, and also the relative performance of the two proposed alternative systems are compared and evaluated. This case study demonstrates the usefulness of the methodology and the applicability of the tools in gauging system capacity and making design decisions.
2010 Seventh International Conference …, Jan 1, 2010
This paper demonstrates the feasibility and potential of applying empirical mode decomposition (E... more This paper demonstrates the feasibility and potential of applying empirical mode decomposition (EMD) to forecast the arrival time behaviors in a parallel batch system. An analysis of the workload records shows the existence of daily and weekly patterns within the workload. Results show that the intrinsic mode functions (IMF), products of the sifting/decomposition process of EMD, produce a better prediction than the original arrival histogram when used in a simple weight-matching prediction technique. Promising applications include the implementation of an EMD/neural network combination.
For large and complicated ASIC designs, it is difficult to read and understand the circuits based... more For large and complicated ASIC designs, it is difficult to read and understand the circuits based on schematic drawings alone; as a result, a hardware description language is much needed for a succinct, descriptive, and human-readable summarization of the circuit. In this paper, we explore VHDL, a hardware description language popular in educational environment. Through the design of a 32-bits pipelined CPU as described in "Computer Organization and Design" by John L. Hennessy and David A. Patterson, we present several VHDL compilers, simulators, and synthesizers that are readily accessible for academic environments. Finally, we perform timing and area analysis the MIPS processor using Xilinx's SPARTAN3 FPGA device and Virtex4 FPGA device.
… . ITNG'07. Fourth International Conference on, Jan 1, 2007
Abstract A version control repository structure has been created based on open source utility sof... more Abstract A version control repository structure has been created based on open source utility software. The structure consists of a subversion repository with an Apache Web interface that is protected by a Shibboleth authentication system. This structure can allow authorized and authenticated data sharing between institutions, yet retains simplicity and protects privacy for users. In addition, it also helps local administrators from having to perform extra account management for new users from other institutions
Uploads
Papers by Linh Ngo