Quality Research in Higher Education Institutions in Oman:
HOLI I B R A H I M H O L I A L I ALI PhD, SFHEA
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Abstract
Academic research remains a prime source of knowledge and innovation for higher education institutions (HEIs) that strive to grow, expand and develop their academic reputations and standards. Yet, research informs teaching practices, shapes social changes and it has financial outcomes for HEIs. Therefore, it is imperative to develop institutional policies and strategies for promoting and sustaining quality research in HEIs in Oman. There are a number of international frameworks and models which have been developed to measure research quality in HEIs around the world. For example, bibliometrics were used to assess research quality in HEIs in the UK because bibliometric data can provide a number of component variables. An appropriate bibliometric model may include components such as output volume, diversity of outputs, citation volume, journal impact factor and average citations per publication, etc. Moreover, other popular examples of models for assessing research quality are Multidimensional Research Assessment Matrix (MRAM) used in Europe and the UK’s Research Assessment Exercise (RAE). However, neither of the above mentioned models is adopted by HEIs in Oman. Thus, the current study is an attempt to explore some institutional, international, logistic and pragmatic factors that impact academic research and publication quality, review popular international research quality assessment models and explore the possibility of applying them in the Omani context. To achieve the study objectives, 20 teacher researchers were surveyed and the findings and recommendations were presented. Keywords: Quality Research, HEIs in Oman, International Models, Factors, Teacher Researchers' Views
Related papers
Quality Research in Higher Education Institutions in Oman: Some Views of Teacher Researchers
Advances in Language and Literary Studies
Academic research remains a prime source of knowledge and innovation for higher education institutions (HEIs) that strive to grow, expand and develop their academic reputations and standards. Yet, research informs teaching practices, shapes social changes and it has financial outcomes for HEIs. Therefore, it is imperative to develop institutional policies and strategies for promoting and sustaining quality research in HEIs in Oman. There are a number of international frameworks and models which have been developed to measure research quality in HEIs around the world. For example, bibliometrics were used to assess research quality in HEIs in the UK because bibliometric data can provide a number of component variables. An appropriate bibliometric model may include components such as output volume, diversity of outputs, citation volume, journal impact factor and average citations per publication, etc. Moreover, other popular examples of models for assessing research quality are Multidimensional Research Assessment Matrix (MRAM) used in Europe and the UK's Research Assessment Exercise (RAE). However, neither of the above mentioned models is adopted by HEIs in Oman. Thus, the current study is an attempt to explore some institutional, international, logistic and pragmatic factors that impact academic research and publication quality, review popular international research quality assessment models and explore the possibility of applying them in the Omani context. To achieve the study objectives, 20 teacher researchers were surveyed and the findings and recommendations were presented.
European Educational Research Quality Indicators (EERQI): An Experiment
Research Assessment in the Humanities, 2016
European Educational Research Quality Indicators (EERQI)' was a research project funded under the EU 7th Framework Programme from 2008 to 2011. The mission of this project was to develop new approaches for the evaluation of quality of educational research publications. Traditional methods of assessing quality of scholarly publications are highly depended on ranking methods according to citation frequency and journal impact factors. Both are based on methodologies that do not reflect adequate coverage of European scientific publications, namely in the social sciences and humanities. Hence, if European science or institutions are exposed to these evaluation methods, not only individual researchers and institutions are widely ignored, but also complete subject domains and language areas. The initiators of the EERQI project, as well as numerous researchers and evaluation bodies within the European Union, recognized the need to remedy the inadequacies of this situation. According to our hypotheses, educational research served as a model case for research in the social sciences and humanities. EERQI aimed to
The Quality Assurance in Research of Higher Education Institutions in Oman
2017
This research analysed the quality assurance in research planning and management of selected HEIs in Oman. It used document analysis of HEIs practices using OAAA Quality Audit reports from 2011 to 2016 through thematic coding and categorising. It aims to identify best practices and gaps in the same areas and report it in a collective and summative manner; and assessed the current situation in the area of research and consultancy based on the inferences and extrapolations. This paper discussed the strategic actions as stated in the quality audit reports and provided recommendations to better plan, implement, and manage research activities. The study revealed that there is a significantly high number of recommendations in colleges especially in the key area of research planning and management, thus indicates that research in colleges may still be underdeveloped. Conversely, universities in Oman have reached a considerable degree of quality in their research activities especially in re...
Assessment of Research Quality in Higher Education: Contribution for an Institutional Framework
The past twenty years have seen a remarkable rise in the measurement of the impact/ cost-benefit and value-for money of research outcomes. The implications for knowledge construction, higher education institutions and researchers are massive. This paper presents a proposal for addressing the question-how can institutions evaluate and monitor the quality of research in order to promote research excellence? The present study combines a strong documental analysis of major reference frameworks that are/were used across European higher education institutions with data analysis of a case study developed in the UK about the perceptions and recommendations of the main intervenients in the last Research Assessment Exercise (RAE). The dimensions and indicators identified in this study will contribute for the design of the Institutional Research Quality Assessment Framework that will be used in a research centre at the University of Aveiro. We provide examples of processes and practices of how institutions can develop internal evaluation exercises. We argue for an integrated/integrative approach where the basic principles of quality are identified, openly discussed and developed in order to reinforce the identity and promote the empowerment and engagement of researchers in the process of research assessment.
Mooij, T. (2015). Exploring a prototype framework of web-based and peer-reviewed “European Educational Research Quality Indicators” (EERQI). Scientometrics, 102 (1), 1037-1055.
2015
Digitization, the Internet, and information or webometric interdisciplinary approaches are affecting the fields of Scientometrics and Library and Information Science (LIS). These new approaches can be used to improve citation-only procedures to estimate the quality and impact of research. A European pilot to explore this potential was called “European Educational Research Quality Indicators” (EERQI, FP7 # 217549). An interdisciplinary consortium was involved from 2008-2011. Different types of indicators were developed to score 171 educational research documents. Extrinsic bibliometric and citation indicators were collected from the Internet for each document; intrinsic indicators reflecting content-based quality were developed and relevant data gathered by peer review. Exploratory and confirmatory factor analysis and structural modeling were used to explore statistical relationships among latent factors or concepts and their indicators. Three intrinsic and two extrinsic latent factors were found to be relevant. Moreover, the more a document was related to a reviewer’s own area of research, the higher the score the reviewer gave concerning 1) significance, originality, and consistency, and 2) methodological adequacy. The conclusions are that a prototype EERQI framework has been constructed: intrinsic quality indicators add specific information to extrinsic quality or impact indicators, and vice versa. Also, a problem of “objective” impact scores is that they are based on “subjective” or biased peer-review scores. Peer-review, which is foundational to having a work cited, seems biased and this bias should be controlled or improved by more refined estimates of quality and impact of research. Some suggestions are given and limitations of the pilot are discussed. As the EERQI development approach, instruments, and tools are new, they should be developed further.
Research Quality Evaluation in Social Sciences: The Case of Criteria on the Conditions and Requirements for Academic Promotion in Serbia, Slovenia and Montenegro
Montenegrin Journal of Sports Science and Medicine
were selected to be subjects in this study. The sources used for the analyses in this study were the official criteria on the condition and requirements for academic promotion at the abovementioned universities. The authors used a descriptive method with the consulting of competent sources and personal experiences. First, it is interesting to note that the universities in Serbia and Slovenia follow official documents at two levels: one at the national level issued by the relevant higher education council/agency and the second at the university level issued by the senate of each university, whose criteria are more strict in terms of quantitative requirements. However, this is not the case in Montenegro, where universities follow only the national criteria in the research quality evaluation. In each country, evaluation exercises usually recognize three fields, one of which is social sciences and humanities, which is concerned with an entire range of interdisciplinary and multidisciplinary scientific areas. Comparing the minimum standards for the appointment of university teachers, it is essential to highlight that Slovenian regulations are the most demanding, especially with regards to quantitative criteria, while Serbian and Montenegrin criteria are similar to each other; however, it is necessary to highlight that Montenegrin regulations contain some unusual criteria, such as the requirement that scientific research work must be achieved through one single-author paper published in an international journal for promotion to academic titles at all three levels (assistant, associate and full professor) in social sciences and humanities; however, this is not the case in other academic fields.
Are pre-compiled citation indexes of peer-reviewed journals an adequate control for research quality? A case study of library and information science.
South Africa Journal of Libraries and …, 2005
Co-authored with Peter G. Underwood. Looks at the South African Department of Education's new recommendations for the evaluation of higher education research in South Africa, and examines two primary aspects: the use of pre-compiled journal lists from overseas, and the apparent reliance on peer review as a guarantee of quality. Pointing out that these are tried and tested standards of quality, the authors argue that there are nonetheless disciplinary differences between experimental sciences - such as physics or chemistry - and other disciplines that make these measures difficult to apply across the spectrum. They present an analysis of library and information science publications in the chosen lists and point to the weakness of the selection of titles in this discipline. In addition, there are extra difficulties for scientists from South Africa and the developing world in securing publication in premier international library and information science journals. The authors conclude by calling for the employment of other, additional evaluation measures in an integrated system.
Are productivity, impact and visibility indicators appropriate for measuring the quality of research conducted in universities
The outcome of scientific activity conducted by universities materializes in a number of ways, including publications, the research projects, the attainment of scientific repute and the PhD theses awarded. This communication contains the preliminary results of a research project designed to evaluate the quality of Spanish public universities' scientific activity on the grounds of a wide range of indicators that take into consideration most of the aspects involved in this activity. The objective sought here was to determine the relationship between bibliometric indicators for productivity, impact and visibility and indicators of scientific repute, external funding and researcher training capacity in Spanish public universities. The present study was based on a review of Spanish public universities' scientific activity in 2002-2006. The relationships between indicators were computed in terms of the determination coefficient (R 2), which measures the percentage of data variability that can be explained by such associations. The results revealed that bibliometric indicators are only scantly related to other measures of scientific activity relevant to university research.
Academic and Administrative Obstacles Facing Scientific Research in Higher Education Institutions in the Sultanate of Oman: An Analytical Quantitative Study
2019
The aim of this study was to investigate the most important academic and administrative obstacles facing scientific research in the Sultanate of Oman. It also aimed to reveal the impact of some independent variables, such as gender, age, type of institution, field of study, and country of education. The study was conducted on a sample of 714 researchers and academics working in institutions of higher education in various governorates of the Sultanate. The study is a descriptive research. A questionnaire was employed as the main instrument for data collection, devised analytically in line with the objectives and questions of the study, and to characterize and diagnose the phenomenon in a profound and comprehensive manner. The results of the study indicated that the most important administrative obstacles facing scientific research in the Sultanate is the large number of hours of teaching and the huge administrative loads. The results also showed that the lack of sabbatical leaves for...
An introduction to the Research Excellence Framework: A new research evaluation framework for universities in the UK
Synthesiology English edition, 2013
The crucial point to understand before delving into the details of the REF evaluation framework is its rationale for conducting the evaluation. This is because the evaluation procedures (i.e., This article introduces the Research Excellence Framework (REF): a new research evaluation framework developed by the Higher Education Funding Council for England (HEFCE) to evaluate the research activities of higher education institutions in the UK. To promote excellent research so that its potential effect can be maximized, the REF has three criteria for evaluating institutions: output quality, impact, and research environment. Remarkably, although the purpose of the REF is university evaluation, social impact is explicitly included within the evaluation framework. It is proposed that output quality be evaluated by conventional review with the aid of quantitative bibliometric indicators, such as the number of paper citations. In this article, we introduce the REF, from output to impact, and make recommendations for the evaluation of research for universities in Japan.
Related papers
Mooij, T. (2011). European Educational Research Quality Indicators (EERQI): A first prototype framework of intrinsic and extrinsic indicators. Paper for the final conference in Brussels, University Foundation, 15-16 March 2011. Nijmegen, The Netherlands: Radboud Universiteit, ITS.
Mooij, T. (2011). European Educational Research Quality Indicators (EERQI): A first prototype framework of intrinsic and extrinsic indicators. Paper final conference, 15-16 March 2011. Nijmegen, The Netherlands: Radboud Universiteit, ITS. , 2011
The goal of the international project 'European Educational Research Quality Indicators' (EERQI) is to improve upon citation-only based assessments of the quality or impact of educational and other research. One of the project activities is to distinguish 'objective' bibliometric and citation indicators, or 'extrinsic indicators' of research documents, from 'subjective' indicators reflecting 'intrinsic' qualities like rigour, originality, significance, integrity, and style. Different pilots were conducted to collect data with respect to these two types of indicators. In addition to other presentations at the final conference of the project, the goal of this paper is to analyse and report about some of the data gathered. Despite the lack of time and methodological problems of the data collected, two research questions will be answered: 1) What are the results of applying the 'intrinsic criteria' rigour, originality, significance, integrity, and style, in a peer review evaluation of educational research articles? 2) What are the results of analysing the relationships between both intrinsic and extrinsic indicators, to construct an example of a prototype EERQI framework?
Quality of research: which underlying values?
Scientometrics, 2013
Traditional bibliometric indicators are considered too limited for some research areas such as humanities and social sciences because they mostly reveal a specific aspect of academic performance (quantity of publications) and tend to ignore a significant part of research production. The frequent misuses (e.g. improper generalizations) of bibliometric measures results in a substantial part of the research community failing to consider the exact nature of bibliometric measures. This study investigates the links between practices for assessing academic performance, bibliometric methods' use and underlying values of research quality within the scientific community of University of Lausanne, Switzerland. Findings reveal four researcher profiles depending on research orientations and goals, ranging from those using "pure" quantitative tools to those using more subjective and personal techniques. Each profile is characterized according to disciplinary affiliation, tenure, academic function as well as commitment to quality values.
Assessing the quality of academic research outcomes: a reflection on the existing studies and views of the knowledge production actors in academic system
Educational Measurement and Evaluation Studies, 2019
The present research was conducted to evaluate the quality of academic research outcomes from the perspective of knowledge production actors in one of the major universities in Iran with qualitative approach, case study method and triangulation technique. The study method was qualitative case study. For this purpose, in the first stage, we examined and studied the research background on the quality of research outcomes and in the second phase we conducted in-depth interviews with faculty members of Shiraz University. Statistical population were 610 faculty members of Shiraz University. We selected 24 members in four groups of humanities, engineering, agriculture and veterinary sciences and basic sciences that have at least a degree of associated professor and have been selected as the top researcher in the last five years with criteria sampling method. The results of this research explored the quality of academic research in two components of "quality of publications" and "quality of presentation and maturity of research" and, respectively, in five indicators of "quality of the publication", "alignment with the indicators of scientometrics","Research credibility "," Innovation and efficiency "and" Applicability "were identified in a total of 32 indicators.
Identification of Quality in Educational Research Publications: The European Educational Research Quality Indicators (Eerqi) Project
Revista De Investigacion Educativa, 2012
Criteria for Research Quality: International Perspectives
Evaluation or assessment of research quality is an integral part of universities and funding agencies. So far, there has been little discussion about how well criteria used in this context match the quality criteria of researchers. We present the results of three studies on academics’ criteria for good research including lecturers at traditional universities and at institutes of higher professional education in the Netherlands, humanities scholars from 10 European countries as well as scholars of media and communication sciences in Belgium. This session intends to stimulate the discussion on more inclusive and comprehensive approaches to the assessment of research quality.
Challenges and Threats to Quality in Scholarly Knowledge Production: Views of Selected Stakeholders from 17 Countries
Research Square, 2022
This study applies Harvey and Green’s (1993) model of quality to scholarly knowledge production. Although studies of quality in higher education have been commonplace for decades, there is a gap in understanding quality in terms of research production from the stakeholder’s perspective. This study begins to fill that gap through a qualitative interview study of quality in the knowledge production process. Stakeholders in all parts of the scholarly knowledge production process, from 17 countries are included in the data sample. Interview data are analyzed through the conceptualizations of quality developed by Harvey and Green (1993), extending the use of the model into the realm of the knowledge production process. Definitions and challenges of quality in producing scholarly knowledge are discussed. The findings indicate a rift between the institutional view of quality and the individual perceptions of quality, suggesting the need for policies aimed at addressing a unification of scholarly knowledge production efforts.
Universities Research Performance in the United Arab Emirates and Oman: Challenges of Higher Education Systems
Journal of Higher Education Policy And Leadership Studies
This article analyzes research performance in universities in two member countries of the Gulf Cooperation Council (GCC): the United Arab Emirates (UAE) and the Sultanate of Oman. Both have introduced reforms, innovations, and investments into their educational systems. Many international university branches were established, but their impact on research performance has yet to be closely evaluated. The article includes the following: first, descriptive analysis of research performance through total number of publications, citable documents, and average number of citations per document; second, analysis of priority subject areas and an overview of university rankings; third, challenges for research in higher educational institutions. Among sociocultural predictors of academic performance are historical context, English language proficiency, the modern educational system's drawbacks, and higher education's privatization and commercialization. Highlighted are institutional and organizational obstacles related to employment conditions of expatriates, along with the research environment and challenges that hinder internationalization.
European Educational Research Quality Indicators (EERQI)
Proceedings of Issi 2009 the 12th International Conference of the International Society For Scientometrics and Informetrics Volume 2, 2009
Symposium: Criteria for Research Quality: International Perspectives
Research ratings and assessments are institutionalized or regularly applied in many countries. However, little is known how well the increasingly important ‘managerial conception’ of quality inherent to such assessments and ratings matches the academics’ views about what constitutes the quality of research. Three studies on academics’ criteria of good research are presented: a) a Dutch study among lecturers of social sciences and natural sciences of both traditional universities and higher professional education; b) a Swiss research among scholars in the Humanities from 25 European countries; and c) a Belgian study among Belgian Flemish and French speaking scholars from the Media and Communication disciplines. This symposium will shortly present the results of these studies and then have a debate with the audience on the implications of similarities and differences found between the results of the three studies, but also between these results and the existing, more managerial criteria for the assessment of research.
Research quality, characteristics of publications and socio-demographic features of Universities and Researchers: evidence from the Italian VQR 2004-2010 evaluation exercise
In July, 2013, ANVUR has published the results of the 2004-2010 Italian evaluation exercise (VQR 2004-2010 or simply VQR in the acronym used hereafter). The VQR Report has presented aggregate results relative to the quality of scientific publications submitted for evaluation by Italian Universities and Research bodies; the final objective of the Report was to rank Italian scientific institutions on the basis of the quality of their research, so as to provide to the Italian Ministry of Education, University and Research (MIUR) information to be used to assign a part of the public funding. The aim of this paper is that of providing a more disaggregated analysis of evaluation outcomes, specifically looking at possible existing correlations among scientific quality and a number of product- and researcher-specific variables.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.