Research evaluation

It is well known that women are underrepresented in the academic systems of many countries. Gender discrimination is one of the factors that could contribute to this phenomenon. This study considers a recent national academic recruitment campaign in Italy, examining whether women are subject to more or less bias than men. The findings show that no gender-related differences occur among the candidates who benefit from positive bias, while among those candidates affected by negative bias, the incidence of women is lower than that of men. Among the factors that determine success in a competition for an academic position, the number of the applicant's career years in the same university as the committee members assumes greater weight for male candidates than for females. Being of the same gender as the committee president is also a factor that assumes greater weight for male applicants. On the other hand, for female applicants, the presence of a full professor in the same university with the same family name as the candidate assumes greater weight than for male candidates.

This article explores psychological avenues to reconciliation between groups. It describes the psychological changes in survivors, perpetrators, and passive bystanders in the course of the evolution of increasing violence and points to healing from the psychological wounds created as an essential component of reconciliation. It also explores the role of understanding the roots of genocide, and of violence between groups in general, in contributing to healing, to the creation of a shared history in place of the usually contradictory histories held by groups that have been in violent conflict, and to reconciliation in general. The role of processes that have been emphasized in the literature on reconciliation, such as truth, justice, and contact between groups are discussed. Bottom up approaches focusing on the population and top down approaches involving leaders and the media, and the importance of changes in institutions and structures are discussed. The article exemplifies many of the issues and processes by a discussion of the genocide in Rwanda, and by the description of interventions, ranging from work with small groups, including leaders and the media, to radio programs that aimed to further reconciliation, as well as research evaluating an intervention.

Frequency radar is an operational oceanographic tool. Researchers have identified the basic sources of error associated with this technology. Further research evaluating errors relating to the HF radar system and corresponding algorithms can facilitate coastal environment data assimilation. Uncertainty due to two sources of error is studied to obtain a more complete accuracy of the HF radar-measured total surface current velocity vectors. The error sources include geometry of the two station HF radar system and limits of the deep-water wave assumption of the algorithm that calculates current velocity from the HF radar signal. The latter is of particular interest to our work in a shallow environment such as Corpus Christi Bay. Water depths in portions of this and other Texas bays will push the limits of the deep-water assumption for the wavelengths of interest. A map of Corpus Christi Bay illustrating quantified GDOP for each point on the radar grid and an applicable matrix transformation that accounts for error due to the deep water wave assumption. The deep water assumption error is quantified and shown to be minimal for depths as shallow as one meter.

We collate data from the latest AISHE Report regarding PhDs enrolled and passing out and the Gross State Domestic Product (GSDP) of various states and union territories to compute primary and composite indicators that show how well they are preparing for a knowledge economy. The "Revealed" Comparative Advantage (RCA) of Balassa is used to evaluate the comparative or competitive advantage of the various comparators. The Balassa index serves as a proxy for intensity or quality of the activity, against GSDP baselines. We use this to visualize the patterns and order the comparators using quantity-quality maps and Lorenz curve representations. Mizoram, Manipur, Arunachal Pradesh, Jammu and Kashmir, Meghalaya, Nagaland, and Sikkim are well endowed with institutions where relative to the GSDP, a large number of PhDs have opportunities to conduct research. Among the large states, Punjab, Tamil Nadu and Delhi lead prominently, while Maharashtra, Karnataka, and Gujarat, which traditionally lead the economic, industrial, and digital economy sectors are seen as laggards when it comes to enrolling and producing PhDs relative to their respective GSDPs. For annual out-turn of PhDs, Kerala moves up the rankings and joins Delhi as a large state with good performance relative to GSDP.

The objective of this paper was to verify the spacing and age influence in the longitudinal residual strain (DRL) in clones of Eucalyptus associated to the growth stresses. The material was collected at Vazante and Paracatu regions, Northwest of Minas Gerais State, Brazil. An extensometer CIRAD-Forêt was used for determining the DRL. Two experiments were evaluated: the first one with four clones (6, 7, 10 and 44) in three spacing (3x3, 6x4 and 10x4 m) and other one with variations in three clones (6, 7 and 44) in three ages (84, 96 and 156 months). The results showed that there was significant effect of both interaction clone-spacing and clone-age on DRL. For the first experiment the results showed that clone 6, increased with the opening spacing, while for clones 7, 10 and 44, the spacing have not caused alteration in the mag- nitude of DRL. The second experiment, evaluating the effect of the age on DRL, showed that DRL of clone 6 suffered reduction with the increase of age, while ...

Length-weight relationship (LWR) and condition factor of Clariasanguillaris of Peele Reservoir (Burkina Faso) were studiedfrom April 2015 to Mars 2017.226 Specimens of Clarias anguillariswere collected monthly from traditional fishing.In each specimen,length (TL) and total weight were determined. The length-weight relationship was obtained by the equation: W = a*Lb.Value of regression intercept (a) and slope (b) was obtained by linearizing the equation using the least square method. Condition factor (K) was determined by the equation: K= 100 (W/Lb).The length-weight relationship showed negative allometric growth. Values of condition factor showed that Peele reservoir was favorable to the growth of Clarias anguillaris. Results of this study would be used to well management particularly of Peele reservoir and generally of aquatic ecosystem in Burkina Faso.

This paper addresses the development of a flexible low-cost automated scale highway (FLASH) laboratory which is intended to serve as a catalyst for accelerating the development of many intelligent vehicle highway system (IVHS) concepts. It also highlights the significance of the laboratory for the research, evaluation, and testing of automated highway system (AHS) configurations, architectures, designs and technologies. This laboratory,

Academic books are objects of special value in the cycle of scholarly communication in the social sciences and humanities (SSH). This value can be assigned, described, and assessed by different actors in academia at different points in the communication process, in ways that tend to be more formal and objective but are also frequently based on complex, informal and subjective notions of quality. An important feature of the academic book publishing system has been recognised and can best be related to the concept of ‘bibliodiversity’. Aside from publishing at the international level (usually by big publishing companies), a significant body of knowledge is (and has been in the past) produced and circulated within smaller national and regional landscapes. Such country- specific ecosystems of academic book publishers are key to the survival of epistemic and linguistic plurality in research as well as its societal impact and relevance Traditionally, many of these European national ecosystems have consisted of small and mid-sized publishers, public or private, often subsidised by public resources since market-based strategies have not been sufficient to enable their financial sustainability. In multiple ways, the financial sustainability of publishers was reliant on the value of the books they were publishing, as perceived and assessed by authors, reviewers, readers, libraries, funding agencies, and government bodies, or bodies performing research assessments. The transition to Open Access (OA) is inevitable even for these small national landscapes; it is beneficial for both the authors and the audience and is often fostered by national OS policies. However, it can bring disruption into already fragile and vulnerable ecosystems, and this refers particularly to the countries that belong to the so-called scientific semi-periphery. While publishers will need to find ways to provide new services, better adjusted to the open circulation of knowledge, this will inevitably result in a changed understanding of what constitutes ‘quality’ and ‘prestige’ in book publishing, impact the ways in which books are evaluated and assessed, and have consequences on the publishers’ sustainability.

RESUMO -Com o objetivo de entender os efeitos da intensidade de pastejo, sobre as características morfogênicas, o valor nutritivo, a produção de matéria seca e as perdas da espécie Panicum maximum, foi comprovado que incrementos na altura de pastejo estimulam alterações morfogênicas importantes, elevando a altura do meristema apical e o índice de área foliar reduzindo a relação folha:colmo, promovendo uma redução no valor nutritivo da pastagem, enquanto a maior intensidade de pastejo estimulou o perfilhamento lateral. De maneira geral, menores alturas de corte aumentam a produção de MS para a espécie Panicum maximum. Se por um lado a alta oferta de forragem provoca aumento nas perdas, maiores intensidades reduzem a quantidade de folhas mortas na liteira, que por sua vez, são necessárias para manter a integridade e proteção do solo. A intensidade de pastejo deve ser o ponto de partida para determinar as demais práticas de manejo visando o aproveitamento mais eficiente das pastagens, que por sua vez, garantirá o atendimento das exigências de mantença e produção dos animais, a redução das perdas com o pastejo e a perenidade da pastagem. Palavras-chave: características morfogênicas, intensidade de pastejo, senescência SUMMARY -With the objective of understanding the effects of the intensity grazing, on the characteristics morphogenic, the nutritional value, the production of dry matter and the losses of the species Panicum, it was proven that increments in the grazing height stimulate alterations important morphogenic, elevating the meristem apical height and the leaf area index reducing the leaf/culm ratio, promoting a reduction in the nutritional value of the pasture, while the largest grazing intensity stimulated the lateral tiller. In way general, smaller cut heights they increase the production of MS for the gender Panicum. If on one side the high forage offer provokes increase in the losses, larger intensities reduce the amount of leaves died in the litter, that for time it, they are necessary to maintain the integrity and protection of the soil. The grazing intensity should be the starting point to determine the other handling practices seeking the most efficient use of the pasture, that for his/her time, it will guarantee the service of the maintenance demands and production of the animals, the reduction of the losses with the grazing and the longevity of the pasture.

Pennsylvania System of School Assessment (PSSA) data from one rural school system covering four groups of children for a consecutive three year period was used to study the impact of transient students entering the school system. The analysis compared native children (those on roll since the first year) with transient children added to or deleted from the enrollment base of the district during 2006, 2007, 2008 academic years when the PSSA exam was administered. Significant differences favoring the achievement of native children were noted over the years of the study. A policy recommendation regarding data used for making Adequate Yearly Progress (AYP) is also presented in this paper.

Pennsylvania System of School Assessment (PSSA) data from one rural school system covering four groups of children for a consecutive three year period was used to study the impact of transient students entering the school system. The analysis compared native children (those on roll since the first year) with transient children added to or deleted from the enrollment base of the district during 2006, 2007, 2008 academic years when the PSSA exam was administered. Significant differences favoring the achievement of native children were noted over the years of the study. A policy recommendation regarding data used for making Adequate Yearly Progress (AYP) is also presented in this paper.

The focus of this study was to analyze a benchmark formative assessment (4Sight) that pr edicts how students will perform on the annual Pennsylvania, USA exam that is given in grades three through eight inclusive and 11. Correlation analysis reported a significant positive linear relationship between students' performance in the Pennsylvania System of School Assessment (PSSA) exam and each of the 4Sight exams. Also the authors found significant correlations between PSSA performance by gender, ethnicity, socio-economic status, and grade levels. The research revealed significant differences in the average scores and student grade level, ethnicity, and socioeconomic status. This study shows significant gains in student scores and the results clearly support the use of the 4Sight Benchmark Assessment. Not only will 4Sight assist school stakeholders in pinpointing academic achievement, it may also help determine a course of action for staff professional development efforts and spending practices to continue formative benchmark assessments.

The focus of this study was to analyze a benchmark formative assessment (4Sight) that pr edicts how students will perform on the annual Pennsylvania, USA exam that is given in grades three through eight inclusive and 11. Correlation analysis reported a significant positive linear relationship between students' performance in the Pennsylvania System of School Assessment (PSSA) exam and each of the 4Sight exams. Also the authors found significant correlations between PSSA performance by gender, ethnicity, socio-economic status, and grade levels. The research revealed significant differences in the average scores and student grade level, ethnicity, and socioeconomic status. This study shows significant gains in student scores and the results clearly support the use of the 4Sight Benchmark Assessment. Not only will 4Sight assist school stakeholders in pinpointing academic achievement, it may also help determine a course of action for staff professional development efforts and spendi...

The New Jersey Collegiate Substance Abuse Program (NJCSAP) provided intensive substance abuse treatment to college students requiring treatment for severe substance use disorders. This study reports the progress of students who received 6 months of treatment at NJCSAP and participated in a research evaluation of the program. Overall, 74.5% of participants who completed the follow-up were abstinent at the 6-month assessment. Including participants who did not complete the follow-up as users yielded a 52.6% rate of abstinence. Students who completed the follow-up experienced decreases in the number of current psychiatric diagnoses met, depressive symptomatology, alcohol and drug problem severity, and family and psychiatric problem severity over the 6 month period. Most students rated the program components as vet), or moderately helpful and most were attending AA at the 6-month assessment. Results are compared to findings from other programs for adolescents and young adults. Copyright

This three-paper dissertation explores problems with the use of standardized tests as outcome measures for the evaluation of instructional interventions in mathematics and science. Investigators commonly use students’ scores on standardized tests to evaluate the impact of instructional programs designed to improve student achievement. However, evidence suggests that the standardized tests may not measure, or may not measure well, the student learning caused by the interventions. This problem is special case of a basic problem in applied measurement related to understanding whether a particular test provides accurate and useful information about the impact of an educational intervention. The three papers explore different aspects of the issue and highlight the potential benefits of (a) using particular research methods and of (b) implementing changes to educational policy that would strengthen efforts to reform instructional intervention in mathematics and science.The first paper inv...

This study investigates the use of persistent identifiers and alternative metrics exposure in Latin American institutional repositories, focusing on 307 repositories from Spanish-speaking countries. Findings reveal that while 82.7% of repositories use the Handle System, only 48% resolve correctly, indicating maintenance challenges. Additionally, a modest presence of alternative metrics is noted, with only 12.1% displaying Altmetric badges and 1.6% exhibiting PlumX badges. Only 29.6% allow the collection of alternative metrics data via Altmetric's bookmarklet tool. Practical solutions emphasize leveraging persistent identifiers and fostering collaboration with altmetric service providers to enhance metric exposure. This research underscores the importance of optimizing repositories for comprehensive research impact assessment, emphasizing both academic recognition and societal relevance. It provides insights for institutions to improve repository efficiency and document the impact of research outputs effectively, contributing to the advancement of open science practices.

The purpose of this paper is to research the premises for the development of analytical tools for reporting sustainability activities at the microeconomic level. Based on the synthesis of specialized literature, the analysis of policy documents and analytical reports of international and European organizations, it was hypothesized that the current corporate reporting framework does not meet the informational needs of stakeholders. In order to identify the methodological issues regarding sustainability reporting, both the national practice in the field of monitoring and reporting of the National Bureau of Statistics of the Republic of Moldova regarding ODD2030 and the corporate practice were analyzed, being examined non-financial reporting documents of the Purcari S.A. group and of the State enterprise "State Administration of Roads". Traditional research methods were applied in the research: monographic, analysis, synthesis, comparison. The carried-out research allowed the authors to systematize qualitative and quantitative performance indicators (KPI) for measuring and evaluating the entity's sustainable performance. It was concluded that at the national level, the system of indicators for monitoring progress in achieving the 2030 Agenda is developed, but at the microeconomic level, the necessary analytical and methodological framework is missing. In this context, the conducted research provides a theoretical framework for the relationship between the accounting information system and business sustainability. In addition, the study provides a methodological framework for the sustainability reporting procedure and the KPI system for sustainability performance assessment.

Does the special status of a university improve state support and lead to cumulative advantages? Few studies have focused on the effects of the competitive funding of research projects. This paper contributes to the field by investigating how Russian state universities compete for additional research funding. By drawing on data from open sources, I focus on the winners of the Russian Academic Excellence Initiative 5-100 and the applicants which did not get selected. A comparison of 21 research-oriented winners with a control group of 22 unsuccessful applicants revealed the equally modest success of both in securing funding beyond the state funding programs. However, there is a positive trend in attracting grant funds by the program winners. This may be due to the cumulative effect of the 5-100 initiative and the new Russian Science Foundation (RSF) which were introduced almost simultaneously. The comparison further shows that elite universities outperform their rivals in a variety of funding programs, but this is more evident in the RSF competitions. The paper further deliberates on the possible effects of RSF grants for universities (in Russian).

In Russian: В статье анализируется эффект внедрения наукометрических барьеров при распределении грантов Российского научного фонда в рамках ежегодного конкурса научных групп на примере сравнения победителей 2014 и 2017 годов. Можно ли считать перемены в процедуре отбора заявок, связанные с анализом предшествующих научных достижений учёных, шагом к поддержке более продуктивных руководителей грантов? Полезно ли внимание к наукометрическим показателям исследователей? Изменилась ли доля руководителей грантов, которые входили в число авторов самых высокоцитируемых публикаций в своих областях? Различаются ли результаты для учёных из области физики и социально-гуманитарных наук? Авторы ответили на эти вопросы, проанализировав по базе Scopus данные о научных публикациях руководителей грантов РНФ, получавших финансовую поддержку фонда. В анализ были включены две группы учёных-победители по направлению «физика и науки о космосе» и победители в области социально-гуманитарных наук. Для того, чтобы глубже оценить научные результаты руководителей авторы сравнили их публикации с выборкой высокоцитируемых публикаций в соответствующих областях. Было обнаружено, что отбор среди физиков уже в первый период был эффективным, поскольку получателями грантов стали продуктивные исследователи, среди которых присутствовали авторы высокоцитируемых статей. Гуманитарии заметно реже публикуются в международных изданиях, но и в их случае во втором периоде отбор фонда дал лучшие результаты в отношении присуждения грантов более плодовитым авторам, как с точки зрения количества, так и качества публикаций

This study examines the effects of using publication-based metrics for the initial screening in the application process for a project leader. The key questions are whether formal policy affects the allocation of funds to researchers with a better publication record and how the previous academic performance of principal investigators is related to future project results. Design/methodology/approach: We compared two competitions, before and after the policy raised the publication threshold for the principal investigators. We analyzed 9,167 papers published by 332 winners in physics and the social sciences and humanities (SSH), and 11,253 publications resulting from each funded project. Findings: We found that among physicists, even in the first period, grants tended to be allocated to prolific authors publishing in high-quality journals. In contrast, the SSH project grantees had been less prolific in publishing internationally in both periods; however, in the second period, the selection of grant recipients yielded better results regarding awarding grants to more productive authors in terms of the quantity and quality of publications. There was no evidence that this better selection of grant recipients resulted in better publication records during grant realization. Originality: This study contributes to the discussion of formal policies that rely on metrics for the evaluation of grant proposals. The Russian case shows that such policy may have a profound effect on changing the supply side of applicants, especially in disciplines that are less suitable for metric-based evaluations. In spite of the criticism given to metrics, they might be a useful additional instrument in academic systems where professional expertise is corrupted and prevents allocation of funds to prolific researchers.

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

The research evaluated the changes of verbal and spatial working memory with females during 15 days À 61 head-down bed rest. We used 2-back task to evaluate the working memory ability on four time points: the fifth day before the rest, the fifth day and the tenth day in the rest and the fifth day after the rest, as well as record the participants' depression and anxiety feelings using Beck Anxiety Inventory (BAI) and Beck Depression Inventory (BDI) simultaneously. The results demonstrated that the trends of verbal and spatial working memory performance were consistent with that of the control group during the rest. Moreover, in the À 61 head-down bed rest conditions, the participants have performed no damage on the working memory ability, and any clinically salient anxiety and depression. The research considered that, compared to the real space environment, individuals' undamaged cognitive functions probably have something to do with the failure of evoking clinical anxiety and depression in the stimulated weightless environment.

en los diversos procesos a los que se somete al profesorado universitario a lo largo de su carrera profesional, debido a la influencia cada vez mayor de dicho proceso. En concreto, el análisis se centra en los conocidos sexenios de investigación que evalúa la Comisión Nacional Evaluadora de la Actividad Investigadora (CNEAI) y en las promociones a diversas figuras de profesorado, contratado y funcionario, que realiza la Agencia Nacional de Evaluación de la Calidad y Acreditación (ANECA). En primer lugar se presenta la situación actual de los indicadores y criterios que emplean ambas organizaciones y se aprovecha para realizar un breve recorrido histórico en su evolución. Por último y atendiendo a lo expuesto en los apartados anteriores se presentan una serie de alternativas para adecuar los méritos exigidos al esfuerzo investigador del profesorado de economía y teniendo por primera vez en cuenta un aspecto tan relevante como es la dedicación docente de cada profesor.

This toolkit is designed to help school-and district-based practitioners engage in a continuous improvement effort. It provides an overview of continuous improvement and focuses on the Plan-Do-Study-Act cycle. It includes tools and resources that practitioners can use to implement a continuous improvement effort in their own schools, districts, or agencies.

The aim of this investigation was to gauge the comparative research performance of university departments of psychology in Britain. The performance indicator was the number of publications per departmental staff member in the journals of the British Psychological Society (BPS) during the seven-year period 1983-1989. The contents of these journals were thoroughly searched, and articles written by members of university psychology departments in Britain were counted. The number of publications of each psychology department was divided by the size of the department in the corresponding year and the resulting annual figures were summed to determine the number of publications in BPS journals per departmental staff member over the seven-year period. These research performance figures correlated significantly with an earlier measure of departmental research performance based on publications in the seven European psychological journals with the highest citations per published article and with recent performance indicators based on other criteria.

Indicator of evaluation in Scholarly Publication Ecosystem

Form of evaluation:
Content evaluation
bibliographic evaluation
altimetric evaluation
open evaluation

Type of evaluation:
Quantitative evaluation
qualitative evaluation
mixed evaluation

Format of evaluation:
Technical evaluation,
non-technical evaluation

We offer a different perspective of how quantity and quality of impact from scientific collaboration is shared between an institution and its direct collaborators using common bibliometric measures. The CWTS Leiden data gives size-dependent measures like number of publications and highly-cited publications and a size-independent measure of quality of impact The number of publications and highly-cited publications combine additively while the impact measure combines in a weighted way. The relationships are presented in the form of two-dimensional graphs and they reveal a pyramidal or inverted funnel dispersion. Examples are given to illustrate the use of data and methodology and typical results for a few comparator countries are shown.

Este es un artículo de acceso abierto distribuido bajo los términos de la licencia Creative Commons Attribution-Non Commercial (by-nc) Spain 3.0 [ 106 ] anna planas-lladó, pilar pineda-herrero, esther gil-pasamontes y laia sánchez-casals sips-pedagogia social. revista interuniversitaria [1139-1723 (2014) 24, 105-134] tercera época PALAVRAS-CHAVE: avaliação, pesquisa participativa; pesquisa de avaliação; ação comunitária; desenvolvimento comunitário; participação. la metodología de la evaluación participativa de planes y acciones comunitarias. tres experiencias de evaluación... [ 107 ] sips-pedagogia social. revista interuniversitaria [1139-1723 (2014) 24, 105-134] tercera época [ 108 ] anna planas-lladó, pilar pineda-herrero, esther gil-pasamontes y laia sánchez-casals sips-pedagogia social. revista interuniversitaria [1139-1723 (2014) 24, 105-134] tercera época la metodología de la evaluación participativa de planes y acciones comunitarias. tres experiencias de evaluación... [ 109 ]

The main goal of the study was to adapt the Structured Child Assessment Tool for Family Relationships (SCARF) developed by Strachan et al. (2010) to Turkish culture and to develop an assessment tool for the evaluators working in custody cases to make a standardized assessment in child interviews. The study involved 130 children between the ages of 4 and 14 who were included in custody cases. For the reliability of the assessment tool, Cronbach's Alpha coefficients were computed for dimensions and subdimensions by age and examined with the test-retest method. For construct validity, Spearman Correlation Analysis was conducted for the correlation between the scores given by the child and the evaluator to the parents. Independent samples t-test was applied to specify whether there was a statistically significant difference between the scores given by children to their parents. In the research, a significant positive relationship was established in the scores given to the mother in both assessment tools for construct validity. In the scores given to the father, a significant relationship was found in all dimensions except Negative Parenting and Co-Parenting (p<0.01). The comparison of the scores given by the child to the parents did not reveal any significant difference between the scores of the mother and father in all dimensions and sub-dimensions (p>0.05). As a consequence, it was established that the SCARF is a valid, reliable, and appropriate assessment tool for Turkish culture that can be used by the evaluator in child with custody cases.

 Users may download and print one copy of any publication from the public portal for the purpose of private study or research.  You may not further distribute the material or use it for any profit-making activity or commercial gain  You may freely distribute the URL identifying the publication in the public portal If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

In this work we investigate the determinants of professors' career advancement in Italian universities. From the analyses, it emerges that the fundamental determinant of an academic candidate's success is not scientific merit, but rather the number of years that the candidate has belonged to the same university as the selection committee president. Where applicants have participated in research work with the president, their probability of success also increases significantly. The factors of the years of service and occurrence of joint research for the other commission members also have an effect, however of lesser weight. The specific phenomenon of nepotism, although it exists, seems less important. The scientific quality of the commission members has negligible effect on the expected outcome of the competition, and even more so the geographic location of the university calling for the competition.

In benchmarking international research, although publication and citation analyses should not be used to compare different disciplines, scientometrists frequently fail to resist the temptation to present rankings based on total publications and citations. Such measures are affected ...

National research evaluation exercises provide a comparative measure of research performance of the nation's institutions, and as such represent a tool for stimulating research productivity, particularly if the results are used to inform selective funding by government. While a school of thought welcomes frequent changes in evaluation criteria in order to prevent the subjects evaluated from adopting opportunistic behaviors, it is evident that the "rules of the game" should above all be functional towards policy objectives, and therefore be known with adequate forewarning prior to the evaluation period. Otherwise, the risk is that policy-makers will find themselves faced by a dilemma: should they reward universities that responded best to the criteria in effect at the outset of the observation period or those that result as best according to rules that emerged during or after the observation period? This study verifies if and to what extent some universities are penalized instead of rewarded for good behavior, in pursuit of the objectives of the "known" rules of the game, by comparing the research performances of Italian universities for the period of the nation's next evaluation exercise (2004-2008): first as measured according to criteria available at the outset of the period and next according to those announced at the end of the period.

Resumen: Las recientes llamadas de atención desde la comunidad científica para una «cartera más equilibrada» en la inversión pública en ciencia han sostenido la necesidad de complementar los incrementos en los fondos para la investigación biomédica con aumentos en los soportes de las investigaciones físicas, informáticas y de materiales junto con un apoyo reforzado al nivel superior de educación científica. Tales argumentos presumen que la ciencia es un bien público no cualificado. El presente artículo, sin embargo, sugiere ...

Distributed Constraint Satisfaction Problems (DCSP) provide a formalism for representing, in a simple and efficient way, distributed problems. Different agents collaborate with each other in order to find a global solution subject to constraints. In general, researchers evaluate DCSP algorithms on graph coloring problems or uniform random binary DCSP. In this paper, we propose to compare DCSP algorithms on a multi-agent exploration problem. This problem is a particular case of multi-agent coordination problems and the evaluation of DCSP algorithms on this problem is difficult. In order to measure different aspects of this multi-agent exploration problem, we use six different criteria: classical criteria from DCSP benchmarks and specific criteria for this problem.

Log (localizer RMSE) =-2.26 + 0.07 (z-clutter score) 2 + 0.43 (leg)-1.41 (display) +0.43 (workload) +0.95 (Luminance)-1.81 (contrast)-1.12 (density) (R 2 =0.36, p<0.0001) Log (localizer RMSE) =-2.16 + 0.19 (z-TLX) + 0.44 (leg)-1.38 (display) + 0.37 (workload) + 0.99 (luminance)-1.70 (contrast)-1.17 (density) (R 2 =0.37, p<0.0001) Objectives 1. Perform preliminary validation of multidimensional measure of display clutter. 2. Assess influence of: (a) pilot experience; (b) HUD configuration; (c) flight segment; and (d) workload on perceptions of display clutter and cognitive load, and flight task performance. 3. Model HUD clutter scores in terms of display visual properties (e.g., lumens, contrast, active pixels). • Model pilot performance in terms of perceived clutter and cognitive load. • Identify clutter descriptor terms most used by pilots with range of experience to define clutter under different conditions.

This paper suggests practical methods for assessing policy research programs, both ex post and ex ante. Measuring the benefits of policy research is difficult: the path of causation between research and policy change is nearly always uncertain; multiple factors influence any particular policy change; policies are diverse in nature as are their intended and actual effects; and some effects of policy research are not priced in the market. Many of the benefits of changes in policy stem from the reduced cost of welfareimproving institutional change. Economic surplus analysis can be used to assess such changes. In some cases, Bayesian decision theory may be helpful in evaluating policy research, although it is usually difficult to obtain estimates of the probability distributions a decisionmaker has before the research becomes available. Subjective estimates of parameters and some measure of their degree of uncertainty, are likely to be needed for an economic surplus model. The paper suggests a set of steps for policy research evaluation. It is applied to two cases: an evaluation of pesticide policy research in Brazil, and an evaluation of policies affecting deforestation in Indonesia.

After-death interviews with bereaved respondents are an important tool in the repertoire of researchers evaluating the quality of end-of-life care or investigating the experiences of people at the end of life. Despite the importance of after-death interviews to our understanding of the last months of life, the validity of the information gathered has received little attention. In this article, we review some of the available information, drawing on evidence from cognitive psychology as well as from palliative care studies. Findings from cognitive psychology indicate that memory is a dynamic process, influenced by emotion state and the individual's perspective at the time of the event and at recall. Further research is therefore needed to understand better the circumstances, types of information and research questions for which bereaved relatives are valid surrogates for people who have died.

A key challenge in the sciences is the quantification, measure and management of knowledge, particularly as it relates to the growth and emergence of new disciplines. This exploratory study examines the growth of two relatively new sciences: nanotechnology and nanomedicine. Using a simple analysis of the growth of publications in these two related fields, the authors show that the growth in new sciences has been quite rapid. Nevertheless, a major limitation of this work is that it is far too difficult to quantify their spillover effects and new methods of quantifying these. The authors propose that new ways of quantifying scientific spillovers is needed and require investigation, given the limitations of scientific metrics such as bibliometrics.

The paper explores the feasibility to contribute to solving problems derived from social exclusion with the support of scientific research, among other factors. The exploration is based on an analytical path consisting, first, in the systemic identification of the actors involved in the process and, second, in the follow-up of the journey that goes from the existence of the problem of social inclusion until its resolution. Finally, the analytical path is illustrated and tested with concrete examples of the Uruguayan experience.

Australian higher education policy aimed at widening participation focuses on the inclusion of students from diverse backgrounds, including those from a low socioeconomic status background. While this policy has succeeded in widening access, other measures of policy success include retention and academic success of these students and their achievement of course learning outcomes. One inclusive approach to contributing to students' academic success is through a curriculum development process which includes the embedding of academic literacies in course curricula. The project presented here is based on a rationale that adopting an embedded academic literacies approach represents a movement away from a deficit model of academic support, and envisages the development of academic literacies in terms of disciplinary practices and shifting student identities. This paper presents two case studies from this project which illustrate different approaches to the development of embedded academic literacies curricula, and discusses the challenges of measuring the success of these approaches. The project evaluation confirms that this curriculum development contributes to students' awareness of their developing academic skills and literacies and that capacity building for staff should be presented in a variety of different ways. However, we argue that further interrogation of the "good and bad news stories" from this project will contribute to sustainable approaches to enriching curricula more broadly across the university. We also argue that while broad curriculum renewal depends on systemic university policy, success is also contingent on the engagement of all those who have responsibility for student learning.

Australian higher education policy aimed at widening participation focuses on the inclusion of students from diverse backgrounds, including those from a low socioeconomic status background. While this policy has succeeded in widening access, other measures of policy success include retention and academic success of these students and their achievement of course learning outcomes. One inclusive approach to contributing to students' academic success is through a curriculum development process which includes the embedding of academic literacies in course curricula. The project presented here is based on a rationale that adopting an embedded academic literacies approach represents a movement away from a deficit model of academic support, and envisages the development of academic literacies in terms of disciplinary practices and shifting student identities. This paper presents two case studies from this project which illustrate different approaches to the development of embedded academic literacies curricula, and discusses the challenges of measuring the success of these approaches. The project evaluation confirms that this curriculum development contributes to students' awareness of their developing academic skills and literacies and that capacity building for staff should be presented in a variety of different ways. However, we argue that further interrogation of the "good and bad news stories" from this project will contribute to sustainable approaches to enriching curricula more broadly across the university. We also argue that while broad curriculum renewal depends on systemic university policy, success is also contingent on the engagement of all those who have responsibility for student learning.

The author thanks the three groups of First Nations communities in British Columbia, Canada, who participated in the research reported in this article and whose efforts to serve children and families provide examples for everyone. Thank you also to individual community members and service providers who were interviewed for the research. The communities and the individuals who participated entered into the research process with the understanding that they would remain anonymous, and they are not named in this article at their request. The author also expresses appreciation to Silvia Vilches who has assisted in the project.

In the wake of the terrorist attacks at the World Trade Center, more than 9,000 counselors went to New York City to offer aid to rescue workers, families, and direct victims of the violence of September 11, 2001. These mental health professionals assumed that many New Yorkers were at high risk for developing posttraumatic stress disorder (PTSD), and they hoped that their interventions would mitigate psychological distress and prevent the emergence of this syndrome. Typically developing in response to horrific, life-threatening events, such as combat, rape, and earthquakes, PTSD is characterized by reexperiencing symptoms (e.g., intrusive recollections of the trauma, nightmares), emotional numbing and avoidance of reminders of the trauma, and hyperarousal (e.g., exaggerated startle, difficulty sleeping). People vary widely in their vulnerability for developing PTSD in the wake of trauma. For example, higher cognitive ability and strong social support buffer people against PTSD, whereas a family or personal history of emotional disorder heightens risk, as does negative appraisal of one's stress reactions (e.g., as a sign of personal weakness) and dissociation during the trauma (e.g., feeling unreal or experiencing time slowing down). However, the vast majority of trauma survivors recover from initial posttrauma reactions without professional help. Accordingly, the efficacy of interventions designed to mitigate acute distress and prevent long-term psychopathology, such as PTSD, needs to be evaluated against the effects of natural recovery. The need for controlled evaluations of early interventions has only recently been widely acknowledged. Psychological debriefing-the most widely used method-has undergone increasing empirical scrutiny, and the results have been disappointing. Although the majority of debriefed survivors describe the experience as helpful, there is no convincing evidence that debriefing reduces the incidence of PTSD, and some controlled studies suggest that it may impede natural recovery from trauma. Most studies show that individuals who receive de-briefing fare no better than those who do not receive debriefing. Methodological limitations have complicated interpretation of the data, and an intense controversy has developed regarding how best to help people in the immediate wake of trauma. Recent published recommendations suggest that individuals providing crisis intervention in the immediate aftermath of the event should carefully assess trauma survivors' needs and offer support as necessary, without forcing survivors to disclose their personal thoughts and feelings about the event. Providing information about the trauma and its consequences is also important. However, research evaluating the efficacy of such "psychological first aid" is needed. Some researchers have developed early interventions to treat individuals who are already showing marked stress symptoms, and have tested methods of identifying those at risk for chronic PTSD. The single most important indicator of subsequent risk for chronic PTSD appears to be the severity or number of posttrauma symptoms from about 1 to 2 weeks after the event onward (provided that the event is over and that there is no ongoing threat). Cognitive-behavioral treatments differ from crisis intervention (e.g., debriefing) in that they are delivered weeks or months after the trauma, and therefore constitute a form of psychotherapy, not immediate emotional first aid. Several controlled trials suggest that certain cognitive-behavioral therapy methods may reduce the incidence of PTSD among people exposed to traumatic events. These methods are more effective than either supportive counseling or no intervention. In this monograph, we review risk factors for PTSD, research on psychological debriefing, recent recommendations for crisis intervention and the identification of individuals at risk of chronic PTSD, and research on early interventions based on cognitive-behavioral therapy. We close by placing the controversy regarding early aid for trauma survivors in its social, political, and economic context. Following the terrorist attacks at the World Trade Center, more than 9,000 grief and crisis counselors arrived in New York City to provide aid to families, rescue workers, and others exposed to the mayhem of September 11, 2001. The assumption driving these well-intentioned efforts was that many New Yorkers were likely to develop posttraumatic stress disorder (PTSD) if they did not receive counseling soon after the trauma.

Data quality remains a persistent problem in practice and a challenge for research. In this study we focus on four of the most important dimensions of data quality -accuracy, completeness, consistency, and timeliness. Definitions and conceptual models for these dimensions have not been collectively considered with respect to data mining in general and a key determinant of data mining outcomes, problem complexity, in particular. Conversely, these four dimensions of data quality have only been indirectly addressed by data mining research. Using definitions and constructs of data quality dimensions, our research shows for the first time that data quality and problem complexity have significant interaction effects on data mining outcomes. It also shows that the dimension of consistency can be concluded to have the largest effects of all four. Our results help address an important research challenge noted by March and Smith [15]. They also enable practitioners to assess data quality, prioritize efforts to improve it, and increase the performance of data mining for better decisions.