Evaluation of Information and Knowledge Retrieval Systems
Maryam Karami; ٖGolnessa Galyani-Moghaddam; Farhad Hadinejad
Abstract
IntroductionThis study evaluates and ranks the scientific journals of psychology using the Data Envelopment Analysis (DEA) model. Data envelopment analysis (DEA) is a linear programming-based technique for measuring the relative performance of organizational units where the presence of multiple inputs ...
Read More
IntroductionThis study evaluates and ranks the scientific journals of psychology using the Data Envelopment Analysis (DEA) model. Data envelopment analysis (DEA) is a linear programming-based technique for measuring the relative performance of organizational units where the presence of multiple inputs and outputs makes comparison difficult. DEA was originally developed to measure the efficiency of a Decision Making Units (DMU) as a whole unit, without considering its internal structure. In other words, the system is treated as a black box, within which inputs are supplied to produce outputs, with there generally being a positive correlation between the two.Traditional DEA models are only able to evaluate DMUs with deterministic inputs and outputs, while in real-world problems, data are usually uncertain. So far, various approaches have been introduced to overcome the uncertainty of data. In this paper, two robust DEA models are presented to evaluate the performance of systems with continuous uncertain data under constant return to scale (CRS) and variable return to scale (VRS) conditions. The main advantage of the proposed robust DEA models over the previous robust DEA models is that they are able to formulate uncertainty in both input and output data. Moreover, these models are also developed directly on basic traditional DEA models (not alternative models).Research Question(s)What is the status of effective indicators (citation and non-citation) in the ranking of valid scientific journals of psychology?What are the top scientific journals in different fields of psychology?What is the ranking status of psychology journals using the Data Envelopment Analysis (DEA) model?What is the ranking status of psychology scientific journals based on the Anderson-Peterson CRS and Anderson-Peterson VRS models?Literature ReviewDEA is used for ranking journals in different fields. A study by Rosenthal and Weiss (2017) ranks business journals, using data from the Thomson Reuters Journal Citation Reports® (JCR). They ranked 358 business journals from five different JCR categories according to such citation-based factors as the number of articles, the number of citations, impact factor, five-year impact factor, immediacy index, eigenfactor score, and article influence score. They compute the relative efficiencies of the journals and thereby create plausible journal rankings that largely, but not completely, corroborate three widely used business publication journal ranking lists. In addition, we show how the different characteristics of the JCR data impact the DEA ranking model. Finally, they identify journals that are not on the business publication lists but consistently perform very well relative to those benchmark journals, and should possibly be included in the business publication ranking lists. They also identify journals whose inclusion in widely used business publication rankings cannot be justified by their methodology.MethodologyIn this study of data envelopment analysis technique, Anderson-Peterson model, CRS and VRS output-oriented, 2018 JCR ratings scientific journals of psychology were evaluated and the top journals ranked. This study has a quantitative approach and is applied research. The research method is scientometrics and bibliometrics using Operational Research techniques. In order to evaluate and rank psychology scientific journals, seven citation indicators were extracted from the Analytics Clarivate database. These indicators are the total number of citations, journal impact factor, five-year impact factor, immediate index, citeable items, journal influence factor, and journal article influence factor.In this study, using data envelopment analysis technique, Anderson-Peterson model, CRS and VRS output-oriented, 2018 JCR ratings scientific journals of psychology were evaluated and the top journals ranked.ResultsFindings show that with the help of JCR indicators and using the Anderson-Peterson CRS and VRS model, more accurate rankings of journals can be achieved. The comparison of scientific journals is in the ranking of CRS and VRS models. The Journal of Psychological Science in the Public Interest tops in both models. The top 10 journals based on CRS respectively are: Psychological Science in the Public Interest, International Review of Sport and Exercise Psychology, Annual Review of Psychology, Psychological Bulletin, Psychological Inquiry, Behavioral and Brain Sciences, Social Issues and Policy Review, Personality and Social Psychology Review, Annual Review of Clinical Psychology, Journal of Personality and Social Psychology.The top 10 journals based on VRS respectively are: Psychological Science in the Public Interest, International Review of Sport and Exercise Psychology, Annual Review of Psychology, Frontiers in Psychology, Psychological Bulletin, Journal of Personality and Social Psychology, Trends in Cognitive Sciences, Psychological Science, Frontiers in Human Neurosciences.DiscussionHere goes the text for your discussion.ConclusionScientific journals of psychology were evaluated and ranked using the Anderson-Peterson CRS and VRS models. Also, the evaluation indicators of scientific journals in the Clarivate Analytics database were reviewed and the top three journals in 11 areas of psychology and the top 30 journals in this field were identified and introduced. The top 30 journals and their differences in CRS and VRS models were compared and analyzed. In the part of descriptive findings, the frequency of journals in different fields of psychology was found, including 10.25% of psychology journals in general, 10.91% of applied psychology journals, 1.86% of biological psychology journals, 17.17% scientific journals in the clinical psychology field, 10.11% scientific journals in advanced psychology field, 7.85% scientific journals in educational psychology field, 11.71% scientific journals in experimental psychology field, 1.73% scientific journals in mathematics psychology field, 18.28% are scientific journals in the field of interdisciplinary psychology, 1.73% are scientific journals in the field of psychoanalytic psychology, and 8.38% are scientific journals in the field of social psychology. Finally, considering the needs of the country's scientific community, conducting research with other research communities (different scientific fields and disciplines), conducting research and ranking journals with other indicators and normalized indicators are recommended.
Najmeh Seyyeddokht; Fatemeh Emami roody
Abstract
The purpose of the study is to evaluate the growth or decrease of scientific output in the field of information retrieval in the Web of Science Citation Database from 2010 to 2017. The research is applied and uses scientific indices to evaluate the scientific outputs of the field of information retrieval ...
Read More
The purpose of the study is to evaluate the growth or decrease of scientific output in the field of information retrieval in the Web of Science Citation Database from 2010 to 2017. The research is applied and uses scientific indices to evaluate the scientific outputs of the field of information retrieval and the statistical population includes all records of the Web of Science Citation Database. The findings showed that molar, H. was the top author in this field with 36 records, and the United States was the top country with 1984 records. The NATIONAL DELA RECHERCHE SCIENTIFIQUE CNRS Institute was recognized by producing 235 records best Institute and LECTURE NOTES IN COMPUTER SCIENCE with 915 records best Journal. Computer science was introduced as the top subject area with 8241 records. An article entitled Graph Regularized Nonnegative Matrix Factorization for Data Representation received the highest citation (including 585 citations) as the top information retrieval article. The results showed that the growth of scientific productions in the field of information retrieval did not follow a steady trend and declined during 2011-2012 as well as in 2017 and during the period of 2013 to 2016 with a growing trend in this field.
Farzaneh Ghanadinezhad
Abstract
The purpose of this study was to present a conceptual model of competencies of university library managers to evaluate their competencies in Ahvaz from the perspective of staff of these libraries.This research was a survey, applied, purposeful, descriptive and analytical in nature. The study population ...
Read More
The purpose of this study was to present a conceptual model of competencies of university library managers to evaluate their competencies in Ahvaz from the perspective of staff of these libraries.This research was a survey, applied, purposeful, descriptive and analytical in nature. The study population consisted of all the staffs of the academic libraries of Ahvaz city (n = 91). Finally, the conceptual model of competencies of university library managers was identified in 7 categories (Individual- behavioral; Socio- communication; Moral- value; Organizational- managerial; Insight- Perceptual; Innovative- Entrepreneurial and Specialty). The competencies of university library managers of Ahvaz city have been evaluated from the perspective of the staff of these libraries to be on a medium to high level.The results of this study indicate that due to the evolutions caused by the development of different technologies and the further movement of these libraries towards digitalization and electronicization, academic libraries need managers who in addition to managerial and specialized knowledge, are familiar with the latest technological advances and learn information literacy skills and other innovative and technological skills. Innovation: Most of the studies that have been undertaken for the study of university library managers have examined the performance of these libraries in a limited dimension. However, the present study was conducted to evaluate the competencies of the managers of Ahvaz academic libraries from different dimensions. The results of these evaluations can provide the basis for planning to address the weaknesses of the managers.
Ali Jalali Dizajji; Mehdi Alipour Hafezi; Hossein Adabi Firozjah
Abstract
Purpose: The aim of this studies evaluating the usability of digital libraries in governmental universities at Tehran.Methodology: Evaluative Survey methodology was used for the survey applying measures of search, navigation, forms layout, contrast and scan ability, optimization (size & print), help, ...
Read More
Purpose: The aim of this studies evaluating the usability of digital libraries in governmental universities at Tehran.Methodology: Evaluative Survey methodology was used for the survey applying measures of search, navigation, forms layout, contrast and scan ability, optimization (size & print), help, usage of windows and speed and errors through a questionnaire containing 36 questions. The research population included 124,800 undergraduate, Master and PhD students, from three governmental universities of Tehran, Sanati Sharif and Sanati Amirkabir. Stratified random sampling method was applied to select 378 students as a sample. For data analysis, SPSS software was used along with descriptive techniques as well as independent test and ANOVA where needed. Findings: The findings indicated that the criteria relating to the usability of digital libraries in the three Tehran universities evaluated to be in relatively good condition and there is no significant difference between the digital libraries for the usability criteria. Conclution: Survey results show that these libraries should be improved by managers, librarians, and experts for a user-friendly system, thereby improving the quality of related universities digital libraries.
Mitra Sameie
Abstract
This study aims to conceptually analyze the Delos reference model and the 5S Framework and to identify key relations between the concepts and indicators of the model and the framework in the organization and evaluation of digital libraries. The research method is conceptual analysis of Delos reference ...
Read More
This study aims to conceptually analyze the Delos reference model and the 5S Framework and to identify key relations between the concepts and indicators of the model and the framework in the organization and evaluation of digital libraries. The research method is conceptual analysis of Delos reference model and 5S Framework in the organization and evaluation of digital libraries. The Delos reference model focuses on the identification of core concepts and relations that encompass a digital library, while the 5S Framework focuses on the concepts of information and knowledge organization. The six areas of Delos reference model include content, user, functionality, quality, policy, and architecture that explain the core concepts and relations of digital libraries in a transparent and structured manner and are used as a foundation for evaluation of digital libraries. However, the 5S Framework mostly focuses on explaining key concepts and information organization in digital libraries such as digital objects, metadata, sets, and services. The organization of the three separate systems (digital library, digital library system, and digital library management system) in the same framework has made the Delos reference model complicated. However, the 5S Framework simply depicts all activities and services of a digital library in five processes. The Delos reference model, compared with the 5S Framework, lacks a strong emphasis on the social aspects of digital libraries. The Delos reference model and the 5s Framework can assist digital library designers in organizing, designing and evaluating digital libraries for coordination of practices, solutions, and development and integration of digital library systems. The Delos model and the 5S Framework have common relationships with digital libraries in the areas such as streams, content, communities, and users.
