Study on criteria to evaluate research projects in educational science in line with international standdards

TÓM TẮT

Nghiên cứu tập trung trình bày cơ sở khoa học của hệ thống tiêu chí đánh giá các công trình

nghiên cứu khoa học giáo dục theo chuẩn quốc tế. Chúng tôi sử dụng kết hợp nghiên cứu lí luận

với phỏng vấn, thảo luận nhóm chuyên gia, khảo sát 140 giảng viên của 5 trường đại học sư phạm

tại Việt Nam và 33 giảng viên phụ trách giảng dạy các bộ môn thuộc 4 chuyên ngành của Trường

Đại học Giáo dục. Mức độ cần thiết, sự phù hợp, độ tin cậy của bộ tiêu chí trong việc đánh giá

luận văn thuộc lĩnh vực khoa học giáo dục đã được kiểm tra. Hai chuyên gia tích kiểm độc lập 146

luận văn dựa vào bộ tiêu chí, kết quả cho thấy ý kiến đánh giá của 2 chuyên gia đối với 38 tiêu chí

đánh giá rất tương đồng với nhau, tỉ lệ trùng khớp nhau từ 85,6% đến 100%. Hệ số tương quan

Kappa đều trên 0,7. Bộ tiêu chí có độ tin cậy cao trong đánh giá chất lượng công trình khoa học

pdf 15 trang phuongnguyen 2260
Bạn đang xem tài liệu "Study on criteria to evaluate research projects in educational science in line with international standdards", để tải tài liệu gốc về máy hãy click vào nút Download ở trên

Tóm tắt nội dung tài liệu: Study on criteria to evaluate research projects in educational science in line with international standdards

Study on criteria to evaluate research projects in educational science in line with international standdards
 TẠP CHÍ KHOA HỌC 
TRƯỜNG ĐẠI HỌC SƯ PHẠM TP HỒ CHÍ MINH 
Tập 17, Số 5 (2020): 829-843 
HO CHI MINH CITY UNIVERSITY OF EDUCATION 
JOURNAL OF SCIENCE 
Vol. 17, No. 5 (2020): 829-843 
ISSN: 
1859-3100 Website:  
829 
Research Article* 
STUDY ON CRITERIA TO EVALUATE RESEARCH PROJECTS 
 IN EDUCATIONAL SCIENCE 
 IN LINE WITH INTERNATIONAL STANDDARDS 
Dinh Thi Kim Thoa
1*
, Tran Van Cong
1
, Tran Thi Thu Anh
2
1 
VNU University of Education, Vietnam National University, Hanoi, Vietnam 
2 
Center of Quality Assurance – University of Hanoi Industrial Textile, Vietnam 
*
Corresponding author: Dinh Thi Kim Thoa – Email: thoadtk@vnu.edu.vn 
Received: March 10, 2020; Revised: April 05, 2020; Accepted: May 27, 2020 
ABSTRACT 
This study focused on finding out the criteria to evaluate research projects in education. We 
used a mixed methods research, including a literature review, focus group interviews with experts, 
and a survey of 140 lecturers from 5 universities of education in Vietnam and 33 lecturers who are 
teaching four majors from the University of Education, Vietnam National University. The necessity, 
suitability, and reliability of the set of criteria in evaluating the thesis in the field of educational 
science were examined. Two independent experts reviewed 146 master theses based on the set of 
criteria. The results showed that the evaluation of the 2 experts for 38 evaluation criteria is very 
similar, matched 85.6% to 100%. The Kappa correlation coefficient was above 0.7. The set of 
criteria is highly reliable in evaluating the quality of scientific projects. 
Keywords: criteria; international standards; educational science; evaluation; literature review 
1. Introduction 
According to the classification of science and technology research in 
Vietnam, educational science belongs to social sciences. Educational science includes 
general education, pedagogy, educational theory, and special education (i.e., people with 
disabilities) and other educational issues (Ministry of Science and Technology, 2008). In 
the world, the criteria for evaluating research in general and research in the field of 
education, in particular, are clear. The clarity is reflected in the research works and the 
proposed evaluation criteria as well as the requirements of research projects. Some authors 
(Stiles, 1993; Wu, Thompson, Aroian, McQuaid, & Deatrick, 2016; Fossey, Harvey, 
McDermott, & Davidson, 2002; Anderson, 2010: McMillan & Wergin, 1998; Clissett, 
2008; Howe & Eisenhart, 1990; Malterud, 2001; Taylor, Beck, & Ainsworth, 2001; 
Cite this article as: Dinh Thi Kim Thoa, Tran Van Cong, Tran Thi Thu Anh (2020). Study on criteria to 
evaluate research projects in educational science in line with international standdards. Ho Chi Minh City 
University of Education Journal of Science, 17(5), 829-843. 
HCMUE Journal of Science Vol. 17, No. 5 (2020): 829-843 
830 
Horsburgh, 2003; Sukamolson, 2010) have proposed a system of criteria for evaluating 
research, which includes qualitative and quantitative studies. 
Regarding the current status of evaluating scientific research in Vietnam, Vu (2014) 
mentioned the irrationality in passing a project, along with the set of criteria to assess the 
results. Tran (2007) considers that the evaluation of the council is based on the following 
criteria: novelty in science, the authenticity of the results, the suitability of the 
methodology, and the applicability of the project. There are many unreasonable points, 
which are not suitable for scientific research. For example, a project may be considered 
low-quality by the council because it is contrary to the scientific perspective of the 
majority of its members although it has the prospect of opening a new research direction. It 
can be seen that, in reality, up to now, many unreasonable things still exist in evaluating 
research. Therefore, a number of authors have investigated and piloted some sets of criteria 
to evaluate research projects or products (Nguyen, 2008; Tran, 2013). 
In Vietnam, firstly, in research report forms, most requirements in the report are still 
formal, many parts are duplicated, while the core and essential components such as 
research questions, methods, reliability, validity of the research tools, discussion, data 
processing have not received enough attention. Secondly, the existing criteria were 
established based on a small sample size and applied for sciences or social sciences in 
general (but not specifically for educational sciences). The development of the criteria for 
each specific industry is still lacking (Tran, 2013). Moreover, there has been limited 
research projects on developing criteria for evaluating educational research projects in line 
with international standards. Therefore, this study aims to develop a set of criteria for 
assessing research projects in education in line with international standards, contributing to 
improving the quality of education research, supporting the management agencies during 
the evaluation process of educational projects, promoting the development of quantity and 
quality of international publications. 
2. Methodology 
 A mixed methods research was used in the current study, including a literature 
review, focus group interviews with experts, and a survey. An overview of the scientific 
research related to this topic was established. Based on the analysis of the interviews with 
the experts and focus group discussions, 11 core criteria and 45 specific criteria to evaluate 
the quality of master thesis in educational Science were proposed. 
2.1. Procedure 
By using surveys, we collect information from experts (lecturers, managers) about 
the necessity of the criteria set in evaluating master thesis in the field of educational 
sciences through a questionnaire with 0 = Unnecessary, 1 = Somewhat necessary, 2 = 
Necessary, and 3 = Completely necessary. 
HCMUE Journal of Science Dinh Thi Kim Thoa et al. 
831 
Developing and testing, and forming the evaluation criteria: (1) Literature review, (2) 
In-depth interview with two lecturers (1 person with more than 30 years of experience and 
another with over ten years of working experience), and (3) Focus group (six lecturers). All 
of the participants have postgraduate qualifications and have more than 15 years of 
working experience. 
We tested the criteria on 146 completed theses (from four majors of the VNU 
University of Education, Vietnam National University, Hanoi) which were selected 
randomly over the years. 
Test procedure 
Step 1: Build a checklist based on the criteria 
Step 2: Prepare the data (146 theses in VNU University of Education, Vietnam 
National University, Hanoi) 
Step 3: Contact two experts, send the experts the checklist, and 146 theses. The two 
experts evaluated them independently. 
Step 4: Collect the evaluation results from the two experts. 
Step 5: Enter data into SPSS 22.0 
Step 6: Analyze and report the results 
The checklist was constructed using the scale with three answering options: 0 = 
None, 1 = Present but not clear (there is a bit), 2 = Present and clearly expressed. 
2.2. Sample 
Collecting data: 150 lecturers of 5 Universities (Hanoi National University of 
Education; Thai Nguyen University of Education; Da Nang University of Education, Hue 
University of Education, Ho Chi Minh City University of Education). 
Collecting data (the second time) at the VNU University of Education, Vietnam 
National University, Hanoi: 35 lecturers who were teaching educational majors such as 
educational management; theory and teaching methods; children and adolescent clinical 
psychology, and measurement and evaluation in education. 
2.2. Developing the criteria for evaluating theses in the field of educational science 
 First, an overview of scientific research related to the research was built. Then the 
opinions of experts through semi-structured interviews were analyzed. We have proposed 
11 core criteria and 45 specific criteria to evaluate the quality of master thesis in the field 
of educational science (Table 1). 
HCMUE Journal of Science Vol. 17, No. 5 (2020): 829-843 
832 
Table 1. The development of the evaluation criteria 
 Criteria Source 
A1.Title 
A1.1 Reflect the main content (independent and dependent 
variables) of the study 
O’Brien et al. (2014) 
Sukamolson (2010) 
A1.2 Mention the participants and the study areas Qualitative research 
A2.Abstract 
A2.1 Accurately reflect the content of the study Qualitative research 
A2.2 The author addresses the problems they intentionally solve Qualitative research 
A2.3 The author briefly stated how to organize and research 
methods 
Wu (2016) 
O’Brien et al. (2014) 
A2.4 The author briefly stated the main results of the study 
A3. Introduction 
A3.1 Describe the reason (theoretical and practical basis): why it 
is selected as a research problem 
Nair et al. (2014) 
A3.2 The purpose of the study: they do this study for what? Qualitative research 
A3.3 The main content needs to be expressed in the form of a 
question to answer 
Qualitative research 
A4. Literature review 
A4.1 Overview of studies related to the content of the topic 
(independent and dependent variables) 
Qualitative research 
A4.2 Point out what has been done and research gaps (things that 
have not been done yet) in relevant studies 
Russell (2005) 
Qualitative research 
A4.3 Identify the main concepts of the study Russell (2005) 
Creswell (2002) A4.4 Identify the theoretical content related to the study 
A5. Research procedure 
A5.1 Describe steps in conducting the study Qualitative research 
Frankel and Devers 
(2000) 
O’Brien et al. (2014) 
A5.2 Describe the sampling procedure and the characteristics of 
the sample 
A6. Methodology 
A6.1 Methods of conducting research methods (approach to the 
research subjects, methods to collect data) 
Russell (2005) 
Qualitative research 
A6.2 Describe research tools (selection, development, adaptation, 
reliability, and validity) 
Nair et al., 2014 
A7. Data analysis and interpretation 
 For quantitative research 
A7.1 
Statistical analysis is consistent with research questions, 
hypotheses, variables, and measurement tools 
Frankel and Devers 
(2000) 
Russell (2005) 
HCMUE Journal of Science Dinh Thi Kim Thoa et al. 
833 
 Criteria Source 
A7.2 Analyze appropriate data to solve research problems Creswell (2002) 
A7.3 
The data is fully presented in tables and charts 
Qualitative research 
Russell (2005) 
A7.4 The results correctly answer the research question, and/or 
hypothesis 
Qualitative research 
 For qualitative research 
A7.5 
Practical and accurate results answer to the research 
questions 
Frankel and Devers 
(2000) 
O’Brien et al. (2014) 
A7.6 The data analysis steps are used to draw conclusions based 
on evidence 
Redfield (2004) 
A7.7 The results are presented in themes and categories so that 
multi-dimensional perspectives can be easily seen 
Redfield (2004) 
 For empirical research 
A7.8 The study clearly describes the experimental / intervention 
procedure (including (i) implementer/supervisor, recipient, 
and cost of implementation; (ii) what are the differences 
between the experiment and control group; and (iii) how the 
logic of the intervention might affect the outcome). 
Creswell (2002) 
Redfield (2004) 
A7.9 Experimental and control groups were randomly selected Redfield (2004) 
A7.10 There was a similarity in signs between the experimental 
group and the control group before the experiment 
Qualitative research 
A7.11 The instrument accurately measures the variables affected 
by the intervention 
Redfield (2004) 
A7.12 The stability of the number of participants in experimental 
research should be ensured 
Qualitative research 
A7.13 The study collected data on the long-term results of the 
intervention, showing that the impact of the intervention 
was sustained over time. 
Redfield (2004) 
A7.14 State the effective scope of intervention Qualitative research 
A8. Discussion 
A8.1 
The author compares the main results with the published 
data, in the most objective way possible 
Creswell (2002) 
Russell (2005) 
O’Brien et al. (2014) 
A8.2 The author discusses the limitations of the research and 
highlights what they have done 
Creswell (2002) 
Nair et al., 2014 
A8.3 Analyze the advantages and limitations of the current 
situation of the research problem, providing the foundation 
for the proposed solutions. 
Russell (2005) 
HCMUE Journal of Science Vol. 17, No. 5 (2020): 829-843 
834 
 Criteria Source 
A9. Conclusions and recommendations 
A9.1 The author repeated the research question and commented 
on the level to which it was solved. 
Creswell (2002) 
A9.2 The author makes recommendations to overcome such 
limitations or provides future research directions 
Nair et al., 2014 
A10. Some requirements for presenting research 
 For quantitative research 
A10.1 The structure of the research is generally consistent with the 
topics covered in a quantitative study 
Qualitative research 
A10.2 The terms social science and education are dependably 
defined 
Redfield (2004) 
A10.3 Variables are labeled (named) throughout the study Qualitative research 
A10.4 The research report uses extensive references Qualitative research 
A10.5 The report is presented in accordance with the target 
audience (readers) 
Qualitative research 
 For qualitative research 
A10.6 The report is scientifically written Qualitative research 
A10.7 The report is not written from an individual standpoint Qualitative research 
A10.8 The written report includes metaphors, unexpected details, 
details, complicated conversations 
Qualitative research 
A10.9 The report is made in a consistent and logical way between 
scientific hypotheses, questions, and research results. 
Qualitative research 
A11. About the presentation structure: 
0. Abstract (1 page) 1.11. New contributions to the study 
1. Introduction 1.12. The structure of the study 
1.1. Reason to choose a topic/issue 2. Theoretical framework 
1.2. Research objectives 2.1. Literature review 
1.3. Research questions 3. Organization and research methods 
1.4. Study hypotheses 3.1. Research organization (process, sampling) 
1.5. Study tasks 3.2. Research methodology (describe in detail) 
1.6. Methodology 4. Results 
1.7. Participants 5. Discuss (analyze) research results 
1.8. Research objects 6. Conclusions and recommendations 
1.9. Scope of the study References 
1.10. Research plan Appendix 
HCMUE Journal of Science Dinh Thi Kim Thoa et al. 
835 
3. Results 
3.1. The views on the necessity of the evaluation criteria for scientific research in 
educational science 
 In the focus group, the experts discussed the necessity and suitability of each 
criterion in the survey. The results showed that the expert ... t was not necessary. The 
criterion: need to ensure stability in the number of participants in the experimental study 
has a low level of agreement (64.5% disagreed). 
The data collected from 33 lecturers from the University of Education showed that 
the set of criteria has the Cronbach’s alpha of 0.659, indicating acceptable 
reliability. Typically, if Cronbach's Alpha coefficient ranges from 0.8 to 1.0, the 
measurement is considered to be good. However, according to some researchers, the 
Cronbach Alpha coefficient of 0.6 or higher can be used in tests (Peterson, 1994; Slater, 
1995). Combined with the high concurrence of the necessity of the criteria set through 140 
lecturers from 5 pedagogical universities and the agreement of 33 lecturers in charge of 
teaching subjects in 4 majors of the University of Education, it can be affirmed that the set 
of criteria is appropriate and has sufficient face reliability and criterion reliability so that 
the testing can be applied to the master thesis of the University of Education. 
3.2. Pilot and data analysis 
HCMUE Journal of Science Dinh Thi Kim Thoa et al. 
837 
Table 3. The percentage table is similar and correlated between two lecturers evaluating 
the structure of the thesis (146 master theses) 
Structure of the thesis 
Percentage of 
similarities 
Kappa correlation 
coefficient 
Abstract (1 page) 100% - 
1. Introduction 100% - 
1.1. Reason to choose a topic/issue 100% - 
1.2. Research objectives 99.3% 0.797 
1.3. Research questions 100% - 
1.4. Study hypotheses 100% - 
1.5. Study tasks 100% - 
1.6. Methodology 100% - 
1.7. Participants 100% - 
1.8. Research objects 100% - 
1.9. Scope of the study 98.6% 0.826 
1.10. Research plan 100% - 
1.11. New contributions to the study 97.3% 0.939 
1.12. The structure of the study 99.3% 0.797 
2. Theoretical framework 99.3% - 
2.1. Literature review 100% - 
3. Organization and research methods 95.2% 0.823 
3.1. Research organization (process, sampling method) 98.6% 0.969 
3.2. Research methodology (describe in detail) 100% - 
4. Results 100% - 
5. Discuss (analyze) research results 99.3% - 
6. Conclusions and recommendations 100% - 
References 100% - 
Appendix 100% - 
The results showed that the evaluations of the two lecturers on 23 items in the thesis 
are very similar, the percentage of agreement ranged from 95.2% to 100%. The Kappa 
correlation coefficients are all over 0.7, there are items that cannot produce results when 
running the correlation coefficients because the data have no variations or the margin is too 
small. It can be seen that the evaluation results of the two lecturers in the content of the 
theses are quite accurate. Kappa (K) is a coefficient used to evaluate the percentage of 
consensus between two people (two raters) when assessing the same content (problem) 
after eliminating the role of risk. According to Viera and Garrett (2005), the K> = 0.61 is 
similar from the good level upwards. Specifically, the K: 
HCMUE Journal of Science Vol. 17, No. 5 (2020): 829-843 
838 
Kappa Agreement 
<0 Poor 
0.01 - 0.20 Slight 
0.21 - 0.40 Fair 
0.41 - 0.6 Moderate 
0.61 - 0.80 Substantial 
0.81 - 0.99 Almost perfect 
 The results in Table 4 showed that the evaluation opinions of the two lecturers on 38 
criteria are very similar, the percentage of similarities ranged from 85.6% to 100%; Kappa 
correlation coefficients are over 0.7. It can be seen that when using the set of criteria in 
evaluating the thesis of educational science at the University of Education, the evaluation 
results of the two lecturers are quite similar. These results confirm the high reliability of 
the criteria set. 
Table 4. Percentage of similarities and correlation between the two lecturers' evaluations 
(146 theses) 
Criteria 
Percentage of 
similarities 
(%) 
Kappa 
correlation 
coefficient 
Title B2.1. Reflects the main content 
(independent and dependent variables) of 
the study 
85.6 - 
B2.2. Referring to the object and study 
area 
92.5 0.847 
Abstract (1 page) B2.3. Accurately reflect the content of the 
study 
100 - 
B2.4. The author briefly stated how to 
organize and research methods 
100 - 
B2.5. The author briefly stated the main 
results of the study 
100 - 
Introduction B2.6. Describe the reason (theoretical and 
practical basis) why it is selected as a 
research problem 
85.6 0.711 
B2.7. The purpose of the study is to 
answer the question: they do this study for 
what? 
93.8 0.762 
Literature review B2.8. Overview of studies related to the 
content of the topic (independent and 
dependent variables) 
89.7 0.826 
B2.9. Point out what has been done and 
research gaps (things that have not been 
done yet) in relevant studies 
89.0 0.828 
B2.10. Identify the main concepts of the 
study 
94.5 - 
HCMUE Journal of Science Dinh Thi Kim Thoa et al. 
839 
Criteria 
Percentage of 
similarities 
(%) 
Kappa 
correlation 
coefficient 
B2.11. Identify the theoretical content 
related to the study 
92.5 - 
Research 
organization 
B2.12. Describe the steps to conduct the 
study 
89.0 0.780 
B2.13. Describe the sampling procedure 
and describe the characteristics of the 
sample 
86.3 0.769 
Methodology B2.14. Methods of conducting research 
methods (approach to the research 
subjects, methods to collect data) 
87.7 0.757 
B2.15. Describe research tools (selection, 
development, adaptation, reliability and 
validity) 
98.6 0.958 
Data analysis in 
quantitative 
research 
B2.16. Consistent statistical analysis, 
consistent with research questions, 
hypotheses, variables, and measurement 
tools 
92.5 0.860 
B2.17. Analyze appropriate data to solve 
research problems 
94.5 0.898 
B2.18. The data is fully presented in 
tables and charts 
98.6 0.972 
Data analysis in 
qualitative 
research 
B2.19. The results correctly answer the 
research question, and / or hypothesis 
100 - 
B2.20. The results are presented in themes 
and categories so that multi-dimensional 
perspectives can be easily seen 
100 - 
Data analysis in 
empirical 
research 
B2.21. The study clearly describes the 
experimental / intervention procedure 
(including (i) implementer/supervisor, 
recipient, and cost of implementation; (ii) 
what is the difference between the 
experiment and control group; and (iii) 
how the logic of the intervention might 
affect the outcome). 
A7.9 Experimental and control groups 
were randomly selected 
93.2 0.871 
B2.22. Experimental and control groups 
were randomly selected 
100 - 
B2.23. There was a similarity in signs 
between the experimental group and the 
control group before the experiment 
100 - 
B2.24. The instrument accurately 
measures the variables affected by the 
100 - 
HCMUE Journal of Science Vol. 17, No. 5 (2020): 829-843 
840 
Criteria 
Percentage of 
similarities 
(%) 
Kappa 
correlation 
coefficient 
intervention 
B2.25. The stability of the number of 
participants in experimental research 
should be ensured 
100 - 
B2.26. The study collected data on the 
long-term results of the intervention, 
showing that the impact of the 
intervention was sustained over time. 
100 - 
B2.27. State the effective scope of 
intervention 
99.3 0.986 
Discussion B2.28. The author compared the main 
results with the published data, in the 
most objective way possible 
100 - 
B2.29. The author discusses the 
limitations of the research and highlights 
what they have done 
100 - 
Conclusion and 
recommendation 
B2.30. The author repeated the research 
question and commented on the level to 
which it was solved. 
89.7 0.773 
B2.31. The author makes 
recommendations to overcome such 
limitations or provide future research 
directions 
89.7 0.734 
Some 
requirements for 
the presentation 
of quantitative 
research 
B2.32. The structure of the research is 
generally consistent with the topics 
covered in a quantitative study 
94.5 0.870 
B2.33. The terms social science and 
education are defined grounded 
94.5 0.640 
B2.34. Variables are labeled (named) 
throughout the study 
97.9 - 
B2.35. The report is presented in 
accordance with the target audience 
(readers) 
100 - 
Some 
requirements for 
qualitative 
research 
presentation 
B2.36. The report is scientifically written 100 - 
B2.37. The report is not written from an 
individual standpoint 
100 - 
B2.38. The report is made in a consistent 
and logical manner between scientific 
hypotheses, questions, and research 
results. 
100 - 
HCMUE Journal of Science Dinh Thi Kim Thoa et al. 
841 
4. Recommendation and conclusion 
The results showed that the criteria set have high reliability. In addition, the criteria 
set can be used as a basis for instructors to guide students to conduct research, write reports 
(master thesis) more easily. The set of evaluation criteria should be made public for 
students from the start of their study, and this will help learners be more active in 
determining their study pathways, acquire knowledge, and have a good orientation in the 
writing process. The set of criteria can be replicated to evaluate dissertations and theses in 
the field of educational science. 
 Conflict of Interest: Authors have no conflict of interest to declare. 
 Acknowledgements: This research is funded by Vietnam National University, Hanoi 
(VNU) under project number QG.17.52. 
REFERENCES 
Anderson, C. (2010). Presenting and evaluating qualitative research. American journal of 
pharmaceutical education, 74(8), 141. 
Clissett, P. (2008). Evaluating qualitative research. Journal of Orthopaedic Nursing, 12(2), 99-105. 
Creswell, J. W. (2002). Educational research: Planning, conducting, and evaluating 
quantitative. New Jersey: Upper Saddle River. 
Fossey, E., Harvey, C., McDermott, F., & Davidson, L. (2002). Understanding and evaluating 
qualitative research. Australian and New Zealand journal of psychiatry, 36(6), 717-732. 
Frankel, R. M., & Devers, K. (2000). Qualitative research: A consumer's guide. Education for 
Health, 13(1), 113. 
Horsburgh, D. (2003). Evaluation of qualitative research. Journal of clinical nursing, 12(2), 
307-312. 
Howe, K., & Eisenhart, M. (1990). Standards for qualitative (and quantitative) research: A 
prolegomenon. Educational researcher, 19(4), 2-9. 
Malterud, K. (2001). Qualitative research: standards, challenges, and guidelines. The lancet, 
358(9280), 483-488. 
McMillan, J. H., & Wergin, J. F. (1998). Understanding and Evaluating Educational Research. 
Prentice-Hall, Inc., One Lake Street, Upper Saddle River, NJ 07458. 
Ministry of Science and Technology (2008). Decision on promulgating a number of scientific and 
technological statistical classification tables, No. 12/2008 / QD-BKHCN. 
Minister of Science and Technology (2004). Circular No. 11/2014/TT-BKHCN. 
HCMUE Journal of Science Vol. 17, No. 5 (2020): 829-843 
842 
Nair, P. R., & Nair, V. D. (2014). Organization of a Research Paper: The IMRAD Format. 
In Scientific Writing and Communication in Agriculture and Natural Resources (pp. 13-25). 
Springer, Cham. 
Nguyen, Q. V. (2008). Building evaluation criteria for scientific research to perform the function 
of scientific research at Hai Duong Vocational College, Master thesis in Business and 
Management, University of Social Sciences and Humanities. 
Nunnally, J. C., & Bernstein, I. H. (1994). Validity. Psychometric theory, 3, 99-132. 
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for 
reporting qualitative research: a synthesis of recommendations. Academic Medicine, 89(9), 
1245-1251. 
Peterson, R. A. (1994). A meta-analysis of Cronbach's coefficient alpha. Journal of consumer 
research, 21(2), 381-391. 
Redfield, D. (2004). A closer look at scientifically based research: How to evaluate educational 
research. THE Journal, 31, 24-25. 
Russell, C. L. (2005). Evaluating quantitative research reports. Nephrology Nursing Journal, 32(1), 
61-64. 
Slater, S. F. (1995). Issues in conducting marketing strategy research. Journal of strategic 
Marketing, 3(4), 257-270. 
Stiles, W. B. (1993). Quality control in qualitative research. Clinical psychology review, 13(6), 
593-618. 
Sukamolson, S. (2010). Fundamentals of quantitative research. Language Institute, Chulalongkorn 
University. 
Taylor, E. W., Beck, J., & Ainsworth, E. (2001). Publishing qualitative adult education research: A 
peer review perspective. Studies in the Education of Adults, 33(2), 163-179. 
Tran, H. T. (2013). Building a system of criteria to evaluate the results of scientific research in 
social sciences at the University of Science, Thai Nguyen University, Master's thesis in 
Business and Management. University of Social Sciences and Humanities 
Tran, M. T. (2007). Scientific research activities of lecturers in universities and methods of 
assessment and acceptance of the topic, Van Lang University - Journal of Science and 
Training, (6), 54-59. 
Viera, A. J., & Garrett, J. M. (2005). Understanding interobserver agreement: the kappa 
statistic. Fam med, 37(5), 360-363. 
Vu, D. C. (2014). Scientific research methodology, Science and Technology Publishing House. 
Wu, Y. P., Thompson, D., Aroian, K. J., McQuaid, E. L., & Deatrick, J. A. (2016). Commentary: 
Writing and evaluating qualitative research reports. Journal of pediatric psychology, 41(5), 
493-505. 
HCMUE Journal of Science Dinh Thi Kim Thoa et al. 
843 
CƠ SỞ KHOA HỌC CỦA BỘ TIÊU CHÍ ĐÁNH GIÁ CÔNG TRÌNH 
NGHIÊN CỨU KHOA HỌC GIÁO DỤC THEO CHUẨN QUỐC TẾ 
Đinh Thị Kim Thoa1*, Trần Văn Công1, Trần Thị Thu Anh2 
1 Trường Đại học Giáo dục, Đại học Quốc gia Hà Nội, Việt Nam 
2 Trung tâm Đảm bảo chất lượng, Trường Đại học Công nghiệp Dệt may Hà Nội, Việt Nam 
*
Tác giả liên hệ: Đinh Thị Kim Thoa – Email: thoadtk@vnu.edu.vn 
Ngày nhận bài: 10-3-2020; ngày nhận bài sửa: 05-4-2020; ngày duyệt đăng: 27-5-2020 
TÓM TẮT 
Nghiên cứu tập trung trình bày cơ sở khoa học của hệ thống tiêu chí đánh giá các công trình 
nghiên cứu khoa học giáo dục theo chuẩn quốc tế. Chúng tôi sử dụng kết hợp nghiên cứu lí luận 
với phỏng vấn, thảo luận nhóm chuyên gia, khảo sát 140 giảng viên của 5 trường đại học sư phạm 
tại Việt Nam và 33 giảng viên phụ trách giảng dạy các bộ môn thuộc 4 chuyên ngành của Trường 
Đại học Giáo dục. Mức độ cần thiết, sự phù hợp, độ tin cậy của bộ tiêu chí trong việc đánh giá 
luận văn thuộc lĩnh vực khoa học giáo dục đã được kiểm tra. Hai chuyên gia tích kiểm độc lập 146 
luận văn dựa vào bộ tiêu chí, kết quả cho thấy ý kiến đánh giá của 2 chuyên gia đối với 38 tiêu chí 
đánh giá rất tương đồng với nhau, tỉ lệ trùng khớp nhau từ 85,6% đến 100%. Hệ số tương quan 
Kappa đều trên 0,7. Bộ tiêu chí có độ tin cậy cao trong đánh giá chất lượng công trình khoa học. 
Từ khóa: tiêu chí; chuẩn quốc tế; khoa học giáo dục; đánh giá; cơ sở khoa học 

File đính kèm:

  • pdfstudy_on_criteria_to_evaluate_research_projects_in_education.pdf