China Social Science Review

No.1, 2024

Reflections on the Participation of Generative AI in Academic Evaluation

(Abstract)

Ye Jiyuan and Guo Weibing

Generative AI should be used with caution in academic research and evaluation. It should be viewed as a potential auxiliary tool, rather than a substitute for the independent thinking and judgment of researchers or peer reviewers. Generative AI can effectively improve the efficiency of academic evaluation, but it should not replace human evaluation. It can be used as an effective auxiliary tool, but it must be dominated by human expert evaluation. Generative AI promotes the modernization of academic evaluation, but the essence of evaluation is human activity. We should uphold a positive “pessimistic” and cautious “optimistic” attitude, maintain strong vigilance to the possible phenomenon of technological “alienation,” continue to pay attention to the coupling relationship between technology progress of AI and academic evaluation system, explore new evaluation models of human-computer interaction, empathy and collaboration, and pay attention to academic “all-round evaluation.”