Reliability analysis of group experts and testing of evaluation outcomes

Information structural bias and cognitive structural bias and other issues lead to randomness and inconsistency of expert evaluations, calling into question the reliability of evaluation outcomes of expert groups. To solve this problem, psychological statistics reliability was used to measure expert reliability for individual experts and expert groups; then, two-factor fixed effects model was used to further analyze and test the sources of error. This can simultaneously analyze and evaluate the fairness and reasonableness of evaluation outcome and the reliability of experts. Finally, an empirical analysis was carried out with a tender evaluation case.