ISSN 0253-2778

CN 34-1054/N

Open AccessOpen Access JUSTC

Reliability analysis of group experts and testing of evaluation outcomes

Cite this:
https://doi.org/10.3969/j.issn.0253-2778.2016.02.010
  • Received Date: 10 September 2014
  • Rev Recd Date: 08 June 2015
  • Publish Date: 28 February 2016
  • Information structural bias and cognitive structural bias and other issues lead to randomness and inconsistency of expert evaluations, calling into question the reliability of evaluation outcomes of expert groups. To solve this problem, psychological statistics reliability was used to measure expert reliability for individual experts and expert groups; then, two-factor fixed effects model was used to further analyze and test the sources of error. This can simultaneously analyze and evaluate the fairness and reasonableness of evaluation outcome and the reliability of experts. Finally, an empirical analysis was carried out with a tender evaluation case.
    Information structural bias and cognitive structural bias and other issues lead to randomness and inconsistency of expert evaluations, calling into question the reliability of evaluation outcomes of expert groups. To solve this problem, psychological statistics reliability was used to measure expert reliability for individual experts and expert groups; then, two-factor fixed effects model was used to further analyze and test the sources of error. This can simultaneously analyze and evaluate the fairness and reasonableness of evaluation outcome and the reliability of experts. Finally, an empirical analysis was carried out with a tender evaluation case.
  • loading
  • 加载中

Catalog

    Article Metrics

    Article views (164) PDF downloads(103)
    Proportional views

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return