Taking the open education scholarship as the research object, this paper starts from the scholarship evaluation method. Taking the National Open University scholarship as an example, the problem of scholarship evaluation is transformed into a multi-objective decision-making problem, and 16 schemes are given. By establishing the hierarchy model, Delphi method is used to provide the quantitative basis for constructing the comparison matrix, then Yaahp is used to calculate the weight vector and the combination weight vector, and the consistency is checked. The weight of each factor is obtained from the weight vector, the weight is compared and the priority of 16 schemes is given. After analysis and discussion, it is concluded that the above process is reasonable, effective, simple and practical.