我们的网站为什么显示成这样？

可能因为您的浏览器不支持样式，您可以更新您的浏览器到最新版本，以获取对此功能的支持，访问下面的网站，获取关于浏览器的信息：

|本期目录/Table of Contents|

 使用Bootstrap方法计算认知诊断评估中的信度(PDF)

《心理学探新》[ISSN:1003-5184/CN:36-1228/B]

期数:
 2018年05期
页码:
 433-439
栏目:
 心理统计与测量
出版日期:
 2018-09-30

文章信息/Info

Title:
 Using Bootstrap to Calculate Reliability in Cognitive Diagnostic Assessment
作者:
 郭 磊1; 2; 3; 4; 张金明5
 1.西南大学心理学部,重庆 400715; 2.西南大学统计学博士后科研流动站,重庆 400715; 3.中国基础教育质量监测协同创新中心西南大学分中心,重庆 400715; 4.重庆市脑科学协同创新中心,重庆 400715; 5.伊利诺伊大学香槟分校教育心理学系,香槟,伊利诺伊州 61820 美国
Author(s):
 Guo Lei1; 2; 3; 4; Zhang Jinming5
 1.Faculty of Psychology,Southwest University,Chongqing 400715; 2.Postdoctoral Research Center for Statistics,Southwest University,Chongqing 400715; 3.Southwest University Branch,Collaborative Innovation Center of Assessment toward Basic Education Quality,Chongqing 400715; 4.Chongqing Collaborative Innovation Center For Brain Science,Chongqing 400715; 5.Department of Educational Psychology,University of Illinois at Urbana-Champagn,Champaign,IL,61820 USA
关键词:
 认知诊断评估;  Bootstrap;  信度
Keywords:
 cognitive diagnostic assessment;  Bootstrap;  reliability
分类号:
 B841.2
DOI:
 -
文献标识码:
 A
摘要:
 测验信度是衡量测验质量的一个重要指标,认知诊断评估中同样需要重视信度问题。现有认知诊断中计算信度的方法均有一个前提假设:被试在前后两次测验的后验概率分布和边际概率完全相同。该假设过强,未考虑两次测验间存在的随机误差。基于Bootstrap抽样,提出了两类属性信度和模式信度的指标,分别是积差相关法和修正的一致性法。通过模拟研究比较了新方法和现有方法在不同属性个数、属性间相关性和题目数量下的表现,并基于英语能力认证考试ECPE和分数减法的实证数据验证了新方法的可行性。最后,对信度估计的影响因素进行了讨论。
Abstract:
 The reliability of cognitive diagnostic assessments(CDAs)is of great importance to any cognitive diagnostic model applications.The current study proposes two attribute-level and two pattern-level reliability indices based on Bootstrap method.Simulation study is conducted to evaluate the performance of the new indices compared to existing methods under three different factors.The results indicate that:(1)overall,the estimation results of attribute-level reliability are more stable than those of pattern-level reliability when comparing the two new types of indices;(2)for attribute-level reliability,the performance of the ARC index is the best; and(3)for pattern-level reliability,the results of PRC,PRM and Wang's method are comparable.Two real data sets were also used to compare the performance of all the indices.Finally,the authors discuss several factors that may influence the degree of reliability of CDAs,and indicate some research interests for the future.

参考文献/References

 郭磊,郑蝉金,边玉芳.(2015).变长CD-CAT中的曝光控制与终止规则.心理学报,47(1),129-140.
江程铭,李纾.(2015).中介分析和自举(Bootstrap)程序应用.心理学探新,35(5),458-463.
涂冬波,蔡艳,丁树良.(2012).认知诊断理论、方法与应用.北京:北京师范大学出版社.
温忠麟,叶宝娟.(2011).从α系数到内部一致性信度.心理学报,43(7),821-829.
詹沛达,陈平,边玉芳.(2016).使用验证性补偿多维IRT模型进行认知诊断评估.心理学报,48(10),1347-1356.
Cui,Y.,Gierl,M.J.,& Chang,H.H.(2012).Estimating classification consistency and accuracy for cognitive diagnostic assessment.Journal of Educational Measurement,49,19-38.
Culpepper,S.A.(2015).Bayesian estimation of the DINA model with Gibbs Sampling.Journal of Educational and Behavioral Statistics,40(5),454-476.
DeCarlo,L.T.(2012).Recognizing Uncertainty in the Q-Matrix via a Bayesian Extension of the DINA Model.Applied Psychological Measurement,36(6),447-468.
dela,T.(2009).DINA model and parameter estimation:A didactic.Journal of Educational and Behavioral Statistics,34(1),115-130.
Huebner,A.,& Wang,C.(2011).A note on comparing examinee classification methods for cognitive diagnosis models.Educational and Psychological Measurement,71,407-419.
Junker,B.W.,& Sijtsma,K.(2001).Cognitive assessment models with few assumptions,and connections with nonparametric item response theory.Applied Psychological Measurement,25,258-272.
Rupp,A.A.,Templin,J.L.,& Henson,R.A.(2010).Diagnostic measurement:Theory,methods,and applications.Guilford Press.
Templin,J.,& Bradshaw,L.(2013).Measuring the reliability of diagnostic classification model examinee estimates.Journal of Classification,30(2),251-275.
Wang,W.Y.,Song,L.H.,Chen,P.,Meng,Y.R.,& Ding,S.L.(2015).Attribute-level and pattern-level classification consistency and accuracy indices for cognitive diagnostic assessment.Journal of Educational Measurement,52(4),457-476.

备注/Memo

备注/Memo:
 基金项目:教育部人文社会科学研究青年基金项目(15YJC190003),2017年重庆市社会科学规划项目(2017PY20),中央高校基本科研业务费专项资金(SWU1809106)。
通讯作者:郭磊,E-mail:happygl1229@swu.edu.cn。
更新日期/Last Update:  2018-09-30