我们的网站为什么显示成这样？

可能因为您的浏览器不支持样式，您可以更新您的浏览器到最新版本，以获取对此功能的支持，访问下面的网站，获取关于浏览器的信息：

|本期目录/Table of Contents|

 量表数据中不努力作答的识别和清理(PDF)

《心理学探新》[ISSN:1003-5184/CN:36-1228/B]

期数:
 2023年06期
页码:
 558-566
栏目:
 心理统计与测量
出版日期:
 2023-12-20

文章信息/Info

Title:
 How to Detect and Clean Insufficient-effort Responding in Scale Data
文章编号:
1003-5184(2023)06-0558-09
作者:
 王 丹 刘红云
 (北京师范大学心理学部,应用实验心理北京市重点实验室,心理学国家级实验教学示范中心[北京师范大学],北京 100875)
Author(s):
 Wang Dan; Liu Hongyun
 (Beijing Key Laboratory of Applied Experimental Psychology,National Demonstration Center for Experimental Psychology Education [Beijing Normal University],Faculty of Psychology,Beijing Normal University,Beijing 100875)
关键词:
 不努力作答;  量表数据;  不努力作答模式;  数据清理
Keywords:
 insufficient-effort responding;  scale data;  careless responding;  data chean
分类号:
 B841.2
DOI:
 -
文献标识码:
 A
摘要:
 在对不努力作答(IER)概念和方法综述的基础上,通过一个心理量表的真实测试数据,介绍了如何综合采用不同的方法甄别IER。主要包括:(1)探索不同指标对不努力作答模式的敏感性,探讨了应用多种指标的必要性以及如何选取的问题;(2)分析IER对测验工具指标计算结果的消极影响;(3)总结不努力作答数据清洗方法及注意事项,为提升量表数据质量提供了数据清理方面的建议。
Abstract:
 The current study summarized the methods of insufficient-effort responding(IER)and focused on how to apply these methods to flag IER data in practical research.Taking the data of Humor Styles Questionnaire as an example,two ways of calculating the cutoff of each method are introduced.In the first study,five IER patterns were defined.Comparing the difference between the flag data and Unflag data identified by 7 IER indicator in five patterns,we explored the applicability of each indicators for different IER patterns.In Study 2,we demonstrated the three steps of flagging IER data,and then the negative effects of IER data were investigated by calculating changes in coefficient alpha,correlation coefficients between scales,and confirmatory factor analysis model-data fit.In discussion,we summarized the advantages and shortcomings of every method and gave advices about choosing and using these methods.In conclusion,insufficient-effort responding is prevalent and it can obscure the calculated result of psychometrical indicators.So,it is necessary to identify and clean IER data.This study could help researchers realize the importance of removing IER data and get to know how to identify the IER data in their surveys,mainly including how to calculate the cutoff,and how to choose and apply IER indices.

参考文献/References

 詹雨臻,陈学志,卓淑玲,Martin.(2011).区分良善与有害的幽默─ 正体中文版 [幽默风格量表] 的发展.测验学刊,58,207-234.
ACT.(2016).Development and validation of ACT Engage:Technical manual.Retrieved from https://www.act.org/content/dam/act/unsecured/documents/act-engage-technicalmanual.pdf
Anseel,F.,Lievens,F.,Schollaert,E.,& Choragwicka,B.(2010).Response rates in organizational science,1995-2008:A meta analytic review and guidelines for survey researchers.Journal of Business and Psychology,25,335-349.
Berry,D.T.R.,Wetter,M.W.,Baer,R.A.,Larsen,L.,Clark,C.,& Monroe,K.(1992).MMP 2 random responding indices:Validation using a self-report methodology.Psychological Assessment,4,340-345.
Chalmers,R.P.(2012).Mirt:A multidimensional item response theory package for the R environment.Journal of Statistical Software,48(6),1-29.
Christian,L.M.,Dillman,D.A.,& Smyth,J.D.(2008).The effects of mode and format on answers to scalar questions in telephone and web surveys.Advances in Telephone Survey Methodology,250-275.
Clark,M.E.,Gironda,R.J.,& Young,R.W.(2003).Detection of back random responding:Effectiveness of MMPI-2 and personality assessment inventory validity indices.Psychological Assessment,15,223-234.
Crede,M.(2010).Random responding as a threat to the validity of effect size estimates in correlational research.Educational and Psychological Measurement,70,596-612.
Curran,P.G.(2016).Methods for the detection of carelessly invalid responses in survey data.Journal of Experimental Social Psychology,66,4-19.
Drasgow,F.,Levine,M.V.,& Williams,E.A.(1985).Appropriateness measurement with polychotomous item response models and standardized indices.British Journal of Mathematical and Statistical Psychology,38(1),67-86.
Dunn,A.M.,Heggestad,E.D.,Shanock,L.R.,& Theilgard,N.(2018).Intra-individual response variability as an indicator of insufficient effort responding:Comparison to other indicators and relationships with individual differences.Journal of Business and Psychology,33(1),105-121.
Goldberg,L.R.,& Kilkowski,J.M.(1985).The prediction of semantic consistency in self-descriptions:characteristics of persons and of terms that affect the consistency of responses to synonym and antonym pairs.Journal of Personality and Social Psychology,48,82-98.
Herman,J.,& Hilton,M.(2017).Supporting students' college success:The role of assessment of interpersonal and interpersonal competencies.Washington,DC:National Academies Press.Retrieved from http://www.nap.edu/24697
Hong,M.,Steedle,J.T.,& Cheng,Y.(2020).Methods of detecting insufficient effort responding:Comparisons and practical recommendations.Educational and Psychological Measurement,80(2),312-345.
Huang,J.L.,Curran,P.G.,Keeney,J.,Poposki,E.M.,& DeShon,R.P.(2012).Detecting and deterring insufficient effort responding to surveys.Journal of Business and Psychology,27(1),99-114.
Huang,J.L.,Liu,M.,& Bowling,N.A.(2015).Insufficient effort responding:Examining an insidious confound in survey data.Journal of Applied Psychology,100(3),828-845.
Jackson,D.N.(1976).The appraisal of personal reliability.Paper presented at the meetings of the Society of Multivariate Experimental Psychology,University Park,PA.
Johnson,J.A.(2005).Ascertaining the validity of individual protocols from web-based personality inventories.Journal of Research in Personality,39,103-129.
Maniaci,M.R.,& Rogge,R.D.(2014).Caring about carelessness:Participant inattention and its effects on research.Journal of Research in Personality,48(1),61-83.
Martin,R.A.,Puhlik-Doris,P.,Larsen,G.,Gray,J.,& Weir,K.(2003).Individual differences in uses of humor and their relation to psychological well-being:Development of the humor styles questionnaire.Journal of Research in Personality,37,48-75.
McGonagle,A.K.,Huang,J.L.,& Walsh,B.M.(2015).Insufficient effort survey responding:An under-appreciated problem in work and organisational health psychology research.Applied Psychology,65,287-321.doi:10.1111/apps.12058.
Meade,A.W.,& Craig,S.B.(2012).Identifying careless responses in survey data.Psychological Methods,17(3),437-455.https://doi.org/10.1037/a0028085
Merritt,S.M.(2012).The two-factor solution to Allen and Meyer's(1990)affective commitment scale:Effects of negatively worded items.Journal of Business and Psychology,27,421-436.
Pauszek,J.R.,Sztybel,P.,& Gibson,B.S.(2017).Evaluating Amazon's Mechanical Turk for psychological research on the symbolic control of attention.Behavior Research Methods,49,1969-1983.
Steedle,J.T.,Hong,M.R.,& Cheng,Y.(2019).The effects of inattentive responding on construct validity evidence when measuring social-emotional learning competencies.Educational Measurement:Issues and Practice,38,101-111.
Tendeiro,J.N.,Meijer,R.R.,& Niessen,A.S.M.(2016).PerFit:An R package for person-fit analysis in IRT.Journal of Statistical Software,74(5),1-27.
Weiner,S.P.,& Dalessio,A.T.(2006).Over surveying:Causes,consequences,and cures.Getting Action From Organizational Surveys:New Concepts,Methods,and Applications,294-311.
Woods,C.M.(2006).Careless responding to reverse-worded items:Implications for confirmatory factor analysis.Journal of Psychopathology and Behavioral Assessment,28,186-191.
Yentes,R.,& Wilhelm,F.(2023).Careless:Procedures for computing indices of careless responding.R package version 1.2.2.https://cran.r-project.org/web/packages/careless/index.html

备注/Memo

备注/Memo:
 基金项目:国家自然科学基金项目(32071091)。
通讯作者:刘红云,E-mail:hyliu@bnu.edu.cn。
更新日期/Last Update:  2023-12-20