我们的网站为什么显示成这样？

可能因为您的浏览器不支持样式，您可以更新您的浏览器到最新版本，以获取对此功能的支持，访问下面的网站，获取关于浏览器的信息：

|本期目录/Table of Contents|

 中英心理学期刊数据删除及删除标准的元研究(PDF)

《心理学探新》[ISSN:1003-5184/CN:36-1228/B]

期数:
 2024年04期
页码:
 374-384
栏目:
 
出版日期:
 2024-09-30

文章信息/Info

Title:
 A Meta-research on Data Exclusion and Exclusion Criteria in Domestic and International Psychology Journals
文章编号:
1003-5184(2024)04-0374-11
作者:
 谢宜骏 杨忠静 吴 燕
 (杭州师范大学经亨颐教育学院心理学系,杭州 311121)
Author(s):
 Xie Yijun Yang Zhongjing Wu Yan
 (Department of Psychology,Jinghengyi College of Education,Hangzhou Normal University,Hangzhou 311121)
关键词:
 数据删除;  元研究;  有问题的研究操作;  数据删除标准
Keywords:
 data exclusion;  meta-research;  questionable research practices;  data exclusion criteria
分类号:
 B841.2
DOI:
 -
文献标识码:
 A
摘要:
 数据删除在心理学研究中存在较大的操作空间,研究者借此获取显著统计结果的操作极大地威胁了科研结果的真实性和可重复性。研究以2000、2010、2020三个年度发表在《心理学报》和Psychological Science期刊上的实证研究为分析对象,结合量化和质性分析方法,揭示中英心理学期刊数据删除现状。结果显示,中英期刊存在数据删除的研究各占比为48.83%和35.56%,平均被试删除比例分别为16.31%和14.48%,在删除数据后未按相关标准进行报告的比例分别为11.48%和5.46%; 在被试数据删除和观测值数据删除中,报告率最高的删除标准分别为基于极端值的删除(57.87%)和基于任务的删除(30.6%); 研究报告的次级删除标准体现了一定的随意性。这些结果表明了建立更为严谨的标准化数据删除报告规范的必要性。
Abstract:
 Data exclusion practices in psychological research provide researchers with considerable flexibility,which poses a significant threat to the validity and reproducibility of scientific findings.We conducted a quantitative and qualitative analysis based on 688 research articles published in the years 2000,2010,and 2020 in the domestic journal Acta Psychological Sinica(APS)and the international journal Psychological Science(PS)for a better understanding of the research practices of data exclusion.The results showed that the proportion of studies employing data exclusion in APS and PS was 48.83% and 35.56% respectively.The average rates of participants exclusion were 16.31% and 14.48% for APS and PS,with 11.48% and 5.46% of studies failing to report exclusion criteria.The most frequently reported exclusion criteria were based on task(30.6%)and based on extreme values(57.87%).Flexibility existed in the setting of secondary exclusion criteria.These findings highlight the necessity of establishing more rigorous standardized reporting guidelines.

参考文献/References

 任志洪,赵子仪,余香莲,赵春晓,张琳,林羽中,张微.(2020).睾酮素与反社会倾向未成年犯的攻击行为:敌意注意偏向的中介和皮质醇的调节作用.心理学报,52(11),1288-1300.
唐晓雨,吴英楠,彭姓,王爱君,李奇.(2020).内源性空间线索有效性对视听觉整合的影响.心理学报,52(7),835-846.
王珺,宋琼雅,许岳培,贾彬彬,陆春雷,陈曦,等.(2021).解读不显著结果:基于500个实证研究的量化分析.心理科学进展,29(3),381-393.
臧雷振,潘晨雨.(2020).社会科学研究透明度:内涵、价值及其实现路径.国外理论动态,(5),82-92.
周爱保,谢珮,潘超超,田喆,谢君伟,刘炯.(2020).寻找丢失的自我:精神分裂症患者的自我面孔识别.心理学报,52(2),184-196.
Agnoli,F.,Wicherts,J.M.,Veldkamp,C.L.S.,Albiero,P.,& Cubelli,R.(2017).Questionable research practices among Italian research psychologists.PLOS ONE,12(3),e0172792.
American Psychological Association(Ed.).(2020).Publication manual of the American Psychological Association(7th ed.).American Psychological Association.
Andre,Q.(2022).Outlier exclusion procedures must be blind to the researcher’s hypothesis.Journal of Experimental Psychology:General,151(1),213-223.
Bakker,M.,& Wicherts,J.M.(2014).Outlier removal,sum scores,and the inflation of the Type I error rate in independent samples t tests:The power of alternatives and recommendations.Psychological Methods,19(3),409-427.
Barnett,V.,& Lewis,T.(1994).Outliers in statistical data(3rd ed.).Wiley.
Begg,C.(1996).Improving the quality of reporting of randomized controlled trials.The CONSORT statement.The Journal of the American Medical Association,276(8),637-639.
Berger,A.,& Kiefer,M.(2021).Comparison of different response time outlier exclusion methods:A simulation study.Frontiers in Psychology,12,675558.
Chambers,C.D.,& Tzavella,L.(2021).The past,present and future of registered reports.Nature Human Behaviour,6(1),29-42.
Gibbert,M.,Nair,L.B.,Weiss,M.,& Hoegl,M.(2021).Using outliers for theory building.Organizational Research Methods,24(1),172-181.
Head,M.L.,Holman,L.,Lanfear,R.,Kahn,A.T.,& Jennions,M.D.(2015).The extent and consequences of p-hacking in science.PLOS Biology,13(3),e1002106.
Heijden,J.(2021).Why meta-research matters to regulation and governance scholarship:An illustrative evidence synthesis of responsive regulation research.Regulation & Governance,15(S1),S123-S142.
Ioannidis,J.P.A.,Fanelli,D.,Dunne,D.D.,& Goodman,S.N.(2015).Meta-research:Evaluation and improvement of research methods and practices.PLOS Biology,13(10),e1002264.
John,L.K.,Loewenstein,G.,& Prelec,D.(2012).Measuring the prevalence of questionable research practices with incentives for truth telling.Psychological Science,23(5),524-532.
LeBel,E.P.,Borsboom,D.,Giner-Sorolla,R.,Hasselman,F.,Peters,K.R.,Ratliff,K.A.,& Smith,C.T.(2013).PsychDisclosure.org:Grassroots support for reforming reporting standards in psychology.Perspectives on Psychological Science,8(4),424-432.
Lyu,X.-K.,Xu,Y.,Zhao,X.-F.,Zuo,X.-N.,& Hu,C.-P.(2020).Beyond psychology:Prevalence of p value and confidence interval misinterpretation across different fields.Journal of Pacific Rim Psychology,14,e6.
Martinson,B.C.,Anderson,M.S.,& de Vries,R.(2005).Scientists behaving badly.Nature,435(7043),737-738.
Massara,P.,Asrar,A.,Bourdon,C.,Ngari,M.,Keown-Stoneman,C.D.G.,Maguire,J.L.,… Comelli,E.M.(2023).New approaches and technical considerations in detecting outlier measurements and trajectories in longitudinal children growth data.BMC Medical Research Methodology,23(1),232.
Moher,D.,Hopewell,S.,Schulz,K.F.,Montori,V.,Gotzsche,P.C.,Devereaux,P.J.,… Altman,D.G.(2010).CONSORT 2010 explanation and elaboration:Updated guidelines for reporting parallel group randomised trials.British Medical Journal,340,c869.
Ng,A.W.Y.,& Chan,A.H.S.(2012,March).Finger response times to visual,auditory and tactile modality stimuli.In International MultiConference of Engineers and Computer Scientists(Vol.2,pp.1449-1454).IMECS.
Page,M.J.,McKenzie,J.E.,Bossuyt,P.M.,Boutron,I.,Hoffmann,T.C.,Mulrow,C.D.,… Moher,D.(2021).The PRISMA 2020 statement:An updated guideline for reporting systematic reviews.BMJ(Clinical Research Ed.),372,n71.
Rabelo,A.L.A.,Farias,J.E.M.,Sarmet,M.M.,Joaquim,T.C.R.,Hoersting,R.C.,Victorino,L.,… Pilati,R.(2020).Questionable research practices among Brazilian psychological researchers:Results from a replication study and an international comparison.International Journal of Psychology,55(4),674-683.
Simmons,J.P.,Nelson,L.D.,& Simonsohn,U.(2011).False-positive psychology:Undisclosed flexibility in data collection and analysis allows presenting anything as significant.Psychological Science,22(11),1359-1366.
Strauss,A.L.(1987).Qualitative analysis for social scientists(1st ed.).Cambridge University Press.
Verhagen,A.,Stubbs,P.W.,Mehta,P.,Kennedy,D.,Nasser,A.M.,Quel de Oliveira,C.,… McCambridge,A.B.(2022).Comparison between 2000 and 2018 on the reporting of statistical significance and clinical relevance in physiotherapy clinical trials in six major physiotherapy journals:A meta-research design.BMJ Open,12(1),e054875.
Wang,H.,Bah,M.J.,& Hammad,M.(2019).Progress in outlier detection techniques:A survey.IEEE Access,7,107964-108000.

备注/Memo

备注/Memo:
 通信作者:吴燕,E-mail:lewuyan@126.com。
更新日期/Last Update:  2024-09-30