Jessica Schleider, PhD, on Open Science and Replicability Practices and Diversity, Equity, and Inclusion in Academia
Release Date: 08/14/2020
Research Matters Podcast
Dr. Jacqueline (Jackie) Persons is a distinguished clinician, researcher, and Clinical Professor at the University of California, Berkeley. She served as president of the Association of Cognitive and Behavioral Therapies (ABCT) in 1999 and currently works in private practice at the Oakland Cognitive Behavior Therapy Center. With over 35 years of experience, Dr. Persons is recognized globally for her pioneering work in integrating research into private practice, particularly in the areas of case formulation and measurement-based care. In this insightful conversation, we dive into Dr....
info_outlineResearch Matters Podcast
Dr. Patricia Arean is is the Director of the Division of Services and Intervention Research at the National Institute of Mental Health (NIMH), as well as a clinical researcher and former professor at the University of Washington’s Department of Psychiatry and Behavioral Sciences. With over 30 years of experience, Dr. Arean has focused her career on increasing access to mental health services for underserved communities. She has led multiple research initiatives, including the UW Alacrity Center, which aims to redesign psychosocial interventions for underserved populations, and the Creative...
info_outlineResearch Matters Podcast
Tony Biglan, Ph.D., is a Senior Scientist at Oregon Research Institute and Co-Director of the Promise Neighborhood Research Consortium. For the past thirty years, he has conducted research in the development and prevention of child and adolescent problem behavior. He is a former president of the Society for Prevention Research and was a member of the Institute of Medicine Committee on Prevention.
info_outlineResearch Matters Podcast
Dean McKay, Ph.D., A.B.B.P. is Professor of Psychology at Fordham University where he is a member of the clinical psychology doctoral program. His lab, Compulsive, Obsessive, and Anxiety Program (COAP) provides instruction to undergraduate, masters, and doctorate levels. Dr. McKay’s expertise is in anxiety and obsessive-compulsive behavior, with his current focus being on Covid-19 related stress and anxiety.
info_outlineResearch Matters Podcast
Dr. Hayes is a Nevada Foundation Professor of Psychology in the Behavior Analysis Program at the University of Nevada, Reno. An author of 46 books and nearly 650 scientific articles, he is especially known for his work on Acceptance and Commitment Therapy, which is one of the most widely used and researched new methods of psychological intervention in the last 20 years.
info_outlineResearch Matters Podcast
Jessica Borelli, Ph.D., is an Associate Professor of Psychological Science at the University of California, Irvine. She is a clinical psychologist specializing in the field of developmental psychopathology, and her research focuses on the links between close relationships, emotions, health, and development.
info_outlineResearch Matters Podcast
James Kirby, Ph.D., is a researcher and senior lecturer at the University of Queensland in Australia, who studies the effects of kindness and compassion. Jeff Kim, a graduate student under Dr. Kirby, joins my discussion with Dr. Kirby on measuring and incorporating physiological data into their research. Today’s conversation is focused on measuring heart rate variability.
info_outlineResearch Matters Podcast
My two guests today, Bethany Teachman, Ph.D. and director of the PACT lab at the University of Virginia, and Jeremy Eberle, a 4th-year graduate student in her lab share the steps they’ve taken to embrace the open-science mindset and open-science practices in their lab.
info_outlineResearch Matters Podcast
Jessica Schleider, PhD, is an assistant professor of clinical psychology at Stony Book University and a graduate of the Clinical Psychology Program at Harvard University. When in graduate school, she learned about open science – not from her courses but from the Twitter-spere and later from The Black Goat Podcast. What she learned was compelling and unsettling and kept her up at night as she thought about the state of scientific research in general and her research in particular.
info_outlineResearch Matters Podcast
Dr. Maria Karekla is an assistant professor at the University of Cyprus where she studies anxiety and cravings and specializes in utilizing psychophysiological measurements in her research. I decided to interview her because she has one of the few labs in the world that has done research comparing consumer grade wearable physiological measurement devices to research grade stationary devices.
info_outlineJessica Schleider, PhD, is an assistant professor of clinical psychology at Stony Book University and a graduate of the Clinical Psychology Program at Harvard University. When in graduate school, she learned about open science – not from her courses but from the Twitter-spere and later from The Black Goat Podcast. What she learned was compelling and unsettling and kept her up at night as she thought about the state of scientific research in general and her research in particular.
Wanting to sleep better, she “made an inner commitment to myself that if I got the chance to build a lab, open science would be part of it from the start… Especially if someone was pursuing a relatively new area of research, I didn’t feel like there was any other way to go about it…The curtain had been pulled up, so I couldn’t trust my own work anymore unless these things were more clearly and rigorously incorporated.”
In today’s episode, Dr. Schleider and I discus open science principles, how open science differs from run-of-the-mill research, and why it can feel daunting and intimidating to embrace open-science principles.
Dr. Schleider is also a strong advocate for diversity, equity, and inclusivity in academia. We discuss the ways academia has traditionally favored those from privileged backgrounds. We also discuss specific steps she has used to ensure that her lab is a safe place for people from underrepresented groups, that opportunities in her lab are clear and transparent, and that a protocol has been set in place should there be any discriminatory behavior or remarks that originate in the lab over which she presides.
In this episode, you’ll learn…
- How Dr. Schleider stumbled upon open science and the replicability revolution
- Why she decided to implement open science practices
- That Dr. Schleider thought she had been doing pre-registration because she had been registering clinical trials
- How open science pre-registration differs from traditional registrations
- Where Dr. Schleider registers her studies
- Why open science can be frustrating to implement
- Why open science requires a mindset change
- The stages of registered reports
Tips from the episode
On where to learn about open science…
- Improve Your Statistical Inferences Coursea course (see link below)
- The Black Goat Podcast (see link below)
On the differences between regular registration and open science preregistration…
- Open science preregistration aims to make sure researchers don’t fall into biases, outcome switch, or p-hack. In open science, when you deviate from the plan, you’re transparent about it.
- Traditional preregistrations don’t require an analytic plan or explain how the data will be analyzed.
On open science procedures she uses…
- Always file a preregistration
- Detail how effect size is computed
- Streamline process for double-checking data set preparation and analysis
- Document code
- Make all of your work accessible to the public
On leveling the playing field in research and academia…
- Reconsider the GRE
- Make admissions more transparent
- Make education less expensive
- Formalize opportunities to get involved in research (so that those opportunities are not reserved for those who know to seek and ask for those opportunities)
Links from the episode:
- Daniel Lakens’ Improve Your Statistical Inferences course
- The Black Goat Podcast
- Dr. Schelider’s lab
- Dr. Schelider’s lab manual
- As-predicted template
- Template for pre-registration for beginners (from her lab)
- Jamovi – easy to use R package
- Documents to guide those who are considering applying to her lab or grad school in general:
Research Matters Podcast is hosted by Jason Luoma, who can be found on Twitter @jasonluoma or Facebook at: facebook.com/jasonluomaphd. You download the podcast through iTunes, Stitcher, or Spotify.