Bethany Teachman, PhD, and Jeremy Eberle, on embracing an open-science mindset
Release Date: 10/02/2020
Research Matters Podcast
Dr. Jacqueline (Jackie) Persons is a distinguished clinician, researcher, and Clinical Professor at the University of California, Berkeley. She served as president of the Association of Cognitive and Behavioral Therapies (ABCT) in 1999 and currently works in private practice at the Oakland Cognitive Behavior Therapy Center. With over 35 years of experience, Dr. Persons is recognized globally for her pioneering work in integrating research into private practice, particularly in the areas of case formulation and measurement-based care. In this insightful conversation, we dive into Dr....
info_outlineResearch Matters Podcast
Dr. Patricia Arean is is the Director of the Division of Services and Intervention Research at the National Institute of Mental Health (NIMH), as well as a clinical researcher and former professor at the University of Washington’s Department of Psychiatry and Behavioral Sciences. With over 30 years of experience, Dr. Arean has focused her career on increasing access to mental health services for underserved communities. She has led multiple research initiatives, including the UW Alacrity Center, which aims to redesign psychosocial interventions for underserved populations, and the Creative...
info_outlineResearch Matters Podcast
Tony Biglan, Ph.D., is a Senior Scientist at Oregon Research Institute and Co-Director of the Promise Neighborhood Research Consortium. For the past thirty years, he has conducted research in the development and prevention of child and adolescent problem behavior. He is a former president of the Society for Prevention Research and was a member of the Institute of Medicine Committee on Prevention.
info_outlineResearch Matters Podcast
Dean McKay, Ph.D., A.B.B.P. is Professor of Psychology at Fordham University where he is a member of the clinical psychology doctoral program. His lab, Compulsive, Obsessive, and Anxiety Program (COAP) provides instruction to undergraduate, masters, and doctorate levels. Dr. McKay’s expertise is in anxiety and obsessive-compulsive behavior, with his current focus being on Covid-19 related stress and anxiety.
info_outlineResearch Matters Podcast
Dr. Hayes is a Nevada Foundation Professor of Psychology in the Behavior Analysis Program at the University of Nevada, Reno. An author of 46 books and nearly 650 scientific articles, he is especially known for his work on Acceptance and Commitment Therapy, which is one of the most widely used and researched new methods of psychological intervention in the last 20 years.
info_outlineResearch Matters Podcast
Jessica Borelli, Ph.D., is an Associate Professor of Psychological Science at the University of California, Irvine. She is a clinical psychologist specializing in the field of developmental psychopathology, and her research focuses on the links between close relationships, emotions, health, and development.
info_outlineResearch Matters Podcast
James Kirby, Ph.D., is a researcher and senior lecturer at the University of Queensland in Australia, who studies the effects of kindness and compassion. Jeff Kim, a graduate student under Dr. Kirby, joins my discussion with Dr. Kirby on measuring and incorporating physiological data into their research. Today’s conversation is focused on measuring heart rate variability.
info_outlineResearch Matters Podcast
My two guests today, Bethany Teachman, Ph.D. and director of the PACT lab at the University of Virginia, and Jeremy Eberle, a 4th-year graduate student in her lab share the steps they’ve taken to embrace the open-science mindset and open-science practices in their lab.
info_outlineResearch Matters Podcast
Jessica Schleider, PhD, is an assistant professor of clinical psychology at Stony Book University and a graduate of the Clinical Psychology Program at Harvard University. When in graduate school, she learned about open science – not from her courses but from the Twitter-spere and later from The Black Goat Podcast. What she learned was compelling and unsettling and kept her up at night as she thought about the state of scientific research in general and her research in particular.
info_outlineResearch Matters Podcast
Dr. Maria Karekla is an assistant professor at the University of Cyprus where she studies anxiety and cravings and specializes in utilizing psychophysiological measurements in her research. I decided to interview her because she has one of the few labs in the world that has done research comparing consumer grade wearable physiological measurement devices to research grade stationary devices.
info_outlineDoes the thought of practicing open science give you sweaty palms? That’s a normal reaction for those of us who weren’t formally trained in the open-science methodology. The sweaty-palm reaction is really not that surprising since most of us have gotten where we are today because we’ve been meticulous in our work and tried to put out the best work we possibly could. In a nutshell, we tend to be perfectionists.
But science, like life, is far from perfect. It’s messy. And it often takes unexpected twists and turns. Once we embrace this reality and view research as a conversation starter, we’ll be able to move past the sweaty-palms stage.
Part of getting comfortable with open-science practices is your mindset. It’s about valuing doing rigorous science, even when it gets messy. Open science is also about creating an environment where feedback is sought and embraced. It’s about learning along the way so that you can do even better science going forward.
In this episode, you’ll learn…
- Why Dr. Teachman felt primed to embrace open science from her grad school experience, even though she wasn’t taught open-science protocol in school
- How to begin embracing open-science practices
- The barriers to embracing open science
- Why open science is about more than protocols and checklists -- it’s about a culture that supports transparency and is non-defensive to feedback
- About the documentation process within her lab
- About the benefits of using GitHub in addition to OSF
- Why doing science according to your values can ease the sting of rejected work by publications
- Dr. Teachman’s suggestion of putting a pre-registration section on your CV
- How Dr. Teachman approaches collaborations with other researchers who are unfamiliar with open-science practices
Tips from the episode
On how to shift a lab towards open-science practices…
- Incorporate visual reminders about your lab’s open-science goals.
- Set concrete deadlines and expect participation from everyone in the lab.
- Get over the idea that “it has to be as near perfect as possible before I make it public.”
On incrementalism and where to start…
- Just start. It won’t be perfect, and you’ll get better at it.
- Embrace that science is about taking risks and figuring it out as you go along.
- As a first step, do a pre-registration of your hypothesis or share a data set.
On the documentation process for open-science projects…
- Use plain language for your comments within your code
- Include a section on deviations from the pre-registration
- Include a guide to open-data and materials
- Use an internal wiki
Links from the episode:
- RO1 trial – Mindtrails
- Alan Kazdin
- Center for Open Science
- PACT lab
- Pre-registration templates on OSF
- Twitter feed on CVs incorporating open science and related materials on OSF
- Tutorial on integrating Github and R
- ReproducibiliTea open science methodology reading groups
- Jeremy Eberle can be found on Twitter: @JeremyWEberle, and https://www.researchgate.net/profile/Jeremy_Eberle2 or https://osf.io/nyqux/
Research Matters Podcast is hosted by Jason Luoma, who can be found on Twitter @jasonluoma or Facebook at: facebook.com/jasonluomaphd. You download the podcast through iTunes, Stitcher, or Spotify. Reach out with suggestions, questions, or comments to [email protected]