loader from loading.io

Restoring Vision: Code Breaking and Optogenetics

On Tech & Vision With Dr. Cal Roberts

Release Date: 03/04/2022

Biosensors: The Future of Diagnostic Medicine show art Biosensors: The Future of Diagnostic Medicine

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. This episode is about how biosensor technology is revolutionizing the field of diagnostic and preventive medicine. Biosensors can take many forms — wearable, implantable, and even ingestible. And they can serve many different functions as well, most notably when it comes to detecting the various pressure levels in our bodies. This episode features interviews with several luminaries working with biosensors. One of them is Doug Adams, a revolutionary entrepreneur who became inspired to create a...

info_outline
The World in Your Hand: The Power of Generative AI show art The World in Your Hand: The Power of Generative AI

On Tech & Vision With Dr. Cal Roberts

When it comes to emerging technology, there’s no hotter topic than artificial intelligence. Programs like ChatGPT and Midjourney are becoming more popular and are inspiring people to explore the possibilities of what AI can achieve — including when it comes to accessible technology for people who are blind or visually impaired. One of those people is Saqib Shaikh, an engineering manager at Microsoft. Saqib leads the team that developed an app called Seeing AI, which utilizes the latest generation of artificial intelligence, known as generative AI Dr. Cal spoke with Saqib about how...

info_outline
Reimagining the Visual Arts show art Reimagining the Visual Arts

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. When it comes to art, a common phrase is “look, don’t touch.” Many think of art as a purely visual medium, and that can make it difficult for people who are blind or visually impaired to engage with it. But in recent years, people have begun to reimagine what it means to experience and express art. For this episode, Dr. Cal spoke to El-Deane Naude from Sony Electronics. El-Deane discussed the Retissa NeoViewer, a project developed with QD Laser that projects images taken on a camera...

info_outline
Developing Big Ideas: Product Testing and Iteration show art Developing Big Ideas: Product Testing and Iteration

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. When we buy a product off the shelf, we rarely think about how much work went into getting it there. Between initial conception and going to market, life-changing technology requires a rigorous testing and development process. That is especially true when it comes to accessible technology for people who are blind or visually impaired. For this episode, Dr. Cal spoke to Jay Cormier, the President and CEO of Eyedaptic, a company that specializes in vision-enhancement technology. Their flagship...

info_outline
Robotic Guidance Technology show art Robotic Guidance Technology

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. The white cane and guide dogs are long-established foundational tools used by people with vision impairment to navigate. Although it would be difficult to replace the 35,000 years of bonding between humans and dogs, researchers are working on robotic technologies that can replicate many of the same functions of a guide dog. One such project, called LYSA, is being developed by Vix Labs in Brazil. LYSA sits on two wheels and is pushed by the user. It’s capable of identifying obstacles and...

info_outline
Smart Cities and Autonomous Driving: How Technology is Providing Greater Freedom of Movement for People with Vision Loss show art Smart Cities and Autonomous Driving: How Technology is Providing Greater Freedom of Movement for People with Vision Loss

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. Navigating the world can be difficult for anyone, whether or not they have vision loss. Tasks like driving safely through a city, navigating a busy airport, or finding the right bus stop all provide unique challenges. Thankfully, advances in technology are giving people more freedom of movement than ever before, allowing them to get where they want, when they want, safely. Smart Cities are putting data collection to work in a healthy way by providing information to make busy intersections more...

info_outline
Leveling Up Accessible Video Game Features: How New Technology is Making Gaming More Immersive and Inclusive for People with Vision Loss show art Leveling Up Accessible Video Game Features: How New Technology is Making Gaming More Immersive and Inclusive for People with Vision Loss

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. For decades, people with vision loss had limited options when it came to accessing video games. Aside from screen magnification and text-to-voice tools, gamers who are blind or visually impaired didn’t have many ways to play their favorite titles. But in recent years, the same cutting-edge technology used to create games has been used to also make them more accessible for people with vision impairment. These advances include more visibility options, the implementation of 3D audio, haptic...

info_outline
A Celebration of Sound and Song: Music Tech Shines the Spotlight on Musicians with Vision Loss show art A Celebration of Sound and Song: Music Tech Shines the Spotlight on Musicians with Vision Loss

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. Marcus Roberts, Stevie Wonder, Ray Charles, and even Louis Braille (who invented the Braille Music Notation system still used today) prove that musicians who are blind or visually impaired have made profound impacts on our musical landscape. However, to get their work to us, musicians who are blind have had to structure complex workarounds, like relying on sighted musicians to demonstrate complex scores; memorizing long pieces; or only performing when they can have a Braille score in front of...

info_outline
Ambient Computing and Voice Assistants: From Your Home to the Stars show art Ambient Computing and Voice Assistants: From Your Home to the Stars

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. Lots of people have voice-controlled smart home assistants like Siri, Google, or Alexa in their homes…. to listen to the news or to set timers. But they can do so much more! David Frerichs, Principal Engineer, Alexa Experience at Amazon on the aging and accessibility team, shares his design philosophy for making voice assistants more inclusive, and the preferred mode of engagement for every user. He also shares that the next stage of smart home assistants will be ambient computing, where your...

info_outline
New Approaches in Access: Smart Tools for Indoor Navigation and Information Transfer show art New Approaches in Access: Smart Tools for Indoor Navigation and Information Transfer

On Tech & Vision With Dr. Cal Roberts

This podcast is about big ideas on how technology is making life better for people with vision loss. Artifacts from Blackbeard’s sunken pirate ship are on display in the North Carolina Maritime Museum in Beaufort, North Carolina. But now they are also accessible to visitors who are blind, thanks to the efforts of Peter Crumley, who spearheads the Beaufort Blind Project. In this episode, we ask: How can new technology help make sites like these as accessible to people who are blind as they are to sighted people? We profile three companies applying new technologies paired with smartphone...

info_outline
 
More Episodes

This podcast is about big ideas on how technology is making life better for people with vision loss.

The Enigma machines that Germany used to encode messages during World War II were notorious for their complexity. Two Enigma experts — Dr. Tom Perera, a retired neuroscientist, and founder of EnigmaMuseum.com, and Dr. Mark Baldwin, an expert on the story of Enigma machines — tell us how the Allies were able to crack the code, by using input-output mapping.

The human brain is similarly complex. Until recently, no one knew the code the retina used to communicate with the brain to create sight. Our guest, Dr. Sheila Nirenberg, a neuroscientist at Weill Cornell, and Principal and Founder of Bionic Sight has — using input-output mapping — cracked the retina’s neural code, enabling her to recreate the electric signals to the brain that could restore sight in people with retinal degeneration. She has created a set of goggles that convert a camera’s images into the code, via pulses of light. And she relies on optogenetics, a relatively new procedure in neuroscience that helps neurons become responsive to light. In her clinical trial, Dr. Nirenberg injects the optogenetic vector into the eye, and trial participants who are completely blind, like Barry Honig, who we speak with on this program, report being able to see light. In early studies, coupling the effects of the optogenetics with the code-enabled goggles has an even more impressive effect on patients’ vision. Dr. Nirenberg is also using her knowledge of the visual neural code to inform machine learning applications that could also be further used to support people who are blind or visually impaired. Clinical trial participants are important partners in the journey of discovery, Dr. Nirenberg says. Barry Honig agrees. He was happy to participate to help ease the burden on future children diagnosed with eye diseases that would otherwise result in blindness, but thanks to these advancements, someday may not.

 

The Big Takeaways:

  • Dr. Tom Perera and Dr. Mark Baldwin describe the history and workings of the Enigma machine, the complex encoding device that allowed Germany to take the upper hand at the beginning of World War II, a war in which communication was sent wirelessly, elevating the need for encryption. They then describe the Polish and British efforts to break Enigma, including standard decryption and Alan Turing’s Bombe machine.
  • Similar to the Enigma, the human brain is incredibly complex, and much of the codes that make it run have not yet been deciphered, until now.
  • Our guest, Dr. Sheila Nirenberg, conducted extensive input-output mapping on live human retinas. She was able to keep them alive in a dish outside the body for a few hours, during which time she’d show them videos. As the retina perceived the films, Dr. Nirenberg mapped the electrical current that would pulse through the ganglion nerve. In this way, she was able to learn how the human eye sees and to decipher the code that allows our brains to perceive images. This code has been honed via evolution over millennia.
  • Having cracked the retinal neural code, Dr. Nirengberg held the key to restoring vision in people who are blind from retinal degeneration. She developed goggles embedded with a camera to convert the visual world into the retina’s neural code using pulses of light, but she still had to get these pulses of light into an unseeing eye.
  • Optogenetics is the key to creating light perception. Optogenetics is a relatively new procedure in neuroscience, by which researchers have created a genetically modified virus based on light-responsive algae, which when injected into live human cells, recombines its DNA with the DNA of host cells. In Dr. Nirenberg’s case, she injects the optogenetic vector into the patient’s retina. Most patients report the restoration of light perception to varying degrees, with just the optogenetics alone. Coupled with the goggles, and with Dr. Nirenberg’s visual neural code, this system could restore some vision in people who are blind. The trial is still in its early stages.
  • Dr. Nirenberg also uses the retinal neural code to improve how computers see. Computer vision experts are teaching computers to “see” more like humans. Still, if they can equip algorithms with humanity’s neural code, the goal of human-like vision becomes more easily achievable.
  • Barry Honig is a participant in the clinical trial. After his optogenetic injection, he was able to perceive the menorah at Hanukkah. From different perspectives, Barry and Dr. Nirenberg agree on the importance of trial participants.

 

Tweetables:

  • “The analogy between the Enigma and the human brain is rather interesting. The brain has … 10 billion brain cells, … the Enigma machine has 10 to the 114th power possible internal connections. And that is actually a lot more.”
  • — Tom Perera, neuroscientist and founder of EnigmaMuseum.com
  • “Millions of years of evolution honed the retina into pulling out … the right features. And then it converts those features into electrical pulses and sends them up to the brain. That’s what a normal retina does.”
  • — Dr. Sheila Nirenberg, neuroscientist at Weill Cornell, and Principal and Founder of Bionic Sight.
  • “And so … you’re watching the retina watch a movie. And … you’re seeing what it would be sending … to your brain.”
  • — Dr. Sheila Nirenberg, neuroscientist at Weill Cornell, and Principal and Founder of Bionic Sight.“So I went from … sort of bare light perception to … this recent past Hanukkah, I … said to my … wife, the menorah — I think it was the eighth day and … the whole menorah was lit!”
  • — Barry Honig, clinical trial participant and founder of Honig International
  • “Whether or not that’s perfect, you know, time will tell, but … to be able to spare kids that, and equally as importantly, to spare their parents that, you know, if I could … just take an injection and be a part of it, then, … that’s a lot of reward.
  • — Barry Honig, clinical trial participant and founder of Honig International

 

Contact Us:

  • Contact us at [email protected] with your innovative new technology ideas for people with vision loss.

 

Pertinent Links: