Discover how virtual reality is unlocking our ability to distinguish between different materials using our senses.
Have you ever picked up a glass ornament, turned it toward the light, or tilted a shiny object to figure out whether it was made of metal or glass? According to new research, that instinct isn’t random—it’s one of the ways our brains gather the information needed to identify what objects are made of (1✔ ✔Trusted Source
Material discrimination relies on context-dependent active sensing strategies
).
Researchers at Toyohashi University of Technology in Japan have found that people naturally change how they explore objects when visual information is uncertain. Using virtual reality (VR), the team discovered that moving our heads, changing viewing angles, and rotating objects with our hands all play important roles in helping the brain distinguish between different materials.
The findings, published in the Journal of Vision, suggest that material perception is far more active than scientists once believed and could help improve future virtual reality systems, robotics, and artificial intelligence.
Advertisement
Our Eyes Don’t Always Tell the Whole Story
Humans rely on several visual cues to recognize materials.
A polished metal surface reflects its surroundings like a mirror, while glass allows light to pass through and bends the background in distinctive ways. Other clues, such as glossiness, transparency, reflections, and distortions, also help the brain decide what it’s seeing.
However, these visual signals can sometimes be deceptive.
Depending on the lighting, surrounding environment, and viewing angle, a metal object and a glass object can appear remarkably similar from a single perspective.
Researchers say this explains why people instinctively move around an object instead of relying on one quick glance.
Advertisement
Virtual Reality Helped Scientists Watch Natural Exploration
To better understand this behavior, the researchers created realistic computer-generated objects that gradually changed in appearance from metal to glass inside a virtual reality environment.
Participants wore VR headsets and were free to move their heads, lean closer, rotate the virtual objects, and examine them from different directions using handheld controllers.
Throughout the experiments, researchers recorded head movements, hand movements, object manipulation, and the amount of time participants spent exploring each object before deciding whether it looked more like metal or glass.
This allowed scientists to observe how people naturally gather visual information when making difficult judgments.
Advertisement
The More Uncertain People Were, the More They Explored
One of the clearest findings was that uncertainty changed behavior.
When participants struggled to determine whether an object was metal or glass, they spent significantly more time examining it.
Instead of making quick decisions, they rotated the object repeatedly, changed viewing angles, and explored it more carefully.
The researchers also found that people who naturally explored objects more thoroughly tended to identify materials more accurately than those who relied on brief observations.
According to co-first author Ryu Nomachi, when people cannot immediately identify an object, they instinctively search for additional visual clues rather than simply accepting the first impression.
Changing Your View Isn’t Always Enough
The research also revealed that different exploration strategies work better in different situations.
When participants compared multiple objects at the same time, moving their heads to change their viewpoint was the most effective way to identify differences in material.
Seeing several objects from different angles made subtle variations in reflections and transparency easier for the brain to detect.
However, when participants examined only a single object, physically rotating and manipulating it became the more useful strategy.
The findings suggest that the brain constantly adapts its approach depending on how much visual information is available. Rather than following one fixed method, humans switch flexibly between moving themselves and moving the object.
Material Perception Is an Active Process
The study challenges the traditional idea that vision is simply a passive process in which the brain interprets whatever image reaches the eyes.
Instead, the researchers argue that people actively seek out the information they need.
Participants used a wide range of exploration strategies, including bringing objects closer, leaning toward them, viewing them from above or below, and rotating them repeatedly until they felt confident in their decision.
These behaviors varied considerably from one individual to another, suggesting that each person develops slightly different ways of gathering visual information.
“Our findings suggest that these everyday exploratory behaviors may play an important role in acquiring the visual information necessary for material discrimination,” Nomachi said.
The Findings Could Improve Virtual Reality and Artificial Intelligence
Although the study focused only on distinguishing between metal and glass using visual information, the researchers believe the findings have applications far beyond laboratory experiments.
Understanding how humans naturally explore objects could help developers create more realistic virtual reality (VR) and augmented reality (AR) experiences, where digital objects respond more like real-world materials.
The research may also improve robotic vision systems and artificial intelligence, allowing machines to actively gather information by changing viewpoints rather than relying on a single image.
Human-centered interface design could also benefit by incorporating the same exploration strategies people naturally use.
The Next Step: Combining Sight with Touch
The researchers plan to expand their work to include additional materials such as fabric, stone, plastic, and wood to better understand how people recognize a wider range of surfaces.
Future studies will also incorporate haptic information, including texture, weight, and temperature, since people rarely rely on vision alone in everyday life.
By combining visual exploration with touch, scientists hope to build a more complete picture of how humans identify the materials around them.
The researchers say their findings reinforce a simple but important idea: understanding the world isn’t just about looking—it also depends on how we choose to explore it.
Reference:
- Material discrimination relies on context-dependent active sensing strategies – (https://jov.arvojournals.org/article.aspx?articleid=2811946)
Source-Medindia