Journal
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
Volume 119, Issue 41, Pages -Publisher
NATL ACAD SCIENCES
DOI: 10.1073/pnas.2204248119
Keywords
surface representation; segmentation; tracking; binding problem; symbolic representation
Categories
Funding
- Howard Hughes Medical Institute
- Kavli Foundation
Ask authors/readers for more resources
This article discusses the segmentation and tracking of objects, proposing a surface representation method based on the mathematical structure of light rays. It shows that objects can be segmented and tracked without learning.
The world is composed of objects, the ground, and the sky. Visual perception of objects requires solving two fundamental challenges: 1) segmenting visual input into discrete units and 2) tracking identities of these units despite appearance changes due to object deformation, changing perspective, and dynamic occlusion. Current computer vision approaches to segmentation and tracking that approach human performance all require learning, raising the question, Can objects be segmented and tracked without learning? Here, we show that the mathematical structure of light rays reflected from environment surfaces yields a natural representation of persistent surfaces, and this surface representation provides a solution to both the segmentation and tracking problems. We describe how to generate this surface representation from continuous visual input and demonstrate that our approach can segment and invariantly track objects in cluttered synthetic video despite severe appearance changes, without requiring learning.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available