Journal
JOURNAL OF REAL-TIME IMAGE PROCESSING
Volume 19, Issue 2, Pages 363-374Publisher
SPRINGER HEIDELBERG
DOI: 10.1007/s11554-021-01191-y
Keywords
Simulator; Convolutional neural network; Embedded vision; Pixel processing
Categories
Funding
- National Science Foundation (NSF) [1946088]
- Direct For Computer & Info Scie & Enginr
- Division Of Computer and Network Systems [1946088] Funding Source: National Science Foundation
Ask authors/readers for more resources
This paper introduces an event camera simulator that implements a distributed computation model to identify relevant regions in an image frame and samples frame-regions only when there is a new event. It closely emulates an image processing pipeline similar to that of physical cameras and effectively emulates event vision with low overheads according to experimental results.
In recent years, there has been a growing interest in realizing methodologies to integrate more and more computation at the level of the image sensor. The rising trend has seen an increased research interest in developing novel event cameras that can facilitate CNN computation directly in the sensor. However, event-based cameras ca be expensive, limiting performance exploration on high-level models and algorithms. This paper presents an event camera simulator that can be a potent tool for hardware design prototyping, parameter optimization, attention-based innovative algorithm development, and benchmarking. The proposed simulator implements a distributed computation model to identify relevant regions in an image frame. Our simulator's relevance computation model is realized as a collection of modules and performs computations in parallel. The distributed computation model is configurable, making it highly useful for design space exploration. The Rendering engine of the simulator samples frame-regions only when there is a new event. The simulator closely emulates an image processing pipeline similar to that of physical cameras. Our experimental results show that the simulator can effectively emulate event vision with low overheads
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available