TOUCH and GO: A Real-World Multisensory Dataset
dc.contributor.author | Chenyang, Ma | |
dc.contributor.author | Fengyu, Yang | |
dc.contributor.author | Andrew, Owens | |
dc.contributor.advisor | Owens, Andrew | |
dc.date.accessioned | 2023-05-26T17:55:49Z | |
dc.date.available | 2023-05-26T17:55:49Z | |
dc.date.issued | 2022 | |
dc.identifier.uri | https://hdl.handle.net/2027.42/176733 | |
dc.description.abstract | Unlike how humans perceive the world from associations between senses and through a series of inanimate objects, contemporary research on robot perception problem mainly rely on vision units or visual inputs to teach the robots interact with the world. We identify that this is due to the lack of real-world multisenory rich object dataset. To tackle this challenge, we present TOUCH and GO, a multisensory dataset containing real-world synchronized high-quality video and tactile data containing 12600 object instances over 37800 touches and 30 hours of video captured from egocentric viewpoint, greatly exceeding the size of existing real-world multisensory datasets. All objects in our dataset are originated from real environments with fine-grained textures retained. We propose and apply our dataset on two novel tasks, tactile-guided image stylization and multi-modal video prediction on tactile images. | |
dc.subject | Real-world multisensory dataset | |
dc.subject | Tactile-guided image stylization | |
dc.subject | Multi-modal video prediction | |
dc.title | TOUCH and GO: A Real-World Multisensory Dataset | |
dc.type | Project | |
dc.subject.hlbtoplevel | Engineering | |
dc.description.peerreviewed | Peer Reviewed | |
dc.contributor.affiliationum | ECE | |
dc.contributor.affiliationum | CSE | |
dc.contributor.affiliationum | ECE | |
dc.contributor.affiliationumcampus | Ann Arbor | |
dc.description.bitstreamurl | http://deepblue.lib.umich.edu/bitstream/2027.42/176733/1/TOUCH_and_GO_A_Real-World_Multisensory_Dataset_-_Chenyang_Ma.pdf | |
dc.description.bitstreamurl | http://deepblue.lib.umich.edu/bitstream/2027.42/176733/2/Chenyang_Ma_Honors_Poster_-_Chenyang_Ma.pdf | |
dc.identifier.doi | https://dx.doi.org/10.7302/7582 | |
dc.working.doi | 10.7302/7582 | en |
dc.owningcollname | Honors Program, The College of Engineering |
Files in this item
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.