Show simple item record

TOUCH and GO: A Real-World Multisensory Dataset

dc.contributor.authorChenyang, Ma
dc.contributor.authorFengyu, Yang
dc.contributor.authorAndrew, Owens
dc.contributor.advisorOwens, Andrew
dc.date.accessioned2023-05-26T17:55:49Z
dc.date.available2023-05-26T17:55:49Z
dc.date.issued2022
dc.identifier.urihttps://hdl.handle.net/2027.42/176733
dc.description.abstractUnlike how humans perceive the world from associations between senses and through a series of inanimate objects, contemporary research on robot perception problem mainly rely on vision units or visual inputs to teach the robots interact with the world. We identify that this is due to the lack of real-world multisenory rich object dataset. To tackle this challenge, we present TOUCH and GO, a multisensory dataset containing real-world synchronized high-quality video and tactile data containing 12600 object instances over 37800 touches and 30 hours of video captured from egocentric viewpoint, greatly exceeding the size of existing real-world multisensory datasets. All objects in our dataset are originated from real environments with fine-grained textures retained. We propose and apply our dataset on two novel tasks, tactile-guided image stylization and multi-modal video prediction on tactile images.
dc.subjectReal-world multisensory dataset
dc.subjectTactile-guided image stylization
dc.subjectMulti-modal video prediction
dc.titleTOUCH and GO: A Real-World Multisensory Dataset
dc.typeProject
dc.subject.hlbtoplevelEngineering
dc.description.peerreviewedPeer Reviewed
dc.contributor.affiliationumECE
dc.contributor.affiliationumCSE
dc.contributor.affiliationumECE
dc.contributor.affiliationumcampusAnn Arbor
dc.description.bitstreamurlhttp://deepblue.lib.umich.edu/bitstream/2027.42/176733/1/TOUCH_and_GO_A_Real-World_Multisensory_Dataset_-_Chenyang_Ma.pdf
dc.description.bitstreamurlhttp://deepblue.lib.umich.edu/bitstream/2027.42/176733/2/Chenyang_Ma_Honors_Poster_-_Chenyang_Ma.pdf
dc.identifier.doihttps://dx.doi.org/10.7302/7582
dc.working.doi10.7302/7582en
dc.owningcollnameHonors Program, The College of Engineering


Files in this item

Show simple item record

Remediation of Harmful Language

The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.

Accessibility

If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.