Publications

You can also find my articles on my Google Scholar profile.


2024

MACS: Mass Conditioned 3D Hand and Object Motion Synthesis
MACS: Mass Conditioned 3D Hand and Object Motion Synthesis
S. Shimada, F. Mueller, J. Bednařík, B. Doosti, B. Bickel, D. Tang, V. Golyanik, J. Taylor, C. Theobalt, T. Beeler.
Accepted at International Conference on 3D Vision (3DV), 2024
[project page] [paper]

2023

Decaf: Monocular Deformation Capture for Face and Hand Interactions
Decaf: Monocular Deformation Capture for Face and Hand Interactions
S. Shimada, V. Golyanik, P. Pérez, C. Theobalt.
ACM Transactions on Graphic (SIGGRAPH Asia), 2023
[project page] [paper] [dataset]
Unbiased 4D: Monocular 4D Reconstruction with a Neural Deformation Model
Unbiased 4D: Monocular 4D Reconstruction with a Neural Deformation Model
E. Johnson, M. Habermann, S. Shimada, V. Golyanik, C. Theobalt.
Accepted at Computer Vision and Pattern Recognition Workshop (CVPRW), 2023
[project page] [paper]

2022

MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes
MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes
Z. Li, S. Shimada, B. Schiele, C. Theobalt, V. Golyanik.
Accepted at 3D Vision (3DV), 2022 (Best Student Paper Award)
[project page] [paper]
HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidance
HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidance
S. Shimada, V. Golyanik, Z. Li, P. Pérez, W. Xu, C. Theobalt.
Accepted at European Conference on Computer Vision (ECCV), 2022
[project page] [paper]
UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capture
UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capture
H. Akada, J. Wang, S. Shimada, M. Takahashi, C. Theobalt, V. Golyanik.
Accepted at European Conference on Computer Vision (ECCV), 2022
[project page]
Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors
Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors
X. Yi, Y. Zhou, M. Habermann, S. Shimada, V. Golyanik, C. Theobalt, F. Xu.
Accepted at Computer Vision and Pattern Recognition (CVPR), 2022 (Best Paper Finalist)
[paper] [project page]

2021

HandVoxNet++: 3D Hand Shape and Pose Estimation using Voxel-Based Neural Networks
HandVoxNet++: 3D Hand Shape and Pose Estimation using Voxel-Based Neural Networks
J. Malik, S. Shimada, A. Elhayek, S. Ali, C. Theobalt, V. Golyanik, D. Stricker.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
[paper] [project page]
Gravity-Aware 3D Human-Object Reconstruction
Gravity-Aware 3D Human-Object Reconstruction
R. Dabral, S. Shimada, A. Jain, C. Theobalt, V. Golyanik.
In International Conference on Computer Vision (ICCV), 2021
[paper] [project page] [code] [dataset]
Neural Monocular 3D Human Motion Capture with Physical Awareness
Neural Monocular 3D Human Motion Capture with Physical Awareness
S. Shimada, V. Golyanik, W. Xu, P. Pérez, C. Theobalt.
ACM Transactions on Graphic (SIGGRAPH), 2021
[paper] [project page]

2020

PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time
PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time
S. Shimada, V. Golyanik, W. Xu, C. Theobalt.
ACM Transactions on Graphic (SIGGRAPH Asia), 2020
[paper] [project page] [arXiv]
Fast Simultaneous Gravitational Alignment of Multiple Point Sets
Fast Simultaneous Gravitational Alignment of Multiple Point Sets
V. Golyanik, S. Shimada, C. Theobalt.
In International Conference on 3D Vision (3DV), 2020 (Oral)
[paper] [project page]
HandVoxNet: Deep Voxel-Based Network for 3D Hand Shape and Pose Estimation from a Single Depth Map
HandVoxNet: Deep Voxel-Based Network for 3D Hand Shape and Pose Estimation from a Single Depth Map
J. Malik, I. Abdelaziz, A. Elhayek, S. Shimada, S. A. Ali, V. Golyanik, C. Theobalt, D. Stricker.
Accepted in Computer Vision and Pattern Recognition (CVPR), 2020
[project page] [arXiv]

2019

DispVoxNets: Non-Rigid Point Set Alignment with Supervised Learning Proxies
DispVoxNets: Non-Rigid Point Set Alignment with Supervised Learning Proxies
S. Shimada, V. Golyanik, E. Tretschk, D. Stricker, C. Theobalt.
In International Conference on 3D Vision (3DV), 2019 (Oral)
[paper] [poster] [project page] [arXiv]
IsMo-GAN: Adversarial Learning for Monocular Non-Rigid 3D Reconstruction.
IsMo-GAN: Adversarial Learning for Monocular Non-Rigid 3D Reconstruction.
S. Shimada, V. Golyanik, C. Theobalt and D. Stricker.
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019; Oral
[paper] [code] [arXiv]

2018

HDM-Net: Monocular Non-Rigid 3D Reconstruction with Learned Deformation Model
HDM-Net: Monocular Non-Rigid 3D Reconstruction with Learned Deformation Model
V. Golyanik, S. Shimada, K. Varanasi, D. Stricker.
In International Conference on Virtual Reality and Augmented Reality (EuroVR), 2018 (Oral (Long Paper))
[paper] [HDM-Net dataset]