HOME

Publications

Google Scholar

A list of publications including Japanese papers is available here.

Book

  1. Takashi Matsuyama, Shohei Nobuhara, Takeshi Takai, and Tony Tung, 3D Video and Its Applications. Springer, 2012. [link] [bibtex]

Tutorial

Research Papers

  1. Kohei Yamashita, Shohei Nobuhara, and Ko Nishino, “DeepShaRM: Multi-View Shape and Reflectance Map Recovery Under Unknown Lighting,” in Proc. of International Conference on 3D Vision (3DV), 2024.     [arxiv] [bibtex]
  2. Kaen Kogashi, Shohei Nobuhara, and Ko Nishino, “SAN: Structure-aware attention network for dyadic human relation recognition in images,” Multimedia Tools and Applications, Oct. 2023. [pdf] [bibtex]
  3. Shu Nakamura, Yasutomo Kawanishi, Shohei Nobuhara, and Ko Nishino, “DeePoint: Visual Pointing Recognition and Direction Estimation,” in Proc. of International Conference on Computer Vision (ICCV), 2023, pp. 20577–20587.     [pdf] [link] [bibtex]
  4. Yifan Zhan, Shohei Nobuhara, Ko Nishino, and Yinqiang Zheng, “NeRFrac: Neural Radiance Fields through Refractive Surface,” in Proc. of International Conference on Computer Vision (ICCV), 2023, pp. 18402–18412.     [pdf] [link] [bibtex]
  5. Tomoki Ichikawa, Yoshiki Fukao, Shohei Nobuhara, and Ko Nishino, “Fresnel Microfacet BRDF: Unification of Polari-Radiometric Surface-Body Reflection,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.     [pdf] [arxiv] [link] [bibtex]
  6. Ryo Kawahara, Meng-Yu Jennifer Kuo, and Shohei Nobuhara, “Teleidoscopic Imaging System for Microscale 3D Shape Reconstruction,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.     [pdf] [bibtex]
  7. Mai Nishimura, Shohei Nobuhara, and Ko Nishino, “View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements,” International Journal of Computer Vision (IJCV), May 2023.     [pdf] [arxiv] [bibtex]
  8. Kohei Yamashita, Yuto Enyo, Shohei Nobuhara, and Ko Nishino, “nLMVS-Net: Deep Non-Lambertian Multi-View Stereo,” in Proc. of IEEE Winter Conference on Applications of Computer Vision (WACV), 2023.     [pdf] [arxiv] [link] [bibtex]
  9. Yuzheng Xu, Yang Wu, Nur Sabrina Binti Zuraimi, Shohei Nobuhara, and Ko Nishino, “Video Region Annotation with Sparse Bounding Boxes,” in International Journal of Computer Vision (IJCV), 2022.     [pdf] [arxiv] [bibtex]
  10. Kosuke Takahashi and Shohei Nobuhara, “Structure of Multiple Mirror System from Kaleidoscopic Projections of Single 3D Point,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 44, no. 9, pp. 5602–5617, 2022.     [pdf] [arxiv] [bibtex]
  11. Mengyu Jennifer Kuo, Satoshi Murai, Ryo Kawahara, Shohei Nobuhara, and Ko Nishino, “Surface Normals and Shape From Water,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 44, no. 12, pp. 9150–9162, 2022.     [pdf] [bibtex]
  12. Zhe Chen, Shohei Nobuhara, and Ko Nishino, “Invertible Neural BRDF for Object Inverse Rendering,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 44, no. 12, pp. 9380–9395, 2022.     [pdf] [bibtex]
  13. Yupeng Liang, Ryosuke Wakaki, Shohei Nobuhara, and Ko Nishino, “Multimodal Material Segmentation,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.     [pdf] [link] [bibtex]
  14. Soma Nonaka, Shohei Nobuhara, and Ko Nishino, “Dynamic 3D Gaze from Afar: Deep Gaze Estimation from Temporal Eye-Head-Body Coordination,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.     [pdf] [link] [bibtex]
  15. Kaen Kogashi, Shohei Nobuhara, and Ko Nishino, “Dyadic Human Relation Recognition,” in Proc. of IEEE International Conference on Multimedia and Expo (ICME), 2022.     (Oral) [bibtex]
  16. Sang-Eun Lee, Keisuke Shibata, Soma Nonaka, Shohei Nobuhara, and Ko Nishino, “Extrinsic Camera Calibration from A Moving Person,” IEEE Robotics and Automation Letters with IROS presentation, vol. 7, no. 4, pp. 10344–10351, 2022.     [pdf] [link] [bibtex]
  17. Sudong Cai, Ryosuke Wakaki, Shohei Nobuhara, and Ko Nishino, “RGB Road Scene Material Segmentation,” in Proc. of Asian Conference on Computer Vision (ACCV), 2022.     [pdf] [link] [bibtex]
  18. Mai Nishimura, Shohei Nobuhara, and Ko Nishino, “ViewBirdiformer: Learning to Recover Ground-Plane Crowd Trajectories and Ego-Motion from a Single Ego-Centric View,” IEEE Robotics and Automation Letters, vol. 8, pp. 368–375, 2022.     [pdf] [arxiv] [bibtex]
  19. Taichi Fukuda, Kotaro Hasegawa, Shinya Ishizaki, Shohei Nobuhara, and Ko Nishino, “BlindSpotNet: Seeing Where We Cannot See,” in Proc. of European Conference on Computer Vision (ECCV) Workshops – Autonomous Vehicle Vision Workshop, 2022.     [video] [arxiv] [link] [bibtex]
  20. Mengyu Jennifer Kuo, Ryo Kawahara, Shohei Nobuhara, and Ko Nishino, “Non-Rigid Shape from Water,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 43, no. 7, pp. 2220–2232, 2021.     [pdf] [video] [bibtex]
  21. Tomoki Ichikawa, Mattew Purri, Ryo Kawahara, Shohei Nobuhara, Kristin Dana, and Ko Nishino, “Shape from Sky: Polarimetric Normal Recovery Under The Sky,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021, pp. 14832–14841.     [pdf] [link] [bibtex]
  22. Yoshiki Fukao, Ryo Kawahara, Shohei Nobuhara, and Ko Nishino, “Polarimetric Normal Stereo,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021, pp. 682–690.     [pdf] [link] [bibtex]
  23. Keisuke Shibata, Sangeun Lee, Shohei Nobuhara, and Ko Nishino, “Consistent 3D Human Shape from Repeatable Action,” in Proc. of The 3rd International Workshop on Dynamic Scene Reconstruction (DynaVis), CVPR Workshop, 2021, pp. 1770–1779.     Best Paper Award [pdf] [video] [bibtex]
  24. Kaen Kogashi, Yang Wu, Shohei Nobuhara, and Ko Nishino, “Human-Object Interaction Detection With Missing Objects,” in Proc. of 17th International Conference on Machine Vision Applications (MVA), 2021.     [bibtex]
  25. Kaen Kogashi, Yang Wu, Shohei Nobuhara, and Ko Nishino, “Human-object interaction detection with missing objects,” Image and Vision Computing, vol. 113, p. 104262, 2021. [pdf] [bibtex]
  26. Mai Nishimura, Shohei Nobuhara, and Ko Nishino, “View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements,” in Proc. of British Machine Vision Conference (BMVC), 2021.     [pdf] [bibtex]
  27. Kohei Yamashita, Shohei Nobuhara, and Ko Nishino, “3D-GMNet: Single-View 3D Shape Recovery as A Gaussian Mixture,” in Proc. of British Machine Vision Conference (BMVC), 2020, pp. 1–13.     [pdf] [arxiv] [bibtex]
  28. Yuzheng Xu, Yang Wu, Nur Sabrina Binti Zuraimi, Shohei Nobuhara, and Ko Nishino, “Video Region Annotation with Sparse Bounding Boxes,” in Proc. of British Machine Vision Conference (BMVC), 2020, pp. 1–12.     (oral), Best Student Paper Award [pdf] [arxiv] [bibtex]
  29. Zhe Chen, Shohei Nobuhara, and Ko Nishino, “Invertible Neural BRDF for Object Inverse Rendering,” in Proc. of European Conference on Computer Vision (ECCV), 2020, pp. 767–783.     (Spotlight) [pdf] [video] [arxiv] [link] [bibtex]
  30. Ryo Kawahara, Meng-Yu Kuo, Shohei Nobuhara, and Ko Nishino, “Appearance and Shape from Water Reflection,” in Proc. of IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, pp. 128–136.     [pdf] [video] [bibtex]
  31. Satoshi Murai, Meng-Yu Jennifer Kuo, Ryo Kawahara, Shohei Nobuhara, and Ko Nishino, “Surface Normals and Shape From Water,” in Proc. of International Conference on Computer Vision (ICCV), 2019, pp. 7829–7837.     (Oral) [pdf] [video] [bibtex]
  32. H. Joo, T. Simon, X. Li, H. Liu, L. Tan, L. Gui, S. Banerjee, T. S. Godisart, B. Nabbe, I. Matthews, T. Kanade, S. Nobuhara, and Y. A. Sheikh, “Panoptic Studio: A Massively Multiview System for Social Interaction Capture,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 41, no. 1, pp. 190–204, 2019. [pdf] [arxiv] [bibtex]
  33. Jinsong Zhang, Rodrigo Verschae, Shohei Nobuhara, and Jean-François Lalonde, “Deep Photovoltaic Nowcasting,” Solar Energy, vol. 176, pp. 267–276, Dec. 2018. [pdf] [arxiv] [bibtex]
  34. Rodrigo Verschae, Hiroaki Kawashima, and Shohei Nobuhara, “A Multi-Camera System for Underwater Real-Time 3D Fish Detection and Tracking,” in IEEE OCEANS, 2017, pp. 1–5.     [pdf] [bibtex]
  35. Rodrigo Verschae, Li Li, Shohei Nobuhara, and Takekazu Kato, “A Sky Image Analysis System for Sub-minute PV Prediction,” in The International 2017 IEEE Photovoltaic Specialists Conference (PVSC-44), 2017.     [pdf] [bibtex]
  36. Kosuke Takahashi, Akihiro Miyata, Shohei Nobuhara, and Takashi Matsuyama, “A Linear Extrinsic Calibration of Kaleidoscopic Imaging System From Single 3D Point,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.     (acceptance ratio: poster 783/2680 = 30%) [pdf] [arxiv] [bibtex]
  37. Ryo Kawahara, Shohei Nobuhara, and Takashi Matsuyama, “Dynamic 3D capture of swimming fish by underwater active stereo,” Methods in Oceanography, vol. 17, pp. 118–137, Dec. 2016. [pdf] [bibtex]
  38. Tomoyuki Mukasa, Shohei Nobuhara, Tony Tung, and Takashi Matsuyama, “Part-wise Geodesic Histogram Shape Descriptor for Unstructured Mesh Series Segmentation,” IPSJ Transactions on Computer Vision and Applications, vol. 8, pp. 29–39, Mar. 2016. [pdf] [bibtex]
  39. Kosuke Takahashi, Shohei Nobuhara, and Takashi Matsuyama, “Mirror-based Camera Pose Estimation Using an Orthogonality Constraint,” IPSJ Transactions on Computer Vision and Applications, vol. 8, pp. 11–19, Feb. 2016. [pdf] [bibtex]
  40. Shohei Nobuhara, Takashi Kashino, Takashi Matsuyama, Kouta Takeuchi, and Kensaku Fujii, “A Single-Shot Multi-Path Interference Resolution for Mirror-Based Full 3D Shape Measurement with a Correlation-Based ToF Camera,” in Proc. of International Conference on 3D Vision (3DV), 2016, pp. 342–350.     [pdf] [bibtex]
  41. Zhaozheng Hu, Takashi Matsuyama, and Shohei Nobuhara, “Cell-based visual surveillance with active cameras for 3D human gaze computation,” Multimedia Tools and Applications, vol. 74, no. 11, pp. 4161–4185, Dec. 2015. [pdf] [bibtex]
  42. Qun Shi, Shohei Nobuhara, and Takashi Matsuyama, “Augmented Motion History Volume for Spatiotemporal Editing of 3-D Video in Multiparty Interaction Scenes,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 1, pp. 63–76, Jan. 2015. [pdf] [bibtex]
  43. Mai Nishimura, Shohei Nobuhara, Takashi Matsuyama, Shinya Shimizu, and Kensaku Fujii, “A Linear Generalized Camera Calibration from Three Intersecting Reference Planes,” in Proc. of International Conference on Computer Vision (ICCV), 2015, pp. 2354–2362.     (acceptance ratio: poster 525/1698 = 30.3%) [pdf] [link] [bibtex]
  44. Tomu Tahara, Ryo Kawahara, Shohei Nobuhara, and Takashi Matsuyama, “Interference-free epipole-centered structured light pattern for mirror-based multi-view active stereo,” in Proc. of International Conference on 3D Vision (3DV), 2015, pp. 153–161.     (acceptance ratio: 50/160) [pdf] [bibtex]
  45. Hanbyul Joo, Hao Liu, Lei Tan, Lin Gui, Bart Nabbe, Iain Matthews, Takeo Kanade, Shohei Nobuhara, and Yaser Sheikh, “Panoptic studio: A massively multiview system for social motion capture,” in Proc. of International Conference on Computer Vision (ICCV), 2015, pp. 3334–3342. (acceptance ratio: oral 56/1698 = 3.3%) [pdf] [bibtex]
  46. Ryo Kawahara, Shohei Nobuhara, and Takashi Matsuyama, “Underwater 3D surface capture using multi-view projectors and cameras with flat housings,” IPSJ Transactions on Computer Vision and Applications, vol. 6, pp. 43–47, Jul. 2014. [link] [bibtex]
  47. Tomoyuki Mukasa, Shohei Nobuhara, Tony Tung, and Takashi Matsuyama, “Tree-structured mesoscopic surface characterization for kinematic structure estimation from 3d video,” IPSJ Transactions on Computer Vision and Applications, vol. 6, pp. 12–24, Jun. 2014. [pdf] [bibtex]
  48. Shohei Nobuhara, Wei Ning, and Takashi Matsuyama, “A Real-Time View-Dependent Shape Optimization for High Quality Free-Viewpoint Rendering of 3D Video,” in Proc. of International Conference on 3D Vision (3DV), 2014, vol. 1, pp. 665–672. (acceptance ratio: 89/176) [pdf] [link] [bibtex]
  49. Tomoyuki Mukasa, Shohei Nobuhara, Tony Tung, and Takashi Matsuyama, “A 3D Shape Descriptor for Segmentation of Unstructured Meshes into Segment-Wise Coherent Mesh Series,” in Proc. of International Conference on 3D Vision (3DV), 2014, vol. 1, pp. 633–640. (acceptance ratio: 89/176) [pdf] [bibtex]
  50. Tomohiko Yano, Shohei Nobuhara, and Takashi Matsuyama, “3d shape from silhouettes in water for online novel-view synthesis,” IPSJ Transactions on Computer Vision and Applications, vol. 5, no. 0, pp. 65–69, Jul. 2013. [pdf] [bibtex]
  51. Qun Shi, Shohei Nobuhara, and Takashi Matsuyama, “Augmented Motion History Volume for Spatiotemporal Editing of 3D Video in Multi-party Interaction Scenes,” in Proc. of International Conference on 3D Vision (3DV), 2013, pp. 414–421. [pdf] [bibtex]
  52. Ryo Kawahara, Shohei Nobuhara, and Takashi Matsuyama, “A Pixel-wise Varifocal Camera Model for Efficient Forward Projection and Linear Extrinsic Calibration of Underwater Cameras with Flat Housings,” in ICCV Workshop on Underwater Vision, 2013, pp. 819–824. Best Paper Award [pdf] [link] [bibtex]
  53. Qun Shi, Shohei Nobuhara, and Takashi Matsuyama, “3D Face Reconstruction and Gaze Estimation from Multi-view Video using Symmetry Prior,” IPSJ Transactions on Computer Vision and Applications, vol. 4, pp. 149–160, Oct. 2012. [pdf] [bibtex]
  54. Kosuke Takahashi, Shohei Nobuhara, and Takashi Matsuyama, “A new mirror-based extrinsic camera calibration using an orthogonality constraint,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 1051–1058. Best Open Source Code Award 2nd Prize [pdf] [link] [bibtex]
  55. Yali Zheng, Shohei Nobuhara, and Yaser Sheikh, “Structure from motion blur in low light,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 2569–2576. [pdf] [bibtex]
  56. Tatsuhisa Yamaguchi, Hiromasa Yoshimoto, Shohei Nobuhara, and Takashi Matsuyama, “Cell-based 3D video capture of a freely-moving object using multi-viewpoint active cameras,” IPSJ Transactions on Computer Vision and Applications, vol. 2, pp. 169–184, Nov. 2010. [pdf] [bibtex]
  57. Shohei Nobuhara, Yuta Kimura, and Takashi Matsuyama, “Object-oriented color calibration of multi-viewpoint cameras in sparse and convergent arrangement,” IPSJ Transactions on Computer Vision and Applications, vol. 2, pp. 132–144, Mar. 2010. [pdf] [bibtex]
  58. Peng Huang, Tony Tung, Shohei Nobuhara, Adrian Hilton, and Takashi Matsuyama, “Comparison of skeleton and non-skeleton shape descriptors for 3d video,” in Proc. of International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), 2010, pp. 1–8. [pdf] [bibtex]
  59. Hideyuki Tamura, Takashi Matsuyama, Naokazu Yokoya, Ryosuke Ichikari, Shohei Nobuhara, and Tomokazu Sato, “Computer vision technology applied to MR-based pre-visualization in filmmaking,” in Proc. of Asian Conference on Computer Vision (ACCV), 2010, pp. 1–10. (Keynote Speech) [pdf] [bibtex]
  60. Shohei Nobuhara, Yoshiyuki Tsuda, Iku Ohama, and Takashi Matsuyama, “Multi-viewpoint silhouette extraction with 3D context-aware error detection, correction, and shadow suppression,” IPSJ Transactions on Computer Vision and Applications, vol. 1, pp. 242–259, Sep. 2009. [pdf] [bibtex]
  61. Tomoyuki Mukasa, Shohei Nobuhara, Atsuto Maki, and Takashi Matsuyama, “Finding kinematic structure in time series volume data,” ELCVIA: Electronic Letters on Computer Vision and Image Analysis, vol. 7, no. 4, pp. 62–72, Apr. 2009. [pdf] [bibtex]
  62. Jonathan Starck, Atsuto Maki, Shohei Nobuhara, Adrian Hilton, and Takashi Matsuyama, “The multiple-camera 3-D production studio,” IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), vol. 19, no. 6, pp. 856–869, Mar. 2009. [pdf] [bibtex]
  63. Tony Tung, Shohei Nobuhara, and Takashi Matsuyama, “Complete multi-view reconstruction of dynamic scenes from probabilistic fusion of narrow and wide baseline stereo,” in Proc. of International Conference on Computer Vision (ICCV), 2009, pp. 1709–1716. [pdf] [bibtex]
  64. Tatsuhisa Yamaguchi, Shohei Nobuhara, and Takashi Matsuyama, “Cell-based object tracking method for 3D shape reconstruction using multi-viewpoint active cameras,” in The 9th IEEE International Workshop on Visual Surveillance (VS2009), 2009, pp. 1306–1313. [pdf] [bibtex]
  65. Tony Tung, Shohei Nobuhara, and Takashi Matsuyama, “Simultaneous super-resolution and 3D video using graph-cuts,” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008, pp. 1–8. [pdf] [bibtex]
  66. Tomoyuki Mukasa, Arata Miyamoto, Shohei Nobuhara, Atsuto Maki, and Takashi Matsuyama, “Complex human motion estimation using visibility,” in Proc. of IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2008, pp. 1–6. [pdf] [bibtex]
  67. T. Matsuyama, S. Nobuhara, T. Mukasa, A. Miyamoto, and K. Fujimoto, “3D Human Sensing,” in International Conference on Informatics Education and Research for Knowledge-Circulating Society, 2008, pp. 41–46. [pdf] [bibtex]
  68. Shohei Nobuhara, Yoshiyuki Tsuda, Takashi Matsuyama, and Iku Ohama, “Multi-viewpoint Silhouette Extraction with 3D Context-aware Error Detection, Correction, and Shadow Suppression,” in 4th European Conference on Visual Media Production (CVMP), 2007, pp. 19–27. [pdf] [bibtex]
  69. Shohei Nobuhara and Takashi Matsuyama, “Deformable mesh model for complex multi-object 3D motion estimation from multi-viewpoint video,” in Proc. of International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), 2006, pp. 264–271. [pdf] [bibtex]
  70. Tomoyuki Mukasa, Shohei Nobuhara, Atsuto Maki, and Takashi Matsuyama, “Finding articulated body in time-series volume data,” in Proc. of International Conference on Articulated Motion and Deformable Objects (AMDO), 2006, pp. 395–404. [pdf] [bibtex]
  71. Takeshi Takai, Shohei Nobuhara, Hiromasa Yoshimoto, and Takashi Matsuyama, “3D video technologies: capturing high fidelity full 3D shape, motion, and texture,” in Proc. of ISMAR Workshop, 2006. [pdf] [bibtex]
  72. Takashi Matsuyama, Xiaojun Wu, Takeshi Takai, and Shohei Nobuhara, “Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video,” Computer Vision and Image Understanding (CVIU), vol. 96, no. 3, pp. 393–434, Dec. 2004. [pdf] [bibtex]
  73. Shohei Nobuhara and Takashi Matsuyama, “Heterogeneous deformation model for 3D shape and motion recovery from multi-viewpoint images,” in Proc. of International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), 2004, pp. 566–573. [pdf] [bibtex]
  74. Takashi Matsuyama, Xiaojun Wu, Takeshi Takai, and Shohei Nobuhara, “Real-Time Generation and High Fidelity Visualization of 3D Video,” in MIRAGE, 2003, pp. 1–10. [pdf] [bibtex]
  75. Shohei Nobuhara and Takashi Matsuyama, “Dynamic 3D shape from multi-viewpoint images using deformable mesh model,” in Proceedings of the 3rd International Symposium on Image and Signal Processing and Analysis, 2003, vol. 1, pp. 192–197. [pdf] [bibtex]

Award