Portrait of Seiya Ito

Seiya Ito 伊東 聖矢

NICT ARTL (Kyoto/Tokyo)

Researcher in Computer Vision, Machine Learning, and Robotics.

About

I am a researcher at the National Institute of Information and Communications Technology.
I received my Doctor of Engineering from Aoyama Gakuin University in 2021 under the supervision of Prof. Kazuhiko Sumi. I was an assistant professor at Aoyama Gakuin University from 2021 to 2023. My research interests include computer vision, machine learning, and robotics.

Research Interests

  • 3D Reconstruction
  • Depth Estimation
  • Semantic Segmentation

News

2025/06/16
One paper has been accepted to IROS 2025.
2025/06/10
Two papers have been accepted to MVA 2025.
2024/11/23
One paper has been accepted to QCAV 2025.
2024/02/19
Our paper received the Excellent Research Paper Award at IW-FCV 2025.
2023/06/01
Started as a researcher at NICT.

Education

Dr.Eng.2018.4 – 2021.3
Aoyama Gakuin University
Graduate School of Science and Engineering
M.S.2016.4 – 2018.3
Aoyama Gakuin University
Graduate School of Science and Engineering
B.E.2012.4 – 2016.3
Aoyama Gakuin University
Department of Integrated Information Technology

Experience

Researcher2023.6 – current
National Institute of Information and Communications Technology (NICT)
Advanced Reality Technology Laboratory (ARTL), Universal Communication Research Institute (UCRI)
Visiting Researcher2023.10 – current
Aoyama Gakuin University
Assistant Professor2021.9 – 2023.5
Aoyama Gakuin University
Department of Integrated Information Technology
JSPS Research Fellow (PD/DC2)2020.4 – 2022.3
Aoyama Gakuin University
Research Intern2019.9 – 2021.3
National Institute of Advanced Industrial Science and Technology (AIST)
Artificial Intelligence Research Center (AIRC)
Research Assistant2018.11 – 2021.3
Aoyama Gakuin University
Center for Advanced Information Technology Research (CAIR)

Publications

  1. Tomoaki Yamazaki, Seiya Ito, Kouzou Ohara.
    Evaluation of Sense Embeddings with Optimized Vector-Meaning Correspondence
    IEICE Transactions on Information and Systems, 2025.
    [Paper]

  2. Wisan Dhammatorn, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Combining Instance Segmentation and Background Subtraction Models for Small Object Detection
    International Journal of Automation Technology, 2025.
    [Paper]

  3. 村上 紀超, 山崎 禎晃, 伊東 聖矢, 大原 剛三.
    画像分類における誤分類リスクを考慮した敵対的学習
    精密工学会誌, 2025 (in Japanese).
    (Adversarial Training with Misclassification Risk in Image Classification)
    [Paper]

  4. 村田 健悟, 伊東 聖矢, 大原 剛三.
    表現空間における分類複雑性の評価に基づく継続学習分析手法の提案
    人工知能学会論文誌, 2024 (in Japanese).
    (A Novel Analytical Method Based on Classification Complexity in Representation Spaces for Continual Learning)
    [Paper]

  5. 山下 大樹, 村田 健悟, 伊東 聖矢, 大原 剛三.
    使用食材の典型度に頑健な料理画像からのカテゴリと食材の同時推定
    精密工学会誌, 2023 (in Japanese).
    (Category and Ingredients Estimation From Food Image Robust to Typicality of Used Ingredients)
    [Paper]

  6. 伊東 聖矢, 金子 直史, 鷲見 和彦.
    自己教師あり学習を用いた多眼ステレオ
    精密工学会誌, 2020 (in Japanese).
    (Self-Supervised Learning for Multi-View Stereo)
    [Paper]

  7. Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Latent 3D Volume for Joint Depth Estimation and Semantic Segmentation from a Single Image
    Sensors, 2020.
    [Paper]

  8. Junji Takahashi, Masato Kawabe, Seiya Ito, Naoshi Kaneko, Wataro Takahashi, Toshiki Sakamoto, Akihiro Shibata, Yong Yu.
    Image-retrieval Method Using Gradient Dilation Images for Cloud-based Positioning System with 3D Wireframe Map
    Sensors and Materials, 2020.
    [Paper]

  9. 釜田 祐哉, 伊東 聖矢, 金子 直史, 鷲見 和彦.
    食品チラシ画像を用いたレシピ推薦システム
    精密工学会誌, 2019 (in Japanese).
    (Automatic Recipe Recommendation from Food Flyers)
    [Paper][Project Page]

  10. Tomoya Kaneko, Junji Takahashi, Seiya Ito, Yoshito Tobe.
    A Hybrid Map with Permanent 3D Wireframes and Temporal Line Segments toward Long-term Visual Localization
    SICE Journal of Control, Measurement, and System Integration (Special Issue on Fundamentals and Applications of Smart Sensing), 2019.
    [Paper]

  11. 金子 直史, 伊東 聖矢, 鷲見 和彦.
    ClothesAwarePoseNet: 衣服の領域分割を考慮した人物姿勢推定法
    電子情報通信学会論文誌 D (画像の認識・理解特集号), 2018 (in Japanese).
    (ClothesAwarePoseNet: Two-Stream Convolutional Networks for Clothing-Aware Human Pose Estimation)
    [Paper]

  12. Seiya Ito, Naoshi Kaneko, Takeshi Yoshida, and Kazuhiko Sumi.
    Detection of Defective Regions in 3D Reconstruction to Support Image Acquisition
    SICE Journal of Control, Measurement, and System Integretion (Special Issue on Smart Sensing), 2017.
    [Paper]

  1. Keisuke Yamashita, Seiya Ito, Tomoaki Yamazaki, Kouzou Ohara.
    Scene Recognition Meets Knowledge Graphs: Enhancing Rubustness to Object Diversity
    The 19th International Conference on Machine Vision Application (MVA 2025), 2025.
    [Paper]

  2. Yuta Irisawa, Seiya Ito, Tomoaki Yamazaki, Ken Sakurada, Ryuhei Hamaguchi, Masaki Onishi, Kouzou Ohara.
    Viewpoint-Aware 3D Dense Captioning
    The 19th International Conference on Machine Vision Application (MVA 2025), 2025.
    [Paper]

  3. Kakeru Ohkuchi, Tomoaki Yamazaki, Seiya Ito, Kouzou Ohara.
    Exploiting Class Vulnerabilities: Targeted Mislabeling Attack in Object Detection
    The 16th International Conference on Quality Control by Artificial Vision (QCAV 2025), 2025.
    [Paper]

  4. Tomoaki Yamazaki, Seiya Ito, Kouzou Ohara.
    Tailoring Ranking-based Losses to Capture Superior-Subordinate Relationships for Hierarchical Image Classification
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.

  5. Mami Kikuchi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Learning Part Primitive Degrees for Hierarchical 3D Object Partitioning
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.

  6. Qin-yuan Zhou, Seiya Ito, Kazuhiko Sumi.
    A Benchmark for 3D Reconstruction with Semantic Completion in Dynamic Environments
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.
    [Paper][Code]

  7. Dhammatorn Wisan, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Background-aware Two-Stream Network for Moving Object Detection
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.

  8. Yusho Miyashita, Seiya Ito, Kazuhiko Sumi.
    Speeding Up Semantic Scene Completion: A Completion by Region Proposal Approach
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.

  9. Mami Kikuchi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Part-Level Single-View 3D Shape Reconstruction with Multiple Types of Primitives
    The 16th International Conference on Quality Control by Artificial Vision (QCAV 2023), 2023.
    [Paper]

  10. Dhammatorn Wisan, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Two-stream Network for Moving Object Detection
    The 29th International Workshop on Frontiers of Computer Vision (IW-FCV 2023), 2023.

  11. Tomoaki Yamazaki*, Seiya Ito*, Kouzou Ohara (* equal contribution).
    Hierarchical Image Classification with Conceptual Hierarchies Generated via Lexical Databases
    The 29th International Workshop on Frontiers of Computer Vision (IW-FCV 2023), 2023.

  12. Kengo Murata, Seiya Ito, Kouzou Ohara.
    Learning and Transforming General Representations to Break Down Stability-Plasticity Dilemma
    The 16th Asian Conference of Computer Vision (ACCV 2022), 2022.
    [Paper]

  13. Hiroki Kojima, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Multimodal Pseudo-Labeling Under Various Shooting Conditions: Case Study on RGB and IR Images
    The 28th International Workshop on Frontiers of Computer Vision (IW-FCV 2022), 2022.
    [Paper]

  14. Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Dense Panoptic Mapping from RGB-D Sequences in Dynamic Scenes
    The 28th International Workshop on Frontiers of Computer Vision (IW-FCV 2022), 2022.

  15. Seiya Ito, Byeongjun Ju, Naoshi Kaneko, Kazuhiko Sumi.
    Viewpoint-independent Single-view 3D Object Reconstruction using Reinforcement Learning
    The 17th International Conference on Computer Vision Theory and Applications (VISAPP 2022), 2022.
    [Paper]

  16. Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Seeing Farther Than Supervision: Self-supervised Depth Completion in Challenging Environments
    The 17th International Conference on Machine Vision Applications (MVA 2021), 2021.
    [Paper][Code (Not published due to license issues)]

  17. Taku Fujitomi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Bi-directional Recurrent MVSNet for High-resolution Multi-view Stereo
    The 17th International Conference on Machine Vision Applications (MVA 2021), 2021.
    [Paper]

  18. Takafumi Nagi, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Automatic Dataset Collection for Speech-Driven Gesture Generation
    The 15th International Conference on Quality Control by Artificial Vision (QCAV 2021), 2021.
    [Paper]

  19. Gakuto Murayama, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Reducing Depth Ambiguity in 3D Human Pose and Body Shape Estimation
    The 15th International Conference on Quality Control by Artificial Vision (QCAV 2021), 2021.
    [Paper]

  20. Hiroki Kojima, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    You Don't Drink a Cupboard: Improving Egocentric Action Recognition with Co-Occurrence of Verbs and Nouns
    The 15th International Conference on Quality Control by Artificial Vision (QCAV 2021), 2021.
    [Paper]

  21. Naoshi Kaneko, Mei Oyamay, Masaki Hayashiz, Seiya Ito, Kazuhiko Sumi.
    Feature Bridging Networks for 3D Human BodyShape Estimation from a Single Depth Map
    The 4th International Conference on Imaging, Vision & Pattern Recognition (IVPR 2020), 2020.
    [Paper]

  22. Ryo Tamura, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Towards Detailed 3D Modeling: Mesh Super-Resolution via Deformation
    The 4th International Conference on Imaging, Vision & Pattern Recognition (IVPR 2020), 2020.
    [Paper]

  23. Yusuke Nakasato, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Complex Nonlinear and Grid-Sampling Harmonic Convolution for Rotation Equivariant Image Recognition
    International Workshop on Frontiers of Computer Vision (IW-FCV 2020), 2020.

  24. Kazunari Takagi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Boosting Monocular Depth Estimation with Channel Attention and Mutual Learning
    The 3rd International Conference on Imaging, Vision & Pattern Recognition (IVPR), 2019.
    [Paper][Code]

  25. Natsuki Hase, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Data Augmentation for Intra-Class Imbalance with Generative Adversarial Network
    Quality Control by Artificial Vision (QCAV 2019), 2019.
    [Paper]

  26. Nobuhiro Suga, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Multiple Human Tracking with Dual Cost Graphs
    Quality Control by Artificial Vision (QCAV), 2019.
    [Paper]

  27. Masato Fukuzaki, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Robot Grasp Planning with Integration Map of Graspability and Object Occupancy
    International Workshop on Frontiers of Computer Vision (IW-FCV), 2019.
    [Paper]

  28. Kaho Yamada, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Human Action Recognition via Body Part Region Segmented Dense Trajectories
    ACCV 2018 Workshop on Attention/Intention Understanding, 2018.
    [Paper]

  29. Seiya Ito*, Naoshi Kaneko*, Yuma Shinohara, Kazuhiko Sumi (* equal contribution).
    Deep Modular Network Architecture for Depth Estimation from Single Indoor Images
    ECCV 2018 Workshop on 3D Reconstruction in the Wild, 2018.
    [Paper]

  30. Seiya Ito, Naoshi Kaneko, Junji Takahashi, and Kazuhiko Sumi.
    Global Localization from a Single Image in Known Indoor Environments
    The 7th International Conference on Informatics, Electronics & Vision (ICIEV), 2018.
    [Paper]

  • Talk: 伊東 聖矢[特別講演] 画像を用いた環境のセマンティックモデリング (2023)
  • Domestic Conference: 52 papers

Awards

  • 2024 Excellent Research Paper Award in IW-FCV2024.
  • 2022 MIRU Interactive Presentation Award.
  • 2022 Interactive Session Audience Award in SSII 2022.
  • 2019 Best Paper Award in IVPR2019.
  • 2019 Best poster presentation award in IW-FCV2019.
  • 2018 Best Master Thesis Award, Aoyama Gakuin University.
  • 2016 Student Encouragement Award of 78th IPSJ National Convention.
  • 2016 Best Graduation Thesis Award, Aoyama Gakuin University.

Grants

  • JSPS Grant-in-Aid for Early-Career Scientists [Apr. 2022 - Mar. 2024] (link)
  • JSPS Research Fellowships for Young Scientists (DC2/PD) [Apr. 2020 - Mar. 2022]
  • 2019 Early Eagle Program, Aoyama Gakuin University (PI)
  • 2018 Early Eagle Program, Aoyama Gakuin University (PI)

Selected Projects

Contact