Seiya Ito  (伊東 聖矢)


I am a researcher at the National Institute of Information and Communications Technology. I received my Doctor of Engineering degree from Aoyama Gakuin University in 2021 under the supervision of Prof. Kazuhiko Sumi. I was previously an assistant professor at Aoyama Gakuin University from 2021 to 2023. My research interests include computer vision, machine learning, and robotics.

[Email] [LinkedIn]



Education

2018.4-2021.3 Dr.Eng., Aoyama Gakuin University
Graduate School of Science and Engineering
2016.4-2018.3 M.S., Aoyama Gakuin University
Graduate School of Science and Engineering
2012.4-2016.3 B.E., Aoyama Gakuin University
Department of Integrated Information Technology

Experience

2023.6-current Researcher, National Institute of Information and Communications Technology (NICT)
Advanced Reality Technology Laboratory, Universal Communication Research Institute
2021.9-2023.5 Assistant Professor, Aoyama Gakuin University
Department of Integrated Information Technology
2021.4-2021.8 Research Fellow of Japan Society for the Promotion of Science (PD),
Aoyama Gakuin University
2020.4-2021.3 Research Fellow of Japan Society for the Promotion of Science (DC2),
Aoyama Gakuin University
2019.9-2021.3 Research Intern, National Institute of Advanced Industrial Science and Technology (AIST)
Artificial Intelligence Research Center (AIRC)
2018.11-2021.3 Research Assistant, Aoyama Gakuin University
Center for Advanced Information technology Research (CAIR)
2017.02-2018.3 Research Intern, Nippon Telegraph and Telephone Corporation
NTT Communication Science Laboratories

Research Interests

Journal Publications

  1. 村田 健悟, 伊東 聖矢, 大原 剛三.
    表現空間における分類複雑性の評価に基づく継続学習分析手法の提案
    人工知能学会論文誌, 2024 (in Japanese).
    (A Novel Analytical Method Based on Classification Complexity in Representation Spaces for Continual Learning)
    [Paper]

  2. 山下 大樹, 村田 健悟, 伊東 聖矢, 大原 剛三.
    使用食材の典型度に頑健な料理画像からのカテゴリと食材の同時推定
    精密工学会誌, 2023 (in Japanese).
    (Category and Ingredients Estimation From Food Image Robust to Typicality of Used Ingredients)
    [Paper]

  3. 伊東 聖矢, 金子 直史, 鷲見 和彦.
    自己教師あり学習を用いた多眼ステレオ
    精密工学会誌, 2020 (in Japanese).
    (Self-Supervised Learning for Multi-View Stereo)
    [Paper]

  4. Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Latent 3D Volume for Joint Depth Estimation and Semantic Segmentation from a Single Image
    Sensors, 2020.
    [Paper]

  5. Junji Takahashi, Masato Kawabe, Seiya Ito, Naoshi Kaneko, Wataro Takahashi, Toshiki Sakamoto, Akihiro Shibata, Yong Yu.
    Image-retrieval Method Using Gradient Dilation Images for Cloud-based Positioning System with 3D Wireframe Map
    Sensors and Materials, 2020.
    [Paper]

  6. 釜田 祐哉, 伊東 聖矢, 金子 直史, 鷲見 和彦.
    食品チラシ画像を用いたレシピ推薦システム
    精密工学会誌, 2019 (in Japanese).
    (Automatic Recipe Recommendation from Food Flyers)
    [Paper][Project Page]

  7. Tomoya Kaneko, Junji Takahashi, Seiya Ito, Yoshito Tobe.
    A Hybrid Map with Permanent 3D Wireframes and Temporal Line Segments toward Long-term Visual Localization
    SICE Journal of Control, Measurement, and System Integration (Special Issue on Fundamentals and Applications of Smart Sensing), 2019.
    [Paper]

  8. 金子 直史, 伊東 聖矢, 鷲見 和彦.
    ClothesAwarePoseNet: 衣服の領域分割を考慮した人物姿勢推定法
    電子情報通信学会論文誌 D (画像の認識・理解特集号), 2018 (in Japanese).
    (ClothesAwarePoseNet: Two-Stream Convolutional Networks for Clothing-Aware Human Pose Estimation)
    [Paper]

  9. Seiya Ito, Naoshi Kaneko, Takeshi Yoshida, and Kazuhiko Sumi.
    Detection of Defective Regions in 3D Reconstruction to Support Image Acquisition
    SICE Journal of Control, Measurement, and System Integretion (Special Issue on Smart Sensing), 2017.
    [Paper]


International Conference

  1. Tomoaki Yamazaki, Seiya Ito, Kouzou Ohara.
    Tailoring Ranking-based Losses to Capture Superior-Subordinate Relationships for Hierarchical Image Classification
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.
    [Paper]

  2. Mami Kikuchi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Learning Part Primitive Degrees for Hierarchical 3D Object Partitioning
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.
    [Paper]

  3. Qin-yuan Zhou, Seiya Ito, Kazuhiko Sumi.
    A Benchmark for 3D Reconstruction with Semantic Completion in Dynamic Environments
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.
    [Paper]

  4. Dhammatorn Wisan, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Background-aware Two-Stream Network for Moving Object Detection
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.
    [Paper]

  5. Yusho Miyashita, Seiya Ito, Kazuhiko Sumi.
    Speeding Up Semantic Scene Completion: A Completion by Region Proposal Approach
    The 30th International Workshop on Frontiers of Computer Vision (IW-FCV 2024), 2024.
    [Paper]

  6. Mami Kikuchi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Part-Level Single-View 3D Shape Reconstruction with Multiple Types of Primitives
    The 16th International Conference on Quality Control by Artificial Vision (QCAV 2023), 2023.
    [Paper]

  7. Dhammatorn Wisan, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Two-stream Network for Moving Object Detection
    The 29th International Workshop on Frontiers of Computer Vision (IW-FCV 2023), 2023.
    [Paper]

  8. Tomoaki Yamazaki*, Seiya Ito*, Kouzou Ohara (* equal contribution).
    Hierarchical Image Classification with Conceptual Hierarchies Generated via Lexical Databases
    The 29th International Workshop on Frontiers of Computer Vision (IW-FCV 2023), 2023.
    [Paper]

  9. Kengo Murata, Seiya Ito, Kouzou Ohara.
    Learning and Transforming General Representations to Break Down Stability-Plasticity Dilemma
    The 16th Asian Conference of Computer Vision (ACCV), 2022.
    [Paper]

  10. Hiroki Kojima, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Multimodal Pseudo-Labeling Under Various Shooting Conditions: Case Study on RGB and IR Images
    The 28th International Workshop on Frontiers of Computer Vision (IW-FCV), 2022.
    [Paper]

  11. Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Dense Panoptic Mapping from RGB-D Sequences in Dynamic Scenes
    The 28th International Workshop on Frontiers of Computer Vision (IW-FCV), 2022.

  12. Seiya Ito, Byeongjun Ju, Naoshi Kaneko, Kazuhiko Sumi.
    Viewpoint-independent Single-view 3D Object Reconstruction using Reinforcement Learning
    The 17th International Conference on Computer Vision Theory and Applications (VISAPP), 2022.
    [Paper]

  13. Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Seeing Farther Than Supervision: Self-supervised Depth Completion in Challenging Environments
    The 17th International Conference on Machine Vision Applications (MVA), 2021.
    [Paper][Code (Not published due to license issues)]

  14. Taku Fujitomi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Bi-directional Recurrent MVSNet for High-resolution Multi-view Stereo
    The 17th International Conference on Machine Vision Applications (MVA), 2021.
    [Paper]

  15. Takafumi Nagi, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Automatic Dataset Collection for Speech-Driven Gesture Generation
    The 15th International Conference on Quality Control by Artificial Vision (QCAV), 2021.
    [Paper]

  16. Gakuto Murayama, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    Reducing Depth Ambiguity in 3D Human Pose and Body Shape Estimation
    The 15th International Conference on Quality Control by Artificial Vision (QCAV), 2021.
    [Paper]

  17. Hiroki Kojima, Naoshi Kaneko, Seiya Ito, Kazuhiko Sumi.
    You Don't Drink a Cupboard: Improving Egocentric Action Recognition with Co-Occurrence of Verbs and Nouns
    The 15th International Conference on Quality Control by Artificial Vision (QCAV), 2021.
    [Paper]

  18. Naoshi Kaneko, Mei Oyamay, Masaki Hayashiz, Seiya Ito, Kazuhiko Sumi.
    Feature Bridging Networks for 3D Human BodyShape Estimation from a Single Depth Map
    The 4th International Conference on Imaging, Vision & Pattern Recognition (IVPR), 2020.
    [Paper]

  19. Ryo Tamura, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Towards Detailed 3D Modeling: Mesh Super-Resolution via Deformation
    The 4th International Conference on Imaging, Vision & Pattern Recognition (IVPR), 2020.
    [Paper]

  20. Yusuke Nakasato, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Complex Nonlinear and Grid-Sampling Harmonic Convolution for Rotation Equivariant Image Recognition
    International Workshop on Frontiers of Computer Vision (IW-FCV), 2020.

  21. Kazunari Takagi, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Boosting Monocular Depth Estimation with Channel Attention and Mutual Learning
    The 3rd International Conference on Imaging, Vision & Pattern Recognition (IVPR), 2019.
    [Paper][Code]

  22. Natsuki Hase, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Data Augmentation for Intra-Class Imbalance with Generative Adversarial Network
    Quality Control by Artificial Vision (QCAV), 2019.
    [Paper]

  23. Nobuhiro Suga, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Multiple Human Tracking with Dual Cost Graphs
    Quality Control by Artificial Vision (QCAV), 2019.
    [Paper]

  24. Masato Fukuzaki, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Robot Grasp Planning with Integration Map of Graspability and Object Occupancy
    International Workshop on Frontiers of Computer Vision (IW-FCV), 2019.
    [Paper]

  25. Kaho Yamada, Seiya Ito, Naoshi Kaneko, Kazuhiko Sumi.
    Human Action Recognition via Body Part Region Segmented Dense Trajectories
    ACCV 2018 Workshop on Attention/Intention Understanding, 2018.
    [Paper]

  26. Seiya Ito*, Naoshi Kaneko*, Yuma Shinohara, Kazuhiko Sumi (* equal contribution).
    Deep Modular Network Architecture for Depth Estimation from Single Indoor Images
    ECCV 2018 Workshop on 3D Reconstruction in the Wild, 2018.
    [Paper]

  27. Seiya Ito, Naoshi Kaneko, Junji Takahashi, and Kazuhiko Sumi.
    Global Localization from a Single Image in Known Indoor Environments
    The 7th International Conference on Informatics, Electronics & Vision (ICIEV), 2018.
    [Paper]


Talk

Domestic Conference


Awards


Grants