Kimihiro Hasegawa

[ Email: kimihiro at cs dot cmu dot edu ]
(replace “at” and “dot” with “@” and “.”, respectively)
(Last update: October 6, 2025)

About

I am a Ph.D. student at Language Technologies Institutes, Carnegie Mellon University, advised by Prof. Teruko Mitamura.
My research interest lies in how machines understand, extract, and utilize action/event order information in text and video, e.g., procedural activity understanding and event timeline construction. [CV]

---

Education

• May. 2022 - Present:
  Ph.D. student, Language Technologies Institute, Carnegie Mellon University, advised by Dr. Teruko Mitamura

• May. 2020 - May. 2022:
  Master of Language Technologies, Language Technologies Institute, Carnegie Mellon University, advised by Dr. Teruko Mitamura

• Aug. 2017 - Apr. 2018:
  International Exchange Student, Dietrich School of Arts & Sciences, University of Pittsburgh

• Apr. 2015 - Mar. 2020:
  Undergraduate Student, Department of Computer Science and Systems Engineering, Kobe University, advised by Dr. Tetsuya Takiguchi

---

Publications

• “TAMA: Tool-Augmented Multimodal Agent for Procedural Activity Understanding”
  Kimihiro Hasegawa, Wiradee Imrattanatrai, Masaki Asada, Ken Fukuda, Teruko Mitamura
  arXiv 2025 [arXiv]

• “ProMQA-Assembly: Multimodal Procedural QA Dataset on Assembly”
  Kimihiro Hasegawa, Wiradee Imrattanatrai, Masaki Asada, Susan Holm, Yuran Wang, Vincent Zhou, Ken Fukuda, Teruko Mitamura
  arXiv 2025 [arXiv]

• “ProMQA: Question Answering Dataset for Multimodal Procedural Activity Understanding.”
  Kimihiro Hasegawa, Wiradee Imrattanatrai, Zhi-Qi Cheng, Masaki Asada, Susan Holm, Yuran Wang, Ken Fukuda, Teruko Mitamura
  NAACL 2025 [Paper] [arXiv]

• “A Videoo-grounded Dialogue Dataset and Metric for Event-Driven Activities.”
  Wiradee Imrattanatrai, Masaki Asada, Kimihiro Hasegawa, Zhi-Qi Cheng, Ken Fukuda, Teruko Mitamura
  AAAI 2025 [Paper] [arXiv]

• “Formulation Comparison for Timeline Construction using LLMs.”
  Kimihiro Hasegawa, Nikhil Kandukuri, Susan Holm, Yukari Yamakawa, Teruko Mitamura
  arXiv 2024 [arXiv]

• “Cross-document Event Identity via Dense Annotation.”
  Adithya Pratapa, Zhengzhong Liu, Kimihiro Hasegawa, Linwei Li, Yukari Yamakawa, Shikun Zhang, Teruko Mitamura.
  CoNLL 2021 [Paper]

• “Transfer Learning to Generate Multi-sentence Questions Leveraging Difference between Datasets”
  Kimihiro Hasegawa, Takaaki Matsumoto, Ryoichi Takashima, Tetsuya Takiguchi, Yasuo Ariki, Teruko Mitamura
  NLP 2020 [Poster] [Paper]

• “Anaphora Reasoning Question Generation Using Entity Coreference”
  Kimihiro Hasegawa, Takaaki Matsumoto, Teruko Mitamura
  NLP 2019 [Poster] [Paper]

• “Textual Entailment based Question Generation”
  Takaaki Matsumoto, Kimihiro Hasegawa, Yukari Yamakawa and Teruko Mitamura
  2IS&NLG 2018 [Paper]

---

Research Experience

• May. 2020 - Present @CMU
  
  • Graduate Research Assistant
  • Adviser: Dr. Teruko Mitamura
• Apr. 2019 - Mar. 2020 @Kobe University
  
  • Undergraduate Thesis: “Transfer Learning to Generate Multi-sentence Questions Leveraging Difference Between Datasets”
  • Adviser: Dr. Tetsuya Takiguchi
• May. 2018 - Aug. 2018 @CMU
  
  • Summer Research Intern: Smart Reader project
  • Superviser: Dr. Teruko Mitamura