Portrait
Jaeyong Ko
M.S. Student
Industrial Engineering
Seoul National University
Data Science & Business Analytics Lab
About Me

Hi! I am Jaeyong Ko, an M.S. student in Industrial Engineering at Seoul National University, advised by Prof. Pilsung Kang in the Data Science & Business Analytics Lab.

My research focuses on reasoning in LLMs, VLMs, and unified models. Previously, I worked on LLM mathematical reasoning and financial-domain benchmarks. I am currently exploring visual latent reasoning, with the goal of bringing visual thinking from a unified model's generation branch into its understanding branch. Ultimately, I aim to develop unified reasoning models that surpass the combined capabilities of separate, specialized models.

CV
Education
  • Seoul National University
    M.S. in Industrial Engineering
    Sep. 2025 - Present
  • Seoul National University
    B.S. in Industrial Engineering
    Mar. 2019 - Aug. 2025
Publications
Oddin: Latent Visual Reasoning in Unified Multimodal Models via Self-Distillation from Image Generation
Oddin: Latent Visual Reasoning in Unified Multimodal Models via Self-Distillation from Image Generation

Jaeyong Ko*, Hankyeol Kim*, Pilsung Kang (* equal contribution)

LVR @ WACV 2027 Workshop

A unified multimodal model framework that replaces computationally expensive intermediate image generation with compact latent tokens during interleaved text–visual reasoning.

Oddin: Latent Visual Reasoning in Unified Multimodal Models via Self-Distillation from Image Generation
Oddin: Latent Visual Reasoning in Unified Multimodal Models via Self-Distillation from Image Generation

Jaeyong Ko*, Hankyeol Kim*, Pilsung Kang (* equal contribution)

LVR @ WACV 2027 Workshop

A unified multimodal model framework that replaces computationally expensive intermediate image generation with compact latent tokens during interleaved text–visual reasoning.

FinLifeBench: Exhaustive Life-Event History and Financial-State Reconstruction from Longitudinal Banking Dialogue
FinLifeBench: Exhaustive Life-Event History and Financial-State Reconstruction from Longitudinal Banking Dialogue

Hangyeul Lee, Juyoung Oh, Jaeyong Ko, Sunmin Kim, Jaeik Park, Hyunkyu Kim, Jungmin Son, Pilsung Kang

ACM International Conference on AI in Finance (ICAIF 2026)

A benchmark for exhaustive life-event history extraction and financial-state reconstruction from longitudinal banking dialogues.

FinLifeBench: Exhaustive Life-Event History and Financial-State Reconstruction from Longitudinal Banking Dialogue
FinLifeBench: Exhaustive Life-Event History and Financial-State Reconstruction from Longitudinal Banking Dialogue

Hangyeul Lee, Juyoung Oh, Jaeyong Ko, Sunmin Kim, Jaeik Park, Hyunkyu Kim, Jungmin Son, Pilsung Kang

ACM International Conference on AI in Finance (ICAIF 2026)

A benchmark for exhaustive life-event history extraction and financial-state reconstruction from longitudinal banking dialogues.

Cliff Tokens: Analyzing Failure Trigger Tokens in LLM Mathematical Reasoning
Cliff Tokens: Analyzing Failure Trigger Tokens in LLM Mathematical Reasoning

Jaeyong Ko, Jinu Lee, Pilsung Kang, Yukyung Lee

arXiv preprint arXiv:2606.25524 2026

Identifies single-token triggers that can sharply change the success or failure of LLM mathematical reasoning, supporting fine-grained analysis of reasoning reliability.

Cliff Tokens: Analyzing Failure Trigger Tokens in LLM Mathematical Reasoning
Cliff Tokens: Analyzing Failure Trigger Tokens in LLM Mathematical Reasoning

Jaeyong Ko, Jinu Lee, Pilsung Kang, Yukyung Lee

arXiv preprint arXiv:2606.25524 2026

Identifies single-token triggers that can sharply change the success or failure of LLM mathematical reasoning, supporting fine-grained analysis of reasoning reliability.

All publications
Educational Publications
Can a model think VISUALLY?
Can a model think VISUALLY?

Jaeyong Ko, Eunseo Kim, Doehyeon Lee

NeurIPS 2026 Education Track (Accepted)

A visual lecture and hands-on lab compare text-only, visual-only, and interleaved reasoning across four dimensions of unified multimodal models.

Can a model think VISUALLY?
Can a model think VISUALLY?

Jaeyong Ko, Eunseo Kim, Doehyeon Lee

NeurIPS 2026 Education Track (Accepted)

A visual lecture and hands-on lab compare text-only, visual-only, and interleaved reasoning across four dimensions of unified multimodal models.

AI Safety Lives in a Direction: Reading, Breaking, and Repairing Refusal in Multimodal Models
AI Safety Lives in a Direction: Reading, Breaking, and Repairing Refusal in Multimodal Models

Doehyeon Lee, Yoo-Min Jung, Jaeyong Ko

NeurIPS 2026 Education Track (Accepted)

An interactive lecture and lab explore a safety direction in vision-language models by detecting, bypassing, and restoring refusal with projection and activation addition.

AI Safety Lives in a Direction: Reading, Breaking, and Repairing Refusal in Multimodal Models
AI Safety Lives in a Direction: Reading, Breaking, and Repairing Refusal in Multimodal Models

Doehyeon Lee, Yoo-Min Jung, Jaeyong Ko

NeurIPS 2026 Education Track (Accepted)

An interactive lecture and lab explore a safety direction in vision-language models by detecting, bypassing, and restoring refusal with projection and activation addition.

Research Experience
  • Data Science & Business Analytics Lab, SNU
    Master's Student
    Sep. 2025 - Present
  • Ecole Polytechnique de Montreal
    Research Intern
    Apr. 2024 - Aug. 2024
    • Human-centric smart manufacturing workcells for Industry 5.0 applications.
  • Financial Engineering Lab, KAIST
    Research Intern
    Dec. 2023 - Feb. 2024
    • Reinforcement learning applications for goal-based wealth management.
Projects
  • Development of Core Foundation Model and AI Agent Technology for Thermal-Process Manufacturing
    Designed the backbone architecture for the thermal-process foundation model and established an integrated learning framework utilizing domain data and PINN.
    Granted by MOTIE
    Sep. 2026 - Present
  • Duo 2.0: Evaluating LLM Reliability in Long Financial Conversations
    Financial-domain conversational reliability benchmark and LLM-as-a-Judge evaluation.
    Granted by Kakaobank
    Dec. 2025 - Present
  • Development of Advanced Integrated Monitoring Technologies for Laser Welding
    Laser welding anomaly detection with time-series and image multi-modal data.
    Granted by LG Electronics
    Jul. 2025 - Dec. 2025
Other Experience
  • EXGRAM
    Product Manager Intern
    Jul. 2022 - Oct. 2022
    Planned app configurations and push notifications for Veloo.
  • SNU Startup Consulting Group (ACT)
    President & Team Member
    Mar. 2023 - Dec. 2023
    Led student consulting engagements and developed GTM strategies for startup clients.
  • Republic of Korea Army
    Corporal
    Jan. 2021 - Jul. 2022
Teaching
  • Peer Tutoring, SNU
    Course: Production Control (406.310)
    Sep. 2024 - Dec. 2024
  • Peer Tutoring, SNU
    Course: Human Factors Engineering (406.304)
    Sep. 2023 - Dec. 2023
Honors & Awards
  • Excellence Award (Poster Presentation)
    Aug. 2026
    2026 KDMS Summer Conference, Korea Data Mining Society
News
2026
Oddin has been accepted to VR @ WACV 2027.
Oct 29
FinLifeBench has been accepted to ACM ICAIF 2026.
Oct 03
New paper on arXiv: FinLifeBench: Exhaustive Life-Event History and Financial-State Reconstruction from Longitudinal Banking Dialogue
Sep 02
Received the Excellence Award (Poster Presentation) at the 2026 KDMS Summer Conference. 🏆
Aug 25
This homepage is now open. 🎉
Jun 27
New paper on arXiv: Cliff Tokens: Identifying Single-Token Failure Triggers in LLM Mathematical Reasoning
Jun 25