Research

Our current major research interest
♦︎ Robot Vision: Imitation learning for robot manipulation with temporal skill abstractors
♦︎ Medical Image Processing: Semi-supervised medical image segmentation regularizing logits between different networks
♦︎ Visual Question and Answering: Visual question generation utilizing image and object-aware captions

Preprint

⌛ (Under Review) “Enhancing Multi-Hop Question Answering through Automatic Prompt Generation with Cycle Consistnecy of Thought,” Engineering Applications of Artificial Intelligence(2023-JCR-IF: 7.5, 5/179, Top 2.5%)
⌛ (Under Review) “Automatic Network Compression via Evolutionary Search-guided Channel Pruning of Deep Convolutional Neural Networks,” Applied Soft Computing(2023-JCR-IF: 7.2, 15/169, Top 8.6%)
⌛ (Under Review) “Pseudo-Supervised Contrastive Clustering,” Applied Sfot Computing(2023-JCR-IF: 7.2, 15/169, Top 8.6%)
⌛ (Under Review) “Enriching Object-aware Image-Text Highlight Information for Visual Question Generation”
⌛ (Under Review) “Extended Consistency Regularization and Morphological Refinement for Semi-supervised 3D Medical Image Segmentation

Published

2025-02

STCNet: Spatio-Temporal Cross Network with subject-aware contrastive learning for hand gesture recognition in surface EMG
STCNet: Spatio-Temporal Cross Network with subject-aware contrastive learning for hand gesture recognition in surface EMG
Jaemo Yang, Doheun Cha, Dong-Gyu Lee, Sangtae Ahn
Computers in Biology and Medicine  ·  2025-02  ·  doi.org/10.1016/j.compbiomed.2024.109525

2025-01

Enhancing clustering representations with positive proximity and cluster dispersion learning
Enhancing clustering representations with positive proximity and cluster dispersion learning
Abhishek Kumar, Dong-Gyu Lee
Information Sciences  ·  2025-01  ·  doi.org/10.1016/j.ins.2024.121277
Deep scene understanding with extended text description for human object interaction detection
Deep scene understanding with extended text description for human object interaction detection
Hye-Seong Hong, Jeong-Cheol Lee, Abhishek Kumar, Sangtae Ahn, Dong-Gyu Lee
Expert Systems With Applications  ·  2025-01  ·  doi.org/10.1016/j.eswa.2024.125297

2024-12

확장된 의미론적 설명을 활용한 제로샷 행동 인식 시스템 및 동작 방법
확장된 의미론적 설명을 활용한 제로샷 행동 인식 시스템 및 동작 방법
이동규, 이정철
대한민국 특허청  ·  2024-12  ·  10-2024-0197118
하위 작업 명세 기반 모방 학습 프레임워크
하위 작업 명세 기반 모방 학습 프레임워크
이정철, 이동규
2024 한국소프트웨어종합학술대회(KSC)  ·  2024-12  ·  N/A
다중 스케일 고주파 오류 맵을 활용한 확산 모델 기반 이미지 초해상화
다중 스케일 고주파 오류 맵을 활용한 확산 모델 기반 이미지 초해상화
서준혁, 이동규
2024 한국소프트웨어종합학술대회(KSC)  ·  2024-12  ·  N/A
우수발표논문
ESC-ZSAR: Expanded Semantics from Categories with Cross-Attention for Zero-Shot Action Recognition
ESC-ZSAR: Expanded Semantics from Categories with Cross-Attention for Zero-Shot Action Recognition
Jeong-Cheol Lee, Dong-Gyu Lee
Expert Systems With Applications  ·  2024-12  ·  doi.org/10.1016/j.eswa.2024.124786

2024-09

부정 샘플 선택 전략을 통한 비지도 학습
부정 샘플 선택 전략을 통한 비지도 학습
윤영우, 이동규
제 5회 한국 인공지능 학술대회(KAIC)  ·  2024-09  ·  N/A

2024-07

A Similarity-based Training Strategy with Network-level Perturbation for Semi-supervised Semantic Segmentation
A Similarity-based Training Strategy with Network-level Perturbation for Semi-supervised Semantic Segmentation
Jong-Bin Chae, Dong-Gyu Lee
International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI)  ·  2024-07  ·  doi.org/10.1007/978-981-97-8705-0_18

2024-06

객체 판단을 위한 레이더 및 열상관측장비의 연계 방안 연구
객체 판단을 위한 레이더 및 열상관측장비의 연계 방안 연구
정성빈, 이기림, 김도영, 경민구, 이창건, 이헌기, 이동규
2024 한국전자통신학회(KIECS)  ·  2024-06  ·  N/A
Integrating Query-aware Segmentation and Cross-Attention for Robust VQA
Integrating Query-aware Segmentation and Cross-Attention for Robust VQA
Wonjun Choi, Sangbeom Lee, Seungyeon Lee, Heechul Jung, Dong-Gyu Lee
IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW)  ·  2024-06  ·  doi.org/10.48550/arXiv.2407.12055
3rd place Winner

2024-04

공공기관 구내식당 식수 예측 모델개발 및 변수 선정 연구
공공기관 구내식당 식수 예측 모델개발 및 변수 선정 연구
정영한, 이동규
KIISE Transactions on Computing Practice  ·  2024-04  ·  N/A
High-density Cluster Core-based K-means Clustering with an Unknown Number of Clusters
High-density Cluster Core-based K-means Clustering with an Unknown Number of Clusters
Abhimanyu Kumar, Abhishek Kumar, Rammohan Mallipeddi, Dong-Gyu Lee
Applied Soft Computing  ·  2024-04  ·  doi.org/10.1016/j.asoc.2024.111419

2024-03

Robust Unsupervised Domain Adaptation by Retaining Confident Entropy via Edge Concatenation
Robust Unsupervised Domain Adaptation by Retaining Confident Entropy via Edge Concatenation
Hye-Seong Hong, Abhishek Kumar, Dong-Gyu Lee
Expert Systems With Applications  ·  2024-03  ·  doi.org/10.1016/j.eswa.2023.122120

2024-02

A Constrained Multi-Objective Evolutionary Algorithm with Clustering based Weight Vector Adaptation
A Constrained Multi-Objective Evolutionary Algorithm with Clustering based Weight Vector Adaptation
Sri Srinivasa Raju M, Saykat Dutta, Rammohan Mallipeddi, Kedar Nath Das, Dong-Gyu Lee
Swarm and Evolutionary Computation  ·  2024-02  ·  doi.org/10.1016/j.swevo.2023.101432

2024-01

준지도학습 기반 의미론적 분할 프레임워크
준지도학습 기반 의미론적 분할 프레임워크
채종빈, 이동규
2024 영상처리 및 이해에 관한 워크샵(IPIU)  ·  2024-01  ·  N/A
범주 텍스트 기반 개방형 어휘 의미론적 분할
범주 텍스트 기반 개방형 어휘 의미론적 분할
이정철, 이동규
2024 영상처리 및 이해에 관한 워크샵(IPIU)  ·  2024-01  ·  N/A

2024

사이클 일관성 기반 멀티홉 질의응답
사이클 일관성 기반 멀티홉 질의응답
이동규, 이승연
한국저작권위원회  ·  31 Oct 2024  ·  C-2024-042456
범주 텍스트 기반 개방형 어휘 의미론적 분할
범주 텍스트 기반 개방형 어휘 의미론적 분할
이동규, 이정철
한국저작권위원회  ·  31 Oct 2024  ·  C-2024-042454
병렬 인공 신경망 구조 기반 준지도학습 의미론적 분할
병렬 인공 신경망 구조 기반 준지도학습 의미론적 분할
이동규, 채종빈
한국저작권위원회  ·  31 Oct 2024  ·  C-2024-042455

2023-12

Rewarded Meta-pruning: Meta Learning with Rewards for Channel Pruning
Rewarded Meta-pruning: Meta Learning with Rewards for Channel Pruning
Athul Shibu, Abhishek Kumar, Heechul Jung, Dong-Gyu Lee
Mathematics  ·  2023-12  ·  doi.org/10.3390/math11234849

2023-11

RSSGLT: Remote Sensing Image Segmentation Network based on Global-Local Transformer
RSSGLT: Remote Sensing Image Segmentation Network based on Global-Local Transformer
Satyawant Kumar, Abhishek Kumar, Dong-Gyu Lee
IEEE Geoscience and Remote Sensing Letters  ·  2023-11  ·  doi.org/10.1109/LGRS.2023.3337879

2023-10

Spherical Search with Epsilon Constraint and Gradient-based Repair Framework for Constrained Optimization
Spherical Search with Epsilon Constraint and Gradient-based Repair Framework for Constrained Optimization
Zhuji Yang, Abhishek Kumar, Rammohan Mallipeddi, Dong-Gyu Lee
Swarm and Evolutionary Computation  ·  2023-10  ·  doi.org/10.1016/j.swevo.2023.101370

2023-09

제로샷 행동 인식을 위한 멀티모달 크로스 어텐션
제로샷 행동 인식을 위한 멀티모달 크로스 어텐션
이정철, 이동규
제 4회 한국 인공지능 학술대회(KAIC)  ·  2023-09  ·  N/A

2023-08

EvolveNet: Evolving Networks by Learning Scale of Depth and Width
EvolveNet: Evolving Networks by Learning Scale of Depth and Width
Athul Shibu, Dong-Gyu Lee
Mathematics  ·  2023-08  ·  doi.org/10.3390/math11163611

2023-06

Learning Scale of Depth and Width for Network Evolution
Learning Scale of Depth and Width for Network Evolution
Athul Shibu, Dong-Gyu Lee
2023 한국컴퓨터종합학술대회(KCC)  ·  2023-06  ·  N/A

2023-04

CMA-ES with Exponential based Multiplicative Covariance Matrix Adaptation for Global Optimization
CMA-ES with Exponential based Multiplicative Covariance Matrix Adaptation for Global Optimization
Bishal Karmakar, Abhishek Kumar, Rammohan Mallipeddi, Dong-Gyu Lee
Swarm and Evolutionary Computation  ·  2023-04  ·  doi.org/10.1016/j.swevo.2023.101296

2023-01

Encoder-Decoder based Segmentation Model for UAV Street Scene Images
Encoder-Decoder based Segmentation Model for UAV Street Scene Images
Satyawant Kumar, Abhishek Kumar, Dong-Gyu Lee
IEEE 41st International Conference on Consumer Electronics (ICCE)  ·  2023-01  ·  doi.org/10.1109/ICCE56470.2023.10043528
Adaptive Margin-based Contrastive Network for Generalized Zero-Shot Learning
Adaptive Margin-based Contrastive Network for Generalized Zero-Shot Learning
Jeong-Cheol Lee, Athul Shibu, Dong-Gyu Lee
IEEE 41st International Conference on Consumer Electronics (ICCE)  ·  2023-01  ·  doi.org/10.1109/ICCE56470.2023.10043553

2023

확장된 텍스트 기반 제로-샷 행동 인식
확장된 텍스트 기반 제로-샷 행동 인식
이동규, 이정철
한국저작권위원회  ·  14 Dec 2023  ·  C-2023-060158
비지도 학습 도메인 적응 의미론적 영상 분할
비지도 학습 도메인 적응 의미론적 영상 분할
이동규, 홍혜성
한국저작권위원회  ·  14 Dec 2023  ·  C-2023-060159
효율적인 집단식사 서비스 제공을 위한 공공기관 구내식당 실데이터 기반의 식수 예측 기계학습 모델연구
효율적인 집단식사 서비스 제공을 위한 공공기관 구내식당 실데이터 기반의 식수 예측 기계학습 모델연구
정영한, 홍혜성, 이정철, 이동규
2023 한국컴퓨터종합학술대회(KCC)  ·  17 Jun 2023  ·  kcc_2023_cafeteria_ml

2022-12

의미론적 영상분할을 위한 강화된 엔트로피 비지도학습 도메인 적응 방법
의미론적 영상분할을 위한 강화된 엔트로피 비지도학습 도메인 적응 방법
홍혜성, 이동규
2022 한국소프트웨어종합학술대회(KSC)  ·  2022-12  ·  ksc_2022_entropy
Adaptive Backward Forward Sweep for Solving Power Flow of Islanded Microgrids
Adaptive Backward/Forward Sweep for Solving Power Flow of Islanded Microgrids
Abhimanyu Kumar, Abhishek Kumar, Rammohan Mallipeddi, Dong-Gyu Lee
Energies  ·  2022-12  ·  doi.org/10.3390/en15249348
Semantic Segmentation of UAV Images based on Transformer Framework with Context Information
Semantic Segmentation of UAV Images based on Transformer Framework with Context Information
Satyawant Kumar, Abhishek Kumar, Dong-Gyu Lee
Mathematics  ·  2022-12  ·  doi.org/10.3390/math10244735

2022-09

Zero-Shot 이미지 분류를 위한 Transferable Contrastive Network에 관한 연구
Zero-Shot 이미지 분류를 위한 Transferable Contrastive Network에 관한 연구
이정철, 이동규
제 3회 한국 인공지능 학술대회(KAIC)  ·  2022-09  ·  kaic_2022_transferable

2022-08

Human Interaction Recognition Framework based on Interacting Body Part Attention
Human Interaction Recognition Framework based on Interacting Body Part Attention
Dong-Gyu Lee, Seong-Whan Lee
Pattern Recognition  ·  2022-08  ·  doi.org/10.1016/j.patcog.2022.108645

2022-03

Joint Semantic Understanding with Multi-level Branch for Driving Perception
Joint Semantic Understanding with Multi-level Branch for Driving Perception
Dong-Gyu Lee, Yoon-Ki Kim
Applied Sciences  ·  2022-03  ·  doi.org/10.3390/app12062877

2022

Learning to Weight Prune Convolutional Neural Networks
Learning to Weight Prune Convolutional Neural Networks
Athul Shibu, Dong-Gyu Lee
2022 한국뇌공학회 하계 Workshop  ·  27 Jun 2022  ·  weight_pruning
Semantic Segmentation Model for UAV Remote Sensing Images
Semantic Segmentation Model for UAV Remote Sensing Images
Satyawant Kumar, Dong-Gyu Lee
2022 한국뇌공학회 하계 Workshop  ·  27 Jun 2022  ·  uav_segmentation

2021-12

SalfMix: A Novel Single Image-Based Data Augmentation Technique Using a Saliency Map
SalfMix: A Novel Single Image-Based Data Augmentation Technique Using a Saliency Map
Jae-Hyeop Choi, Chae-Hyeon Lee, Dong-Gyu Lee, Heechul Jung
Sensors  ·  2021-12  ·  doi.org/10.3390/s21248444

2021-11

Spatio-temporal Weight of Active Region for Human Activity Recognition
Spatio-temporal Weight of Active Region for Human Activity Recognition
Dong-Gyu Lee, Dong-Ok Won
Proc. 6th IAPR/IEEE Asian Conference on Pattern Recognition (ACPR)  ·  2021-11  ·  doi.org/10.1007/978-3-031-02375-0_7
A Mating Selection Based on Modified Strengthened Dominance Relation for NSGA-III
A Mating Selection Based on Modified Strengthened Dominance Relation for NSGA-III
Saykat Dutta, Sri Srinivasa Raju M, Rammohan Mallipeddi, Kedar Nath Das, Dong-Gyu Lee
Mathematics  ·  2021-11  ·  doi.org/10.3390/math9222837

2021-09

금속 표면 결함 탐지 및 영상 분할을 위한 딥러닝 기반의 다중 클래스 결함 학습
금속 표면 결함 탐지 및 영상 분할을 위한 딥러닝 기반의 다중 클래스 결함 학습
박재현, 최우제, 전세호, 이동규
제 2회 한국 인공지능 학술대회(KAIC)  ·  2021-09  ·  kaic_2021_metal_defect

2021-07

Visual Question Answering based on Local-Scene-Aware Referring Expression Generation
Visual Question Answering based on Local-Scene-Aware Referring Expression Generation
Jung-Jun Kim, Dong-Gyu Lee, Jialin Wu, Hong-Gyu Jung, Seong-Whan Lee
Neural Networks  ·  2021-07  ·  doi.org/10.1016/j.neunet.2021.02.001

2020-07

Three-Stream Fusion Network for First-Person Interaction Recognition
Three-Stream Fusion Network for First-Person Interaction Recognition
Ye-Ji Kim, Dong-Gyu Lee, Seong-Whan Lee
Pattern Recognition  ·  2020-07  ·  doi.org/10.1016/j.patcog.2020.107279

2019-01

Prediction of Partially Observed Human Activity based on Pre-trained Deep Representation
Prediction of Partially Observed Human Activity based on Pre-trained Deep Representation
Dong-Gyu Lee, Seong-Whan Lee
Pattern Recognition  ·  2019-01  ·  doi.org/10.1016/j.patcog.2018.08.006

2018-10

First-Person Activity Recognition Based on Three-Stream Deep Features
First-Person Activity Recognition Based on Three-Stream Deep Features
Ye-Ji Kim, Dong-Gyu Lee, Seong-Whan Lee
Proc. 18th IEEE International Conference on Control, Automation and Systems (ICCAS)  ·  2018-10  ·  doi.org/10.48550/arXiv.2002.08219
Oral Presentation

2018-06

행동 패턴 인식 장치, 행동 패턴 인식 방법 및 행동 패턴 분류기 생성 방법
행동 패턴 인식 장치, 행동 패턴 인식 방법 및 행동 패턴 분류기 생성 방법
이동규, 이상준, 이성환
대한민국 특허청  ·  2018-06  ·  10-18728110000

2018-04

Discriminative Context Learning with Gated Recurrent Unit for Group Activity Recognition
Discriminative Context Learning with Gated Recurrent Unit for Group Activity Recognition
Pil-Soo Kim, Dong-Gyu Lee, Seong-Whan Lee
Pattern Recognition  ·  2018-04  ·  doi.org/10.1016/j.patcog.2017.10.037

2017-10

Local Group Relationship Analysis for Group Activity Recognition
Local Group Relationship Analysis for Group Activity Recognition
Dong-Gyu Lee, Pil-Soo Kim, Seong-Whan Lee
Proc. 17th IEEE International Conference on Control, Automation and Systems (ICCAS)  ·  2017-10  ·  doi.org/10.23919/ICCAS.2017.8204447
Oral Presentation

2017-03

객체에 대한 이상 행동 예측 장치 및 이를 이용한 이상 행동 예측 방법
객체에 대한 이상 행동 예측 장치 및 이를 이용한 이상 행동 예측 방법
이동규, 이성환
대한민국 특허청  ·  2017-03  ·  10-17207810000

2016-12

순환 신경망을 이용한 궤적 기반의 단체 행동 인식
순환 신경망을 이용한 궤적 기반의 단체 행동 인식
김필수, 이동규, 이성환
2016 정보과학회 동계학술대회  ·  2016-12  ·  ksc_2016_trajectory
Human Activity Prediction based on Sub-volume Relationship Descriptor
Human Activity Prediction based on Sub-volume Relationship Descriptor
Dong-Gyu Lee, Seong-Whan Lee
Proc. 23rd IAPR/IEEE International Conference on Pattern Recognition (ICPR)  ·  2016-12  ·  doi.org/10.1109/ICPR.2016.7899939

2015-12

3차원 콘볼루션 신경망을 이용한 인간 행동의 시간 분할 및 인식
3차원 콘볼루션 신경망을 이용한 인간 행동의 시간 분할 및 인식
황영태, 이동규, 이성환
제42회 정기총회 및 동계학술 발표회  ·  2015-12  ·  time_partitioning

2015-01

Motion Influence Map for Unusual Human Activity Detection and Localization in Crowded Scenes
Motion Influence Map for Unusual Human Activity Detection and Localization in Crowded Scenes
Dong-Gyu Lee, Heung-Il Suk, Sung-Kee Park, Seong-Whan Lee
IEEE Transactions on Circuits and Systems for Video Technology  ·  2015-01  ·  dio.org/10.1109/TCSVT.2015.2395752

2014-08

Modeling Crowd Motions for Abnormal Activity Detection
Modeling Crowd Motions for Abnormal Activity Detection
Dong-Gyu Lee, Heung-Il Suk, Seong-Whan Lee
Proc. 11th IEEE International Conference on Advanced Videos and Signal Based Surveillance (AVSS)  ·  2014-08  ·  doi.org/10.1109/AVSS.2014.6918689

2014

적응적 광류 필터링에 기반한 군중 영상에서 이상 행동 검출
적응적 광류 필터링에 기반한 군중 영상에서 이상 행동 검출
이동규, 석흥일, 이성환
26회 영상처리 및 이해에 관한 워크샵  ·  11 Feb 2014  ·  crowd_anomaly

2013-11

Crowd Behavior Representation Using Motion Influence Matrix for Anomaly Detection
Crowd Behavior Representation Using Motion Influence Matrix for Anomaly Detection
Dong-Gyu Lee, Heung-Il Suk, Seong-Whan Lee
Proc. 2nd IAPR/IEEE Asian Conference on Pattern Recognition (ACPR)  ·  2013-11  ·  doi.org/10.1109/ACPR.2013.30
Oral Presentation

2013

Crowd Behavior Representation for Anomaly Detection
Crowd Behavior Representation for Anomaly Detection
이동규, 이성환
2013 뇌와 인공지능 심포지엄  ·  20 Feb 2013  ·  crowd_behavior