知镜 Cognispect · 医学文献与研究工作台

SegVLM: Deformable attentive visual enhancement for referring image segmentation using vision-language model

Dalaq A, Behzad M.
Neural Netw · 2026-10-08 · PMID 42868899

文献摘要

Image segmentation is a fundamental task in computer vision that involves partitioning an image into semantically meaningful regions. Referring image segmentation extends this task by using natural language expressions to localize specific objects, requiring the effective integration of visual and linguistic information. In this work, we propose SegVLM, a vision-language model that incorporates architectural enhancements to improve both segmentation accuracy and cross-modal alignment. The model integrates Squeeze-and-Excitation (SE) module for dynamic feature recalibration, deformable convolutions for geometric adaptability, and residual connection for deep feature learning. We also introduce a novel Referring-Aware Fusion (RAF) loss, which balances region-level alignment, boundary precision, and class imbalance. Extensive experiments and ablation studies demonstrate that each component contributes to consistent performance improvements. SegVLM further exhibits strong generalization across diverse datasets and a variety of referring expression scenarios.

在知镜精读原文来源DOI 原文

知镜提供医学文献检索、阅读笔记、人体图谱、统计绘图与研究复现工具。