Issue |
JNWPU
Volume 37, Number 3, June 2019
|
|
---|---|---|
Page(s) | 503 - 508 | |
DOI | https://doi.org/10.1051/jnwpu/20193730503 | |
Published online | 20 September 2019 |
A Bioinspired Visual Saliency Model
一种生物启发的视觉显著模型
1
Key Laboratory of Contemporary Design and Integrated Manufacturing Technology of Ministry of Education, Northwestern Polytechnical University, Xi’an, 710072, China
2
School of Computer Science, Northwestern Polytechnical University, Xi’an, 710129, China
Received:
12
February
2018
This paper presents a bioinspired visual saliency model. The end-stopping mechanism in the primary visual cortex is introduced in to extract features that represent contour information of latent salient objects such as corners, line intersections and line endpoints, which are combined together with brightness, color and orientation features to form the final saliency map. This model is an analog for the processing mechanism of visual signals along from retina, lateral geniculate nucleus(LGN)to primary visual cortex V1:Firstly, according to the characteristics of the retina and LGN, an input image is decomposed into brightness and opposite color channels; Then, the simple cell is simulated with 2D Gabor filters, and the amplitude of Gabor response is utilized to represent the response of complex cell; Finally, the response of an end-stopped cell is obtained by multiplying the response of two complex cells with different orientation, and outputs of V1 and LGN constitute a bottom-up saliency map. Experimental results on public datasets show that our model can accurately predict human fixations, and the performance achieves the state of the art of bottom-up saliency model.
摘要
提出一种生物启发式的视觉显著模型,利用初级视皮层中的end-stopping机制来提取角点、边缘交叉点和线段端点等这些表征潜在显著物体轮廓的特征,将其与亮度、颜色和方向特征合并形成最终显著图。模型模拟了视觉信号从视网膜、侧膝体到初级视皮层的处理机制:首先根据视网膜和侧膝体特性,将图像分解为亮度和对立颜色通道;然后通过2D Gabor滤波模拟简单细胞感受野,Gabor响应振幅用于表示复杂细胞响应;最后V1层end-stopped细胞响应通过不同朝向的复杂细胞响应乘积来计算,V1层和侧膝体的输出共同构成自底向上显著图。公开数据集上的实验结果显示模型能够准确地预测人眼注视点,性能达到了自底向上模型的先进水平。
Key words: bottom-up saliency / visual attention / end-stopping
关键字 : 自底向上显著模型 / 视觉注意力 / end-stopping机制
© 2019 Journal of Northwestern Polytechnical University. All rights reserved.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.