research-article

CFVMNet: A Multi-branch Network for Vehicle Re-identification Based on Common Field of View

Authors:

Yilong YinAuthors Info & Claims

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

Pages 3523 - 3531

https://doi.org/10.1145/3394171.3413541

Published: 12 October 2020 Publication History

Abstract

Vehicle re-identification (re-ID) aims to retrieve the image of the same vehicles across multiple cameras. It has attracted wide attention in the field of computer vision owing to the deployment of surveillance system. However, some unfavorable factors restrict the retrieval accuracy of re-ID; minor inter-class difference and orientation variation are two main issues. In this study, we proposed a multi-branch network based on common field of view (CFVMNet) to address these issues. In the proposed method, we extracted and fused the global and local detail features using four branches and the Batch DropBlock (BDB) strategy to accentuate inter-class difference. We also considered some other attributes (i.e., color, type, and model) in the feature extraction process to make the final features more recognizable. For the issue of orientation variation that could lead to large intra-class difference, we learned two different metrics according to whether there is common field of view of two vehicle images, respectively, which can enable the proposed CFVMNet to focus on different regions. Extensive experiments on two public datasets, VeRi-776 and VehicleID, show that the proposed method outperformed the state-of-the-art approaches to vehicle re-ID.

Supplementary Material

MP4 File (3394171.3413541.mp4)

A presenatation video that outlines our approach

Download
12.50 MB

References

[1]

Yan Bai, Yihang Lou, Feng Gao, Shiqi Wang, Yuwei Wu, and Ling-Yu Duan. 2018. Group-sensitive triplet embedding for vehicle reidentification. IEEE Transactions on Multimedia, Vol. 20, 9 (2018), 2385--2399.

Digital Library

[2]

Aditya Chattopadhay, Anirban Sarkar, Prantik Howlader, and Vineeth N Balasubramanian. 2018. Grad-cam: Generalized gradient-based visual explanations for deep convolutional networks. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 839--847.

[3]

Ruihang Chu, Yifan Sun, Yadong Li, Zheng Liu, Chi Zhang, and Yichen Wei. 2019. Vehicle re-identification with viewpoint-aware metric learning. In Proceedings of the IEEE International Conference on Computer Vision. 8282--8291.

[4]

Zuozhuo Dai, Mingqiang Chen, Xiaodong Gu, Siyu Zhu, and Ping Tan. 2019. Batch DropBlock Network for Person Re-Identification and Beyond. In The IEEE International Conference on Computer Vision (ICCV).

[5]

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248--255.

[6]

Andras Ferencz, Erik G Learned-Miller, and Jitendra Malik. 2005. Building a classification cascade for visual identification from one example. In Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, Vol. 1. IEEE, 286--293.

Digital Library

[7]

Rogerio Schmidt Feris, Behjat Siddiquie, James Petterson, Yun Zhai, Ankur Datta, Lisa M Brown, and Sharath Pankanti. 2011. Large-scale vehicle detection, indexing, and search in urban surveillance videos. IEEE Transactions on Multimedia, Vol. 14, 1 (2011), 28--42.

Digital Library

[8]

Haiyun Guo, Kuan Zhu, Ming Tang, and Jinqiao Wang. 2019. Two-level attention network with multi-grain ranking loss for vehicle re-identification. IEEE Transactions on Image Processing, Vol. 28, 9 (2019), 4328--4338.

[9]

Yanlin Guo, Cen Rao, Supun Samarasekera, Janet Kim, Rakesh Kumar, and Harpreet Sawhney. 2008. Matching vehicles under large pose transformations using approximate 3d models and piecewise mrf model. In 2008 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1--8.

[10]

Bing He, Jia Li, Yifan Zhao, and Yonghong Tian. 2019. Part-regularized near-duplicate vehicle re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3997--4005.

[11]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.

[12]

Alexander Hermans, Lucas Beyer, and Bastian Leibe. 2017. In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737 (2017).

[13]

Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015).

[14]

Sultan Daud Khan and Habib Ullah. 2019. A survey of advances in vision-based vehicle re-identification. Computer Vision and Image Understanding, Vol. 182 (2019), 50--63.

Digital Library

[15]

Pirazh Khorramshahi, Amit Kumar, Neehar Peri, Sai Saketh Rambhatla, Jun-Cheng Chen, and Rama Chellappa. 2019. A dual-path model with adaptive attention for vehicle re-identification. In Proceedings of the IEEE International Conference on Computer Vision. 6132--6141.

[16]

Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).

[17]

Lawrence A Klein, Michael R Kelley, and Milton K Mills. 1997. Evaluation of overhead and in-ground vehicle detector technologies for traffic flow measurement. Journal of Testing and Evaluation, Vol. 25, 2 (1997), 205--214.

[18]

He Lingxiao, Yinggang Wang, Wu Liu, He Zhao, Zhenan Sun, and Jiashi Feng. [n.d.]. Foreground-Aware Pyramid Reconstruction for Alignment-Free Occluded Person Re-Identification. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 8449--8458.

[19]

Hongye Liu, Yonghong Tian, Yaowei Yang, Lu Pang, and Tiejun Huang. 2016a. Deep relative distance learning: Tell the difference between similar vehicles. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2167--2175.

[20]

Wu Liu, Xinchen Liu, Huadomg Ma, and Peng Cheng. 2017a. Beyond human-level license plate super-resolution with progressive vehicle search and domain priori GAN. In Proceedings of the 25th ACM international conference on Multimedia. 1618--1626.

Digital Library

[21]

Xinchen Liu, Wu Liu, Tao Mei, and Huadong Ma. 2017b. Provid: Progressive and multimodal vehicle reidentification for large-scale urban surveillance. IEEE Transactions on Multimedia, Vol. 20, 3 (2017), 645--658.

Digital Library

[22]

Xinchen Liu, Liu Wu, Huadong Ma, and Huiyuan Fu. 2016b. Large-scale vehicle re-identification in urban surveillance videos. In IEEE International Conference on Multimedia and Expo (ICME) 2016.

[23]

Xinchen Liu, Liu Wu, Mei Tao, and Huadong Ma. 2016c. A Deep Learning-Based Approach to Progressive Vehicle Re-identification for Urban Surveillance. In European Conference on Computer Vision.

[24]

Xiaobin Liu, Shiliang Zhang, Qingming Huang, and Wen Gao. 2018. Ram: a region-aware deep model for vehicle re-identification. In 2018 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6.

[25]

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et almbox. 2019. PyTorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems. 8024--8035.

[26]

Weijian Ruan, Wu Liu, Qian Bao, Jun Chen, Yuhao Cheng, and Tao Mei. 2019. Poinet: pose-guided ovonic insight network for multi-person pose tracking. In Proceedings of the 27th ACM International Conference on Multimedia. 284--292.

Digital Library

[27]

Yifan Sun, Liang Zheng, Yi Yang, Qi Tian, and Shengjin Wang. 2018. Beyond part models: Person retrieval with refined part pooling (and a strong convolutional baseline). In Proceedings of the European Conference on Computer Vision (ECCV). 480--496.

Digital Library

[28]

Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2818--2826.

[29]

Zheng Tang, Milind Naphade, Stan Birchfield, Jonathan Tremblay, William Hodge, Ratnesh Kumar, Shuo Wang, and Xiaodong Yang. 2019. PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data. In The IEEE International Conference on Computer Vision (ICCV).

[30]

Guanshuo Wang, Yufeng Yuan, Xiong Chen, Jiwei Li, and Xi Zhou. 2018. Learning discriminative features with multiple granularities for person re-identification. In Proceedings of the 26th ACM international conference on Multimedia. 274--282.

Digital Library

[31]

Zhongdao Wang, Luming Tang, Xihui Liu, Zhuliang Yao, Shuai Yi, Jing Shao, Junjie Yan, Shengjin Wang, Hongsheng Li, and Xiaogang Wang. 2017. Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification. In Proceedings of the IEEE International Conference on Computer Vision. 379--387.

[32]

Nattachai Watcharapinchai and Sitapa Rujikietgumjorn. 2017. Approximate license plate string matching for vehicle re-identification. In 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE, 1--6.

[33]

Dominik Zapletal and Adam Herout. 2016. Vehicle re-identification for automatic video traffic surveillance. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 25--31.

[34]

Qi Zheng, Chao Liang, Wenhua Fang, Da Xiang, Xin Zhao, Chengping Ren, and Jun Chen. 2015. Car re-identification from large scale images using semantic attributes. In 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP). IEEE, 1--5.

[35]

Zhun Zhong, Liang Zheng, Donglin Cao, and Shaozi Li. 2017a. Re-ranking person re-identification with k-reciprocal encoding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1318--1327.

[36]

Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. 2017b. Random erasing data augmentation. arXiv preprint arXiv:1708.04896 (2017).

[37]

Yi Zhou and Ling Shao. 2018. Aware attentive multi-view inference for vehicle re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 6489--6498.

[38]

Jianqing Zhu, Huanqiang Zeng, Jingchang Huang, Shengcai Liao, Zhen Lei, Canhui Cai, and Lixin Zheng. 2019. Vehicle re-identification using quadruple directional deep learning features. IEEE Transactions on Intelligent Transportation Systems (2019).

Cited By

Hu ZSu YRaj RCheng XZhang Z(2025)View-Aware-Based Post-Processing for Vehicle Re-IdentificationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.348437426:1(849-864)Online publication date: Jan-2025
https://doi.org/10.1109/TITS.2024.3484374
Li BLiu PFu LLi JFang JXu ZYu H(2025)Enhancing Vehicle Re-identification by Pair-flexible Pose Guided Vehicle Image SynthesisGreen Energy and Intelligent Transportation10.1016/j.geits.2025.100269(100269)Online publication date: Jan-2025
https://doi.org/10.1016/j.geits.2025.100269
Fawakherji MVazquez EGiampa PBhattarai B(2024)TextAug: Test Time Text Augmentation for Multimodal Person Re-Identification2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)10.1109/WACVW60836.2024.00040(320-329)Online publication date: 1-Jan-2024
https://doi.org/10.1109/WACVW60836.2024.00040
Show More Cited By

Index Terms

CFVMNet: A Multi-branch Network for Vehicle Re-identification Based on Common Field of View
1. Computing methodologies
  1. Machine learning
    1. Machine learning approaches
      1. Neural networks
2. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
      1. Top-k retrieval in databases

Recommendations

Background Segmentation for Vehicle Re-identification
MultiMedia Modeling
Abstract
Vehicle re-identification (Re-ID) is very important in intelligent transportation and video surveillance. Prior works focus on extracting discriminative features from visual appearance of vehicles or using visual-spatio-temporal information. ...
A Progressive Vehicle Re-Identification Method Based on Multiple Attributes Features Fusion
CSAI '22: Proceedings of the 2022 6th International Conference on Computer Science and Artificial Intelligence

Along with the continuous increase of vehicles, various demands of vehicle recognition tasks have emerged for intelligent transportation systems construction. Vehicle re-identification, targeting on vehicle recognition under cross-cameras, has attracted ...
MSFFT: Multi-Scale Feature Fusion Transformer for cross platform vehicle re-identification
Abstract
A vital component of Intelligent Transportation Systems (ITS) is vehicle re-identification, which allows vehicles to be identified across surveillance devices. Re-identification of vehicles is usually done using information collected from ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

October 2020

4889 pages

ISBN:9781450379885

DOI:10.1145/3394171

General Chairs:
Chang Wen Chen
Chinese University of Hong Kong, Shenzhen, China
,
Rita Cucchiara
UNIMORE, Italy
,
Xian-Sheng Hua
Alibaba Group, China
,
Program Chairs:
Guo-Jun Qi
Futurewei Technologies, USA
,
Elisa Ricci
UNITN & Fondazione Bruno Kessler, Italy
,
Zhengyou Zhang
Tencent, China
,
Roger Zimmermann
National University of Singapore, Singapore

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

MM '20

Sponsor:

SIGMM

MM '20: The 28th ACM International Conference on Multimedia

October 12 - 16, 2020

WA, Seattle, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
371
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)2

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hu ZSu YRaj RCheng XZhang Z(2025)View-Aware-Based Post-Processing for Vehicle Re-IdentificationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.348437426:1(849-864)Online publication date: Jan-2025
https://doi.org/10.1109/TITS.2024.3484374
Li BLiu PFu LLi JFang JXu ZYu H(2025)Enhancing Vehicle Re-identification by Pair-flexible Pose Guided Vehicle Image SynthesisGreen Energy and Intelligent Transportation10.1016/j.geits.2025.100269(100269)Online publication date: Jan-2025
https://doi.org/10.1016/j.geits.2025.100269
Fawakherji MVazquez EGiampa PBhattarai B(2024)TextAug: Test Time Text Augmentation for Multimodal Person Re-Identification2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)10.1109/WACVW60836.2024.00040(320-329)Online publication date: 1-Jan-2024
https://doi.org/10.1109/WACVW60836.2024.00040
Liu XQi JChen CBin KZhong P(2024)Relation-Aware Weight Sharing in Decoupling Feature Learning Network for UAV RGB-Infrared Vehicle Re-IdentificationIEEE Transactions on Multimedia10.1109/TMM.2024.340067526(9839-9853)Online publication date: 2024
https://doi.org/10.1109/TMM.2024.3400675
Lian JWang DWu YZhu S(2024)Multi-Branch Enhanced Discriminative Network for Vehicle Re-IdentificationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.331606825:2(1263-1274)Online publication date: Feb-2024
https://doi.org/10.1109/TITS.2023.3316068
Zhao H(2024)Improving Multi-view Vehicle Identification in Complex Scenes using Robust Deep Neural Networks2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC54092.2024.10831273(2587-2592)Online publication date: 6-Oct-2024
https://doi.org/10.1109/SMC54092.2024.10831273
Li BLiu PFu LLi JFang JXu ZYu H(2024)VehicleGAN: Pair-flexible Pose Guided Image Synthesis for Vehicle Re-identification2024 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55156.2024.10588401(447-453)Online publication date: 2-Jun-2024
https://doi.org/10.1109/IV55156.2024.10588401
Xu YLin YHan SLv K(2024)A Viewpoint-aware Channel Selection Method for Vehicle Re-identification2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10651276(1-8)Online publication date: 30-Jun-2024
https://doi.org/10.1109/IJCNN60899.2024.10651276
Jiao YQiu SSun LHan DLi QChen M(2024)DSA-SCGC: A Dual Self-Attention Mechanism based on Space-Channel Grouped Compression for Vehicle Re-Identification2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650480(1-8)Online publication date: 30-Jun-2024
https://doi.org/10.1109/IJCNN60899.2024.10650480
Li HZhu YWang SZhu ZYe JLing X(2024)Occluded person re-identification based on parallel triplet augmentation and parameter-free token spatial attentionMultimedia Tools and Applications10.1007/s11042-024-18882-wOnline publication date: 2-Apr-2024
https://doi.org/10.1007/s11042-024-18882-w
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten