A new deep wavefront based model for text localization in 3D video

Nandanwar, L, Shivakumara, P, Ramachandra, R, Lu, T, Pal, U, Antonacopoulos, A ORCID: https://orcid.org/0000-0001-9552-0233 and Lu, Y 2021, 'A new deep wavefront based model for text localization in 3D video' , IEEE Transactions on Circuits and Systems for Video Technology, 32 (6) , pp. 3375-3389.

PDF - Accepted Version
Download (6MB) | Preview
[img] PDF - Published Version
Restricted to Repository staff only

Download (1MB)
Access Information: © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.


With the evolution of electronic devices, such as 3D cameras, addressing the challenges of text localization in 3D video (e.g., for indexing) is increasingly drawing the attention of the multimedia and video processing community. Existing methods focus on 2D video and their performance in the presence of the challenges in 3D video, such as shadow areas associated with text and irregularly sized and shaped text, degrades. This paper proposes the first approach that successfully addresses the challenges of 3D video in addition to those of 2D. It employs a number of innovations, among which, the first is the Generalized Gradient Vector Flow (GGVF) for dominant points detection. The second is the Wavefront concept for text candidate point detection from those dominant points. In addition, an Adaptive B-Spline Polygon Curve Network (ABS-Net) is proposed for accurate text localization in 3D videos by constructing tight fitting bounding polygons using text candidate points. Extensive experiments on custom (3D video) and standard datasets (2D video and scene text) show that the proposed method is practical and useful, and overall outperforms existing state-of-the-art methods.

Item Type: Article
Schools: Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Journal or Publication Title: IEEE Transactions on Circuits and Systems for Video Technology
Publisher: IEEE
ISSN: 1051-8215
Related URLs:
Funders: Natural Science Foundation of China, Ministry of Higher Education, Malaysia
Depositing User: Professor Apostolos Antonacopoulos
Date Deposited: 13 Oct 2021 14:11
Last Modified: 17 Aug 2022 08:32
URI: https://usir.salford.ac.uk/id/eprint/61998

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)


Downloads per month over past year