Writer identification and writer retrieval based on NetVLAD with Re‐ranking
Abstract The issue of writer identification and writer retrieval, which is considered a challenging problem in the field of document analysis and recognition is addressed here.. A novel pipeline is proposed for the problem at hand by employing a unified neural network architecture consisting of the...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2022-01-01
|
| Series: | IET Biometrics |
| Online Access: | https://doi.org/10.1049/bme2.12039 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832546703784280064 |
|---|---|
| author | Shervin Rasoulzadeh Bagher BabaAli |
| author_facet | Shervin Rasoulzadeh Bagher BabaAli |
| author_sort | Shervin Rasoulzadeh |
| collection | DOAJ |
| description | Abstract The issue of writer identification and writer retrieval, which is considered a challenging problem in the field of document analysis and recognition is addressed here.. A novel pipeline is proposed for the problem at hand by employing a unified neural network architecture consisting of the ResNet‐20 as a feature extractor and an integrated NetVLAD layer, inspired by the vector of locally aggregated descriptors (VLAD), in the head of the latter part. Having defined this architecture, the triplet semi‐hard loss function is used to directly learn an embedding for individual input image patches. Subsequently, the generalised max‐pooling technique is employed for the aggregation of embedded descriptors of each handwritten image. Also, a novel re‐ranking strategy is introduced for the task of identification and retrieval based on the k‐reciprocal nearest neighbours, and it is shown that the pipeline can benefit tremendously from this step. Experimental evaluation has been done on the three publicly available datasets: the ICDAR 2013, CVL, and KHATT datasets. Results indicate that while the performance was comparable to the state‐of‐the‐art KHATT, the writer identification and writer retrieval pipeline achieve superior performance on the ICDAR 2013 and CVL datasets in terms of mAP. |
| format | Article |
| id | doaj-art-e7507192e7c24237ba478e38f5ede301 |
| institution | Kabale University |
| issn | 2047-4938 2047-4946 |
| language | English |
| publishDate | 2022-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Biometrics |
| spelling | doaj-art-e7507192e7c24237ba478e38f5ede3012025-02-03T06:47:34ZengWileyIET Biometrics2047-49382047-49462022-01-01111102210.1049/bme2.12039Writer identification and writer retrieval based on NetVLAD with Re‐rankingShervin Rasoulzadeh0Bagher BabaAli1School of Mathematics Statistics and Computer Science College of Science University of Tehran Tehran IranSchool of Mathematics Statistics and Computer Science College of Science University of Tehran Tehran IranAbstract The issue of writer identification and writer retrieval, which is considered a challenging problem in the field of document analysis and recognition is addressed here.. A novel pipeline is proposed for the problem at hand by employing a unified neural network architecture consisting of the ResNet‐20 as a feature extractor and an integrated NetVLAD layer, inspired by the vector of locally aggregated descriptors (VLAD), in the head of the latter part. Having defined this architecture, the triplet semi‐hard loss function is used to directly learn an embedding for individual input image patches. Subsequently, the generalised max‐pooling technique is employed for the aggregation of embedded descriptors of each handwritten image. Also, a novel re‐ranking strategy is introduced for the task of identification and retrieval based on the k‐reciprocal nearest neighbours, and it is shown that the pipeline can benefit tremendously from this step. Experimental evaluation has been done on the three publicly available datasets: the ICDAR 2013, CVL, and KHATT datasets. Results indicate that while the performance was comparable to the state‐of‐the‐art KHATT, the writer identification and writer retrieval pipeline achieve superior performance on the ICDAR 2013 and CVL datasets in terms of mAP.https://doi.org/10.1049/bme2.12039 |
| spellingShingle | Shervin Rasoulzadeh Bagher BabaAli Writer identification and writer retrieval based on NetVLAD with Re‐ranking IET Biometrics |
| title | Writer identification and writer retrieval based on NetVLAD with Re‐ranking |
| title_full | Writer identification and writer retrieval based on NetVLAD with Re‐ranking |
| title_fullStr | Writer identification and writer retrieval based on NetVLAD with Re‐ranking |
| title_full_unstemmed | Writer identification and writer retrieval based on NetVLAD with Re‐ranking |
| title_short | Writer identification and writer retrieval based on NetVLAD with Re‐ranking |
| title_sort | writer identification and writer retrieval based on netvlad with re ranking |
| url | https://doi.org/10.1049/bme2.12039 |
| work_keys_str_mv | AT shervinrasoulzadeh writeridentificationandwriterretrievalbasedonnetvladwithreranking AT bagherbabaali writeridentificationandwriterretrievalbasedonnetvladwithreranking |