Projects per year
Abstract
The evaluation of image caption quality is a challenging task, which requires the assessment of two main aspects in a caption: adequacy and fluency. These quality aspects can be judged using a combination of several linguistic features. However, most of the current image captioning metrics focus only on specific linguistic facets, such as the lexical or semantic, and fail to meet a satisfactory level of correlation with human judgements at the sentence-level. We propose a learning-based framework to incorporate the scores of a set of lexical and semantic metrics as features, to capture the adequacy and fluency of captions at different linguistic levels. Our experimental results demonstrate that composite metrics draw upon the strengths of standalone measures to yield improved correlation and accuracy.
Original language | English |
---|---|
Title of host publication | Proceedings of ACL 2018, Student Research Workshop |
Place of Publication | Australia |
Publisher | Association for Computational Linguistics |
Pages | 14-20 |
Number of pages | 7 |
ISBN (Electronic) | 9781948087360 |
Publication status | Published - 2018 |
Event | 56th Annual Meeting of Association for Computational Linguistics - Melbourne, Australia Duration: 15 Jul 2018 → 20 Jul 2018 |
Conference
Conference | 56th Annual Meeting of Association for Computational Linguistics |
---|---|
Abbreviated title | ACL2018 |
Country/Territory | Australia |
City | Melbourne |
Period | 15/07/18 → 20/07/18 |
Fingerprint
Dive into the research topics of 'Learning-based Composite Metrics for Improved Caption Evaluation'. Together they form a unique fingerprint.Projects
- 1 Finished
-
Advanced 3D Computer Vision Algorithms for 'Find and Grasp' Future Robots
Bennamoun, M. (Investigator 01)
ARC Australian Research Council
1/01/15 → 31/12/20
Project: Research