Automatic Generation of a Coherent Story from a Set of Images

Zainy M. Malakan

Research output: ThesisDoctoral Thesis

62 Downloads (Pure)

Abstract

This dissertation explores vision and language (V&L) algorithms. While (V&L) succeeds in image and video captioning tasks, the dynamic Visual Storytelling Task (VST) remains challenging. VST demands coherent stories from a set of images, requiring grammatical accuracy, flow, and style. The dissertation addresses these challenges. Chapter 2 presents a framework utilizing an advanced language model. Chapters 3 and 4 introduce novel techniques that integrate rich visual representation to enhance generated stories. Chapter 5 introduces a new storytelling dataset with a comprehensive analysis. Chapter 6 proposes a state-of-the-art Transformer-based model for generating coherent and informative story descriptions from image sets.
Original languageEnglish
QualificationDoctor of Philosophy
Awarding Institution
  • The University of Western Australia
Supervisors/Advisors
  • Mian, Ajmal, Supervisor
  • Hassan, Mubashar, Supervisor
Award date9 Jan 2024
DOIs
Publication statusUnpublished - 2024

Fingerprint

Dive into the research topics of 'Automatic Generation of a Coherent Story from a Set of Images'. Together they form a unique fingerprint.

Cite this