The thematic modelling of subtext

Authors: Hargood, C., Millard, D.E. and Weal, M.J.

Journal: Multimedia Tools and Applications

Volume: 77

Issue: 21

Pages: 28281-28308

eISSN: 1573-7721

ISSN: 1380-7501

DOI: 10.1007/s11042-018-5972-y

Abstract:

Narratives form a key component of multimedia knowledge representation on the Web. However, many existing multimedia narrative systems either ignore the narrative qualities of any media, or focus on the literal depicted content ignoring any subtext. Ignoring narrative subtext can lead to erroneous search results, or automatically remixed content that lacks cohesion. We suggest that subtext can be computationally modeled in terms of Tomashevsky’s hierarchy of themes and motifs. These elements can then be used in a semiotic term expansion algorithm, incorporating knowledge of subtext into search and subsequent narrative generation. We present two experimental applications of this technique. In the first, we use our thematic model in the automatic construction of photo montages from Flickr, comparing it to more traditional term expansion based on co-occurrence, and showing that this improves the perceived relevance of images within the montage. In the second, we use the thematic model in order to automatically identify Flickr images to illustrate short stories, where it dampened the perception of unwanted themes (an effect we describe as reducing thematic noise). Our work is among the first in this space, and shows that thematic subtext can be tackled computationally.

https://eprints.bournemouth.ac.uk/30549/

Source: Scopus

The thematic modelling of subtext

Authors: Hargood, C., Millard, D.E. and Weal, M.J.

Journal: MULTIMEDIA TOOLS AND APPLICATIONS

Volume: 77

Issue: 21

Pages: 28281-28308

eISSN: 1573-7721

ISSN: 1380-7501

DOI: 10.1007/s11042-018-5972-y

https://eprints.bournemouth.ac.uk/30549/

Source: Web of Science (Lite)

The Thematic Modelling of Subtext

Authors: Hargood, C., Millard, D.E. and Weal, M.J.

Journal: Multimedia Tools and Applications

Publisher: Springer Verlag

ISSN: 0942-4962

DOI: 10.1007/s11042-018-5972-y

Abstract:

Narratives form a key component of multimedia knowledge representation on the Web. However, many existing multimedia narrative systems either ignore the narrative qualities of any media, or focus on the literal depicted content ignoring any subtext. Ignoring narrative subtext can lead to erroneous search results, or automatically remixed content that lacks cohesion. We suggest that subtext can be computationally modeled in terms of Tomashevsky's hierarchy of themes and motifs. These elements can then be used in a semiotic term expansion algorithm, incorporating knowledge of subtext into search and subsequent narrative generation. We present two experimental applications of this technique.

In the first, we use our thematic model in the automatic construction of photo montages from Flickr, comparing it to more traditional term expansion based on co-occurrence, and showing that this improves the perceived relevance of images within the montage. In the second, we use the thematic model in order to automatically identify Flickr images to illustrate short stories, where it dampened the perception of unwanted themes (an effect we describe as reducing thematic noise).

Our work is among the fi rst in this space, and shows that thematic subtext can be tackled computationally.

https://eprints.bournemouth.ac.uk/30549/

Source: Manual

The Thematic Modelling of Subtext

Authors: Hargood, C., Millard, D.E. and Weal, M.J.

Journal: Multimedia Tools and Applications

Volume: 77

Issue: 21

Pages: 28281-28308

ISSN: 0942-4962

Abstract:

Narratives form a key component of multimedia knowledge representation on the Web. However, many existing multimedia narrative systems either ignore the narrative qualities of any media, or focus on the literal depicted content ignoring any subtext. Ignoring narrative subtext can lead to erroneous search results, or automatically remixed content that lacks cohesion. We suggest that subtext can be computationally modeled in terms of Tomashevsky's hierarchy of themes and motifs. These elements can then be used in a semiotic term expansion algorithm, incorporating knowledge of subtext into search and subsequent narrative generation. We present two experimental applications of this technique. In the first, we use our thematic model in the automatic construction of photo montages from Flickr, comparing it to more traditional term expansion based on co-occurrence, and showing that this improves the perceived relevance of images within the montage. In the second, we use the thematic model in order to automatically identify Flickr images to illustrate short stories, where it dampened the perception of unwanted themes (an effect we describe as reducing thematic noise). Our work is among the fi rst in this space, and shows that thematic subtext can be tackled computationally.

https://eprints.bournemouth.ac.uk/30549/

Source: BURO EPrints