Bibliography on Multimedia adaptation/Adaptation multimédia (2017-06-06)

Multimedia documents have to be played on multiple device types. Hence, usage and platform diversity requires document adaptation according to execution contexts, not generally predictable at design time. In an earlier work, a semantic framework for multimedia document adaptation was proposed. In this framework, a multimedia document is interpreted as a set of potential executions corresponding to the author specification. To each target device corresponds a set of possible executions complying with the device constraints. In this context, adapting requires to select an execution that satisfies the target device constraints and which is as close as possible from the initial composition. This theoretical adaptation framework does not specifically consider the main multimedia document dimensions, i.e., temporal, spatial and hypermedia. In this paper, we propose a concrete application of this framework on standard multimedia documents. For that purpose, we first define an abstract structure that captures the spatio-temporal and hypermedia dimensions of multimedia documents, and we develop an adaptation algorithm which transforms in a minimal way such a structure according to device constraints. Then, we show how this can be used for adapting concrete multimedia documents in SMIL through converting the documents in the abstract structure, using the adaptation algorithm, and converting it back in SMIL. This can be used for other document formats without modifying the adaptation algorithm.

The diversity of presentation contexts (such as mobile phones, PDAs) for multimedia documents requires the adaptation of document specifications. In an earlier work, we have proposed a semantic adaptation framework for multimedia documents. This framework captures the semantics of the document composition and transforms the relations between multimedia objects according to adaptation constraints. In this paper, we show that capturing only the document composition for adaptation is unsatisfactory because it leads to a limited form of adapted solutions. Hence, we propose to guide adaptation with functional annotations, i.e., annotations related to multimedia objects which express a function in the document. In order to validate this framework, we propose to use RDF descriptions from SMIL documents and adapt such documents with our interactive adaptation prototype.

The multiplication of presentation contexts (such as mobile phones, PDAs) for multimedia documents requires the adaptation of document specifications. In an earlier work, a semantic approach for multimedia document adaptation was proposed. This framework deals with the semantics of the document composition by transforming the relations between multimedia objects. In this chapter, we apply the defined framework to the hypermedia dimension of documents, i.e., hypermedia links between multimedia objects. By considering hypermedia links as particular objects of the document, we adapt the hypermedia dimension with the temporal dimension. However, due to the non-deterministic character of the hypermedia structure, the document is organized in several loosely dependent sub-specifications. To preserve the adaptation framework, we propose a first straightforward strategy that consists of adapting all sub-specifications generated by the hypermedia structure. Nevertheless, this strategy has several drawbacks, e.g., the profile is not able to change between user interactions. Hence, we propose an incremental approach which adapts document sub-specifications step by step according to these interactions. To validate this framework, we adapt real standard multimedia documents such as SMIL documents.

Un document multimédia marie les technologies de l'écrit, de l'image et du son. Actuellement, les documents multimédia doivent pouvoir être exécutés sur de nombreuses plates-formes (téléphones portables, PDA, ordinateurs de bureau, lecteurs de salon...). Cette diversification des utilisations et des supports nécessite l'adaptation des documents à leur contexte d'exécution, parfois imprévisible au moment de la conception du document. Pour s'affranchir des langages ou formats de description multimédia, nous abstrayons les documents en une structure exprimant l'ensemble des relations entre objets du document. Les relations entre objets sont d'ordre temporel, spatial, hypermédia voire inter-dimensionnel, et peuvent être de nature qualitative. Cette structure capture la sémantique des documents car elle est capable de couvrir chacune de ses exécutions potentielles. Dans ce contexte, adapter va consister à calculer un ensemble d'exécutions le plus proche possible de ces exécutions potentielles qui satisfont les contraintes d'adaptation imposées par une plate-forme cible. À cet effet, les relations de la structure abstraite sont modifiées de sorte de satisfaire ces contraintes d'adaptation. Nous montrons, pour chaque dimension du document, comment réaliser ceci de manière réaliste. Afin de montrer l'applicabilité d'une telle approche, nous la développons dans un cadre adapté au standard SMIL pour lequel nous déclinons les adaptations spatiales, temporelles, spatio-temporelles et hypermédia. Nous sommes amenés à développer des techniques spécifiques pour les représentations spatiales et temporelles efficaces. Nous explorons aussi des approches impliquant la suppression d'objets.

The multiplication of presentation contexts (such as mobile phones, PDAs) for multimedia documents requires the adaptation of document specifications. In an earlier work, a semantic framework for multimedia document adaptation was proposed. This framework deals with the semantics of the document composition by transforming the relations between multimedia objects. However, it was lacking the capability of suppressing multimedia objects. In this paper, we extend the proposed adaptation with this capability. Thanks to this extension, we present a method for summarizing multimedia documents. Moreover, when multimedia objects are removed, the resulted document satisfies some properties such as presentation contiguity. To validate our framework, we adapt standard multimedia documents such as SMIL documents.

The World Wide Web can be accessed through a number of different devices, each having its own capabilities and limitations. Additionally, the content of the Web is increasing tremendously in size and variety. Yet, many devices do not embed support for all types of media and formats. Therefore, in order to provide as much information as possible to all kind of devices, media items have to be adapted. In this paper, we propose to adapt them by replacing incompatible media items by others found on the Web. The adapted media items must convey the same message as the original ones, while satisfying the target profile. We present a possible architecture to implement this and we show that search engines can already achieve this to a limited extent. Nonetheless, some results are unsatisfactory because media annotations lack semantics, are partial and are heterogeneous. Hence, we propose to use Semantic Web technologies, such as RDF descriptions, ontologies, ontology merging and matching, in order to select better alternatives, thus improving this adaptation framework.

La multiplication des supports de présentation multimédia entraîne un besoin d'adaptation des documents à leur contexte d'exécution. Nous avons proposé une approche sémantique d'adaptation de documents multimédia qui a été temporellement définie à l'aide de l'algèbre d'intervalles d'Allen. Cet article étend ces précédents travaux à la dimension spatiale des documents SMIL. Notre objectif est de trouver une représentation spatiale qualitative permettant de calculer un ensemble de solutions d'adaptation proche du document initial. La qualité d'une adaptation se mesure à deux niveaux: expressivité des solutions d'adaptation et rapidité de calcul. Dans ce contexte, nous caractérisons la qualité de l'adaptation selon plusieurs types de représentations spatiales existantes. Nous montrons que ces représentations ne permettent pas d'avoir une qualité d'adaptation optimale. Nous proposons alors une nouvelle représentation spatiale suffisament expressive permettant d'adapter rapidement des documents multimédia SMIL.

The multiplication of execution contexts for multimedia documents requires the adaptation of the document specification to the particularities of the contexts. In this paper, we propose to apply a semantic approach for multimedia document adaptation to the spatio-temporal dimension of documents. To guarantee that the adapted document is close to the initial one respecting adaptation constraints, we define proximities for adapting static documents (i.e., documents without animations) and animated documents. Moreover, we show that these proximities can be refined according to multimedia object properties (e.g., images, videos...). The approach is illustrated by an example.

The multiplication of execution contexts for multimedia documents requires the adaptation of document specifications. This paper instantiates our previous semantic approach for multimedia document adaptation to the spatial dimension of multimedia documents. Our goal is to find a qualitative spatial representation that computes, in a reasonable time, a set of adaptation solutions close to the initial document satisfying a profile. The quality of an adaptation can be regarded in two respects: expressiveness of adaptation solutions and computation speed. In this context, we propose a new spatial representation sufficiently expressive to adapt multimedia documents faster.

The multiplication of execution contexts for multimedia documents requires the adaptation of document specifications. We proposed a semantic approach for multimedia document adaptation. This paper extends this framework to the hypermedia dimension of multimedia documents, i.e., hypermedia links between multimedia objects. By considering hypermedia links as particular objects of the document, it is possible to adapt the hypermedia dimension with other dimensions like the temporal one. However, due to the hypermedia structure, several specifications have to be considered. Thus, to preserve our adaptation framework, we propose a first straightforward strategy that consists of adapting all specifications generated by the hypermedia structure. However, we show that this one has several drawbacks, e.g., its high computational costs. Hence, we propose to adapt document specifications step by step according to the user interactions.

Les récentes avancées technologiques permettent aux documents multimédia d'être présentés sur de nombreuses plates-formes (ordinateurs de bureau, PDA, téléphones portables...). Cette diversification des supports a entraîné un besoin d'adaptation des documents à leur contexte d'exécution. Dans [Euzenat2003b], une approche sémantique d'adaptation de documents multimédia a été proposée et temporellement définie à l'aide de l'algèbre d'intervalles d'Allen. Cet article étend ces précédents travaux en les appliquant au langage de spécification de documents multimédia SMIL. Pour cela, des fonctions de traduction de SMIL vers l'algèbre de Allen (et inversement) ont été définies. Celles-ci préservent la proximité entre le document adapté et le document initial. Enfin, ces fonctions ont été articulées avec [Euzenat2003b].

L'essor du multimédia permet le développement de nombreuses applications mariant les technologies de l'écrit, de l'image et du son. D'autre part, les récentes avancées technologiques permettent aux documents multimédia d'être présent sur de nombreuses plates-formes (téléphones portables, PDA, ordinateurs de bureau...). Cette diversification des utilisations et des supports a entraîné un besoin d'adaptation des documents à leur contexte d'exécution. Pour assurer la proximité entre un document adapté et son document source, une approche sémantique a été développée à partir de spécifications qualitatives des documents multimédia. Notre travail consiste à étendre cette approche à un langage exécutable de documents : SMIL. Un document SMIL ne pouvant être directement adapté avec l'approche proposée, nous introduisons diverses transformations des spécifications de documents en SMIL vers des descriptions qualitatives dont nous montrons quÕelles assurent la propriété de neutralité. De plus, l'approche sémantique ayant été initialement appliquée uniquement à la dimension temporelle, nous l'appliquons par la suite à la dimension spatio-temporelle des documents SMIL. Enfin, nous raffinons les mesures de proximité à l'aide de graphes de voisinage adaptés au type d'objets multimédia manipulés ainsi qu'au type de langage de spécification utilisé.

With the proliferation of heterogeneous devices (desktop computers, personal digital assistants, phones), multimedia documents must be played under various constraints (small screens, low bandwidth). Taking these constraints into account with current document models is impossible. Hence, generic source documents must be transformed into documents compatible with the target contexts. Currently, the design of transformations is left to programmers. We propose here a semantic framework, which accounts for multimedia document adaptation in very general terms. A model of a multimedia document is a potential execution of this document and a context defines a particular class of models. The adaptation should then retain the source document models that belong to the class defined by the context if such models exist. Otherwise, the adaptation should produce a document whose models belong to this class and are ``close'' to those of the source documents. We focus on the temporal dimension of multimedia documents and show how adaptation can take advantage of temporal reasoning techniques. Several metrics are given for assessing the proximity of models.