Dynamic adaptive 3D multi-view video streaming over the internet

Increasing throughput rates and technical developments in video streaming over the Internet offer an attractive solution for the distribution of immersive 3D multi-view. Nevertheless, robustness of video streaming is subject to its utilisation of efficient error resiliency and content aware adaptation techniques. Dynamic network characteristics resulting in frequent congestions may prevent video packets from being delivered in a timely manner. Packet delivery failures may become prominent, degrading 3D immersive video experience significantly. In order to overcome this problem, a novel view recovery technique for 3D free-viewpoint video is introduced to maintain 3D video quality in a cost-effective manner. In this concept, the undelivered (discarded) views as a result of adaptation in the network are recovered with high quality at the receiver side, using Side Information (SI) and the delivered frames of neighbouring views. The proposed adaptive 3D multi-view video streaming scheme is tested using Dynamic Adaptive Streaming over HTTP (MPEG-DASH) standard. Tests using the proposed adaptive technique have revealed that the perceptual 3D video quality under adverse network conditions is significantly improved thanks to the utilisation of the extra side information in view recovery.

Dynamic adaptive 3D multi-view video streaming over the internet

Dynamic adaptive 3D multi-view video streaming over the internet

Hybrid LTE Unicast Broadcast

The Long Term Evolution (LTE) networks provides mobile users with perpetually increasing ubiquitous access to a rich selection of high quality multimedia. This work proposes a Hybrid Unicast Broadcast Synchronisation (HUBS) framework which works within the LTE standard to synchronously deliver multi stream video content by monitoring the radio bearer queues to establish a time lead or lag between broadcast and unicast streams. Since unicast and eMBMS share the same radio resources, the number of Sub-Frames allocated to the eMBMS transmission are then dynamically increased or decreased to minimise the average lead/lag time offset between the streams. Dynamic allocation showed improvements for all services across the cell, whilst keeping streams synchronised despite increased user loading.

Application Partitioning Framework in Mobile Cloud Computing

Application offloading is an emerging area focus towards leveraging the huge computation resources available in cloud to avail for the mobile. This research area is quite challenging due to heterogeneity of applications, mobile and cloud resources. Offload becomes even more complex when we take vulnerable nature of wireless communication into account. In our research, we formulated the offloading research problem in terms of contextual modelling of cloud, mobile, application and wireless network in terms of their parameters and then we discuss the feasibility of application partitioning and offloading by representing an application in the form of a graph. We use two application scenarios: ultra-high video coding and large-scale image retrieval.

ACTION-TV: User interaction aware content generation and distribution for next generation social television

User interaction aware content generation and distribution for next generation social television

User interaction aware content generation and distribution for next generation social television

ACTION-TV proposes an innovative mode of user interaction for broadcasting to relax the rigid and passive nature of present broadcasting ecosystems. It has two key aims:

– A group of users can take part in TV shows providing a sense of immersion into the show and seamless engagement with the content;
– Users are encouraged to use TV shows as a mean of social engagement as well as keeping them and their talents more visible across social circles.

These aims will be achieved by developing an advanced digital media access and delivery platform that enables augmenting traditional audio-visual broadcastings with novel interactivity elements to encourage natural engagement with the content. Mixed-reality technologies will be developed to insert users into pre-recorded content, which will be made ‘responsive’ to users’ actions by ingeniously using a set of auxiliary streams. Potentials of media cloud technologies will be harnessed to personalise ACTION-TV-enabled broadcast content for a group of collaborating users based on their actions. As a result, content producers, for the first time, will be able to generate creative media applications with richer content level user interactivity. Cloud-service providers will be able to monetise their infrastructure through leveraging the increased demand for strategically located in-network media processing. Participating users will be able to share personalised content with their social peers. In this way, end users will have access to more engaging personalised content as well as socialise themselves with community members having common interests. ACTION-TV supports a range of applications from an individual trying out a garment in a TV advert to a group of users interactively attending a TV talent show with the convenience of staying at home. However, ways of utilising the proposed interactivity concept are endless and only limited by the imagination of inspiring content producers.

3D video analysis

Interaction with 3D video content

Interaction with 3D video content

One of the main emerging challenges of future multimedia platforms is the development of three-dimensional (3D) display technology, resulting in a plethora of research activities in the video research community focusing on this topic. This emerging technology is capable of bringing a whole new experience to the end user by offering a 3D real immersive feeling experience. However, research towards meaningful user interaction with the real 3D content is still at its early stages.
Having this in mind, the main aim of this research activity is to provide a comprehensive understanding and investigation about how to develop an interactive 3D video platform that delivers intuitive interaction with 3D video content. The key elements of the proposed platform include effective interaction with the content and the design of appropriate UI modality. Moreover, in order to specify the requirement for the designs, a number of studies into the implication of the 3D content delivery mechanism as well as the best user practices are being conducted.

FreeEye photo and video browsing interface

FreeEye browsing interface

FreeEye browsing interface

Intuitive interfaces have become increasingly important multimedia applications, from personal photo collection to professional management systems. This research brings a novel intuitive interactive interface for browsing of large image and video collections that visualizes underlying structure of the dataset by its size and spatial relations. In order to achieve this, images/frames are initially clustered using an unsupervised graph-based clustering algorithm. By selecting images in a hierarchical layout of the screen, user can intuitively navigate through the collection. The experimental results demonstrate a significant speed-up in a content search scenario compared to a standard browsing interface, as well as inherent intuitiveness of the system.