Media Processing

 

Learning Outcomes:

On successful completion of this module, the student should be able to:

1.         Generalise competency in compression theory

2.         Apply compression to a still images, video and audio data to produce a variety of container formats

3.         Demonstrate an understanding of multimedia synchronisation by developing a piece of audio-visual material.

4.         Understand the concepts and issues surrounding delivery of multimedia content over networks

5.         Be able to develop dynamic multimedia software using the Java Media Framework (JMF)

 

Syllabus Content:

The aim of the module is to give the student a deeper understanding of multimedia content by studying compression, format encoding and synchronisation. The concepts surrounding compression theory will be introduced and then expanded through study of some of the common multimedia formats, such as MPEG2, MPEG4, AC3, AAC, JPEG and MP3.The students will use image, video and audio editing tools to gain experience with these formats.

 

The module will introduce the student to the Java Media Framework (JMF API) and its associated player, which are a set of software development tools for the Java platform that allow the dynamic capture, playback, streaming and transcoding of multiple media formats.

 

Particular emphasis will be placed on issues surrounding the delivery of multimedia content in a networked environment, including performance, quality, streaming and dynamic encoding.

 

Continuous assessment will be based on the student delivering professional-grade networked multimedia systems, including dynamic on-the-fly conversion.

 

Pre-requisites:

1.        Basic understanding of computer architecture and of operating systems.

2.        Programming experience in an Object Oriented Programming Language (graduate of a Honours BSc or BEng involving significant programming experience).

 

Indicative syllabus content:

1. Compression

- Algorithmic complexity theory

- Information entropy                                            

- Lossy vs. Lossless compression

- Psychoacoustics

2. Multimedia Encoding Standards

- Still Image (JPEG)

- Video coding standards (MPEG, H.263)

- Audio Coding Standards (MP3, AC3, AAC)

3. Synchronisation

- Temporal relationships

- Merging of Audio, Still Image and Video

4. Multimedia Development

- Java Media Framework

- Design and Develop professional level

multimedia systems

4. Networked Multimedia

- Communication and Networking Issues

- Quality and Performance

- Dynamic Encoding

 

Practical Programme:

This module will be a blend of theory-based lectures and practical laboratories. The focus is on the utility of the concepts discussed in lectures and their application in modern multimedia software development. Practical activities will be very hands-on, with students encouraged to adopt agile methods of development.

 

Assessment shall consist of weekly lab work and two large assignments. The first assignment will ask the student to demonstrate familiarity with the theoretical concepts covered in lectures by creating a piece of synchronised multimedia that contains video, still images and audio. The student will deliver this project in a number of formats reflecting a variety of compression criteria. The second assignment will the development of a dynamic web-based multimedia delivery application using the Java Media Framework.