Back to Module List

CMPE2I06 - SOUND AND IMAGE I

Module Code:
CMPE2I06
Department:
Computing Sciences
Credit Value:
20
Level:
2
Organiser:
Dr. Barry Theobald
There has recently been a huge growth in the power and sophistication of tools that enable people to manipulate images and sounds on computers, and the techniques underlying these tools are also key for the development of artificial intelligence. In this module, we study the nature of audio and video signals from devices such as cameras and microphones and how they are captured and represented on a computer. This includes the coverage of essential ideas of topics such as sampling, time, spatial and frequency domains, filtering, Fourier representation etc. and practical work (using MATLAB) on processing sounds and images to e.g. produce effects, extract information from, or recognize a sound or an image.

Lecture notes will be made available a few days before the days of the lecture via Blackboard. Similarly, workshop sheets and laboratory sheets will be made available via Blackboard. For some parts of the module, more detailed handouts will also be made available when the material is better suited for whiteboard presentation, rather than Powerpoint. It is important to note that the lecture notes are not comprehensive, and students are expected to make their own notes from lecturers notes and commentary during lectures.

In seminars, students will be expected to tackle problems individually but with help available from the seminar leader.

Laboratory work (MATLAB programming) will take place during time-tabled laboratory periods using networked personal computers. CMP teaching laboratories running MATLAB are available to CMP students during term time outside time-tabled teaching hours.


Required purchases:

The module is quite broad in content and as such three text books are recommended for reading. Students are advised to browse these books before purchase.

  • Croft, R. Davison & M. Hargreaves: Engineering Mathematics, Addison Wesley.
  • R. Kirk and A A. Hunt: Digital Sound Processing for Music and Multimedia, Focal Press.
  • R. Gonzalez and R. Woods: Digital Image Processing, 3rd Edition, Prentice Hall.

Possible alternative purchases:

Many engineering mathematics books are available which give readers an insight into Fourier methods. Similarly, there are a wide range of books, at varying levels, on sound and image processing.


Submission:

Written coursework should be submitted by following the standard CMP practice. Students are advised to refer to the Guidelines and Hints on Written Work in CMP.

Deadlines:

If coursework is handed in after the deadline day or an agreed extension:
 

 

Work submitted Marks deducted
After 15:00 on the due date and before 15:00 on the day following the due date 10 marks
After 15:00 on the second day after the due date and before 15:00 on the third day after the due date 20 marks
After 15:00 on the third day after the due date and before 15:00 on the 20th day after the due date.  All the marks the work merits if submitted on time (ie no marks awarded) 
After 20 working days Work will not be marked and a mark of zero will be entered


Saturdays and Sundays will NOT be taken into account for the purposes of calculation of marks deducted.

All extension requests will be managed through the LTS Hub. A request for an extension to a deadline for the submission of work for assessment should be submitted by the student to the appropriate Learning and Teaching Service Hub, prior to the deadline, on a University Extension Request Form accompanied by appropriate evidence. Extension requests will be considered by the appropriate Learning and Teaching Service Manager in those instances where (a) acceptable extenuating circumstances exist and (b) the request is submitted before the deadline. All other cases will be considered by a Coursework Coordinator in CMP.

For more details, including how to apply for an extension due to extenuating circumstances download Submission for Work Assessment (PDF, 39KB)
 

Plagiarism:

Plagiarism is the copying or close paraphrasing of published or unpublished work, including    the work of another student; without due acknowledgement. Plagiarism is regarded a serious offence by the University, and all cases will be investigated. Possible consequences of plagiarism include deduction of marks and disciplinary action, as detailed by UEA's Policy on Plagiarism and Collusion.


Module specific:

  • To introduce the basic concepts in the description of signals (amplitude, frequency, phase, bandwidth, power etc.) and the measurement of signals in decibels.
  • To introduce the essential ideas of sound and hearing, and light and vision.
  • To understand how sampling of a signal works, what aliasing is, and the considerations involved in sampling.
  • To understand the connection between mathematical descriptions of audio signals and how this relates to perception as musical sounds.
  • To appreciate and understand the effect that noise has on a signal leading to definition and measurement of the signal to noise ratio.
  • To introduce the idea of Fourier analysis and Fourier transforms at an appropriate level of mathematical detail.
  • To understand how sounds and images can be efficiently represented and thus compressed.
  • To learn how to manipulate and process audio and video signals in MATLAB.

Transferable skills:

  • Skills in the manipulation of sound and image files.
  • Problem solving skills.
  • Scholarship and research skills.
  • MATLAB programming skills.
  • Understand how to use MATLAB for basic computing operations.
  • Carry out research and experimentation leading to a technical report.
  • Understand how the importance of testing and evaluation.

On completion of this module students should be able to:

Subject specific:

  • Understand engineering concepts and terms used in the description of signals and systems, and be familiar with the range of parameters that describe high and low quality signals systems.
  • Understand the processes involved in measuring and capturing signals and know how to avoid the pitfalls associated with poor quality capture.
  • Understand the basic mechanisms of hearing and vision.
  • Understand the concept of Fourier analysis.
  • Understand how to apply simple processing techniques to an audio or video signal to obtain a desired effect.

Total hours: 50

Lectures: 20; hours 20: Content (with provisional weekly schedule)

  1. Introduction to signals
  2. Sound and hearing, light and vision
  3. Audio and video capture - issues of sampling and quantisation
  4. Music processing and MIDI ? relation of signal parameters to musical sounds
  5. Concatenative and model-based methods of synthesising audio signals
  6. Fourier analysis
  7. Reading week
  8. Image coding
  9. Point-wise Image Processing and Linear Filtering
  10. Non-linear Filtering and Edge Detection
  11. Image Warping and Introduction to Computer Vision.
  12. Contingency 

Workshops: 10, hours: 10, Content (with provisional weekly schedule): 

  1. No workshop
  2. No workshop
  3. Sampling and quantisation
  4. Music sysnthesis
  5. Mathematics - calculus required for Fourier analysis
  6. Fourier analysis
  7. Fourier analysis
  8. Introduction to Images
  9. Image coding
  10. Image processing
  11. Image processing
  12. Review of module - question and answer session

Laboratory work: 10; Hours: 20, Content (with provisional weekly schedule)  

  1. No lab 
  2. Introduction to MATLAB
  3. Sound processing using MATLAB
  4. Image processing using MATLAB
  5. Music synthesis 
  6. Fourier synthesis 
  7. Fourier transforms 
  8. Image coding 
  9. Image coding
  10. Image processing 
  11. Image processing 
  12. No lab

This module will be assessed by a combination of coursework and exam. Two practical assignments worth 20% each will form the coursework and an exam will make up the remaining 60% of marks. The first piece of coursework will be based on the imaging part of the module, while the second coursework will be based on the sound processing part of the module.

Details are as follows:

  1. Two pieces of coursework will be set: 
  2. Assignment 1 - Sound: value 20%, set week 3, due week 7, returned week 11. Assignment 2 – Image processing: value 20%, set week 8, due week 12, returned week 3 of exam period.
  3. Exam: 3 hours duration, six questions set from across the entire module content, students are required to answer four.