CS 335 Principles of Multimedia Systems, Fall 2007

This course is to introduce principles and current technologies of multimedia systems. Topics include multimedia systems design, multimedia hardware and software, issues in effectively representing, processing and transmitting multimedia data including text, graphics, sound and music, image and video. Image, video and audio standards such as JPEG, MPEG, H.26x, Dolby Digital and AAC will be reviewed. Applications such as video conferencing, video streaming, multimedia data indexing and retrieval will also be introduced.

Hao Jiang, Fulton 410C, hjiang@cs.bc.edu, 617-552-8983.
Office hours: M 4-5pm, F 2-3pm.

Lecture Schedule (Approximate)

#	Date	Topic	Reference Materials
1	TU 09/04/07	Introduction
2	TH 09/06/07	Digital Image, Audio and Video
3	TU 09/11/07	Tutorials on Multimedia Tools and Libraries (Matlab, SDL, OpenCV and Others)
4	TH 09/13/07	Lossless Compression	Li & Drew, Ch7
5	TU 09/18/07	Lossless compression	Li & Drew, Ch7
6	TH 09/20/07	Lossless Compression Applications	Li & Drew, Ch7
7	TU 09/25/07	Lossy Compression	Li & Drew, Sec8.1-8.4; Sayood, Ch11
8	TH 09/27/07	JPEG Standard	Li & Drew, Ch9
9	TU 10/02/07	Image Processing and Analysis in Multimedia Applications
10	TH 10/04/07	Image Processing and Analysis in Multimedia Applications
11	TU 10/09/07	Audio Analysis, Compression and Standards
12	TH 10/11/07	Audio Analysis, Compression and Standards
13	TU 10/16/07	Motion	Li & Drew, Ch10
14	TH 10/18/07	Video Compression	Li & Drew, Ch10
15	TU 10/23/07	MPEG 1 and 2	Li & Drew, Ch11
16	TH 10/25/07	MPEG4	Li & Drew, Ch12
17	TU 10/30/07	MPEG7 and Others	Li & Drew, Ch12
18	TH 11/01/07	Midterm Exam
19	TU 11/06/07	Multimedia over Network
20	TH 11/08/07	Media Play Out and Timing	Perkins, Ch6
21	TU 11/13/07	Media Synchronization	Perkins, Ch7
22	TH 11/15/07	Error and Congestion Control	Perkins, Ch9
23	TU 11/20/07	Tracking
24	TH 11/22/07	Activity Recognition
25	TU 11/27/07	Content Based Media Retrieval	Multimedia Database
26	TH 11/29/07	Content Based Media Retrieval	Li & Drew, Ch18
27	TU 12/04/07	Project Report
28	TH 12/06/07	Project Report

• Assignments: 32%
• Midterm exam: 28%
• Project: 40%

Assignment 1 (written)	Experimentation of image, audio and video processing using matlab and other tools. (out Sept.11, due Sept.25)
Assignment 2 (programming)	Image Compression (due Oct. 16)
Assignment 3 (programming)	Mutlimedia Interface (due Nov. 15)

Late Penalties

• Assignments are due at the beginning of the specified class time. For each day late, 10% of the total possible points will be deducted. No work will be accepted after 4 days late.

• No text book required. Reference materials from book chapters and papers are available on the course website.

• Fundamentals of Multimedia, by Ze-Nian Li and Marks S. Drew, Prentice-Hall 2004.
• Introduction to Data Compression, by Khalid Sayood.
• Digital Image Processing Using MATLAB, by Rafael C. Gonzalez, Richard E. Woods, Steven L. Eddins.
• JPEG: Still Image Data Compression Standard (Digital Multimedia Standards) (Digital Multimedia Standards) by William B. Pennebaker, Joan L. Mitchell.
• MPEG Video Compression Standard (Digital Multimedia Standards Series) (Digital Multimedia Standards Series) by Chad Fogg, Didier J. LeGall, Joan L. Mitchell, William B. Pennebaker.
• RTP -- Audio and Video for the Internet, by Colin Perkins.