CSE 471 Media Processing and Multimedia

Fall, 2007

Charles B. Owen, instructor, cbowen@cse.msu.edu

This is the home page for CSE 471: Media Processing and Multimedia. CSE 471 is taught in the fall of each year. 

This course will study the use of media in computer applications.  Students will study basic signal and image processing and the manipulation of audio, images, and video content. We will learn how to acquire, process, and organize multimedia information.  This will include the use of tools and packages as well as creating your own programs to access and process multimedia data.  Students will also study some artistic and perceptual/cognitive principles relevant to presentation of multimedia information. 

The Collide application A page that describes how to use DirectSound to play sounds in a game Project 2 Videos!

The course syllabus is available in PDF format.

Project 2 Videos!

Course resources

• Course syllabus pdf
• Software requirements
• Sample images
• Sample audio (directory)
• An introduction to XML
• An introduction to Sequencing
• Variable delays tutorial
• Some audio classes
• The Rotoscope Application

Written materials

• Digital Filters
• Gaussian Image Filters
• Image Compositing

Example materials

• Notes.h
• Some example score files
• Audio demonstrations
• The PoleZero program (executable in .zip file)
• The Harmonics program (executable in .zip file)
• The ImageWarp program (executable in .zip file)
• The ImageComposite program (executable in .zip file)

Notice:  The demonstration programs assume the Visual Studio 2005 runtime is available on your machine.  If you do not have Visual Studio 2005 installed, you can install the runtime using this installer.  Please contact me if you have difficulties running any of the this code.

C# and game materials

• Creating a non-convex shape in C# and Direct3D
• The Collide application (project in .zip file)
• Using DirectSound to play sounds in a game

Exams

• Exam 1
• Exam 1 Notes

Lecture sets

1. CSE 471 Media Processing and Multimedia 8-27-07 Powerpoint
2. Sound, Sinusoids, and Spectrum 8-29-07 Powerpoint
3. Sampling and Quantization 9-5-07 Powerpoint
4. Lots of Practical Audio Techniques 9-10-07 Powerpoint
5. Phasors 9-19-07 Powerpoint
6. Digital Filters 9-24-07 Powerpoint
7. Feedback Filters 10-8-07 Powerpoint
8. An Introduction to Digital Images 10-10-07 Powerpoint
9. Image Processing 10-17-07 Powerpoint
10. Image Warping 10-22-07 Powerpoint
11. Compositing 10-24-07 Powerpoint
12. More Warping and Morphing 10-29-07 Powerpoint
13. More Image Processing 11-31-07 Powerpoint
14. Video 11-07-07 Powerpoint
15. Animation Basics 11-12-07 Powerpoint
16. More Animation 11-19-07 Powerpoint

Notice: Some lecture sets are very large because they contain a large number of images. 

Steps

1. Introduction to Visual Studio This step is a tutorial and is not turned in.
2. Some Media data and an Introduction to Time Due 9-7-07
3. Audio Processing Due 9-12-07
4. Audio Filtering Due 9-20-07 *revised*
5. Working and an Image Due 10-18-07
6. Heavy Duty Image Processing Due 10-26-07 *revised*
7. Making Rotoscope persistent Due 11-5-07 *note unusual due date*
8. Introduction to C# and DirectX Due 11-26-07
9. Polygons, Sprites, and Collisions Due 11-30-07

All Steps are due at 11:59pm on the listed due date.

1. Project 1 - A Five-Component Music Synthesizer Due 10-4-07 *revised*
2. Project 2 - Rotoscoping and the Stephen Colbert Green Screen Challenge Due 11-19-07
3. Project 3 - Make Me a Game Due 12-07-07