EECS 498/598: Computer Graphics and Generative Models (Winter 2026)

Overview

With the impressive recent performance of machine-generated visual content, studying how to create realistic imagery using traditional and AI-based tools is becoming increasingly important. This course will introduce students to the theoretical and practical foundations of computer graphics, as well as the recent advances in generative models to automate the content creation process. This course is designed to prepare both undergraduate and graduate students to learn how visual content can be created and to prepare for conducting research in a relevant area.

Homeworks

Since this is only the second iteration of this course, there can be errors in the homeworks, and will be fixed as soon as we spot them. If you encounter problems that you think are not caused by your implementation, first check whether your codebase is up to date with the published ones on github. You are welcome to come to the lab sessions for reporting or clarification of such issues.

Schedule

# Date Topic Material
1 Wednesday, Jan. 7 Introduction Slides
2 Monday, Jan. 12 Transformation 1  
3 Wednesday, Jan. 14 Transformation 2  
  Monday, Jan. 19 Martin Luther King Jr. Day Slides (TBD)
4 Wednesday, Jan. 21 Rasterization 1  
5 Monday, Jan. 26 Rasterization 2  
6 Wednesday, Jan. 28 Rasterization 3  
7 Monday, Feb. 2 Rasterization 4  
8 Wednesday, Feb. 4 Ray Tracing 1  
9 Monday, Feb. 9 Ray Tracing 2  
10 Wednesday, Feb. 11 Ray Tracing 3  
11 Monday, Feb. 16 Ray Tracing 4  
12 Wednesday, Feb. 18 Advanced Topics  
13 Monday, Feb. 23 Geometry  
14 Wednesday, Feb. 25 Reconstruction  
  Monday, Mar. 2 Spring Break Slides (TBD)
  Wednesday, Mar. 4 Spring Break Slides (TBD)
15 Monday, Mar. 9 Representations  
16 Wednesday, Mar. 11 Neural Fields 1  
17 Monday, Mar. 16 Neural Fields 2  
18 Wednesday, Mar. 18 Neural Fields 3  
19 Monday, Mar. 23 Neural Fields 4  
20 Wednesday, Mar. 25 Generative Models 1  
21 Monday, Mar. 30 Generative Models 2  
22 Wednesday, Apr. 1 Generative Models 3  
23 Monday, Apr. 6 Generative Models 4  
24 Wednesday, Apr. 8 Guest Lecture
(TBD)
 
25 Monday, Apr. 13 No Class Slides (TBD)
26 Wednesday, Apr. 15 Guest Lecture
(TBD)
 
27 Monday, Apr. 20 Final Exam Slides (TBD)

Syllabus

Scope and Topics

This course is divided into three parts. The first part discusses the fundamentals of graphics, including camera models, rasterization, materials and lighting, ray-tracing, geometry modeling, and texture modeling. The second and third part discuss automating the traditional graphics pipeline using artificial intelligence. The second part focuses on 3D reconstruction, including structure-from-motion, neural radiance fields (NeRF), Gaussian Splatting, etc. The third part discusses theories and practices of generative models, including generative adversarial networks (GANs) and diffusion models and their recent applications to 3D content creation. Each of these topics would involve homework assignments involving individual programming.

Prerequisites

Students taking this course should be comfortable with mathematical expositions and proofs. Familiarity with linear algebra, probability, and multivariate calculus is required. Formally, the students are expected to take (EECS 281) and (MATH 425 or 412 or EECS 301 or IOE 265 or TO 301) and (EECS 351 or MATH 214 or MATH 217 or 296 or 417 or 419 or ROB 101), or be in graduate standings before registering for this course. The generative parts of the course will involve significant deep learning and computer vision, including neural network design and training. Thus, familiarity with deep learning, especially in the context of computer vision, is highly recommended.

Difference between 498/598

While all undergraduate and graduate students will join the same lectures, they will be given the same homework assignments or exams. The final grades will be assigned within the two tracks.

Class Participation

This course expects a great amount of class participation from the students and a significant part of the final grade will be from the participation. Specifically, students are expected to join the lectures in person and participate in in-class discussions and quizzes that happen after each lecture. Students will be expected to contribute to online Q&As and discussions. We will track student participation in the lab sessions and the Piazza discussions and reflect them to the grading accordingly.

Lab sessions

T/TH lab sessions will be a more involved version of office hours and interchangeable between the two time slots. Some of the TAs and instructors will be present to help students with the conceptual and homework-related questions, including hands-on programming aids. We hope it will also serve as a bazaar of knowledge where students exchange ideas/information and help each other.

Piazza

Grading

Your grade will be based on:

Course Policies

Formatting and Submission

Submissions that do not follow these rules (and any additional ones specified in the homeworks) will get a 0.

Collaboration and External Sources

Late Submissions

Our policy is generous. Late homework will be deducted 10% flat rate for 10 days. After that, we will impose 25% penalty (submission more than 10 days late).

Regrades

Exams

There will be a final exam.

Textbooks

There is no required textbook. However, the following textbook is recommended for the course:

Topics Covered

  1. Classical Computer Graphics – 12 sessions
    1. Camera models. Homogenous coordinates. Transformations
    2. Rasterization
    3. Materials and lighting
    4. Ray-tracing. Global Illuminations
    5. Texture mapping
    6. Blender project
  2. 3D Reconstruction (for content capture) – 4 sessions
    1. Structure from motions
    2. Neural implicit representations (neural fields)
    3. Neural radiance fields (NeRF)
    4. NeRF extensions (hybrid representations, dynamic reconstructions, etc)
  3. Generative Models (for content creation) – 6 sessions
    1. Variational autoencoders
    2. Generative adversarial networks (GANs)
    3. Diffusion and score-based models
    4. Flow-based models
    5. Inverse problem-solving with diffusion models
  4. 3D Generative Models (for content creation) – 4 sessions
    1. 3D GANs
    2. Distilling diffusion models for 3D generation
    3. Other 3D generative models