This schedule is preliminary and subject to change as the term evolves.

Lecture Date Topic Suggested Reading Assignments
WEEK 1
1 Mon 01/13/2025 Introduction (Ioannis, Shubham) Assignment 0 Out
2 Wed 01/15/2025 3D Representations I (Ioannis)
WEEK 2
3 Wed 01/22/2025 3D Representations II (Shubham) Assignment 0 Due
Assignment 1 Out
Fri 01/24/2025 Pytorch3D Tutorial (NSH 3002, 4-5pm) colab notebook
WEEK 3
4 Mon 01/27/2025 Image Formation (Ioannis)
5 Wed 01/29/2025 Single-view 3D: History (Ioannis) Depth Map Prediction from a Single Image using a Multi-Scale Deep Network

Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer

Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation
WEEK 4
6 Mon 02/03/2025 Single-view 3D: Depth & Objects (Shubham) Learning a predictable and generative vector representation for objects

Occupancy Networks: Learning 3D Reconstruction in Function Space

AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation
7 Wed 02/05/2025 Single-view 3D: Objects II (Shubham)

Projects: Selection and Timeline (Shubham)
Learning Category-Specific Mesh Reconstruction from Image Collections

Accelerating 3D Deep Learning with PyTorch3D
Assignment 1 Due
Assignment 2 Out
WEEK 5
8 Mon 02/10/2025 Single-view 3D: Humans, Hands, and Animals (Shubham)

SMPL: A Skinned Multi-Person Linear Model

Embodied Hands: Modeling and Capturing Hands and Bodies Together

End-to-end Recovery of Human Shape and Pose

DOVE: Learning Deformable 3D Objects by Watching Videos
9 Wed 02/12/2025 Volume Rendering (Ioannis) Volume Rendering Digest
WEEK 6
10 Mon 02/17/2025 Neural Radiance Fields (Ioannis) NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
11 Wed 02/19/2025 Neural Radiance Fields (continued) (Ioannis) Plenoxels: Radiance Fields without Neural Networks
ReLU Fields: The Little Non-linearity That Could

Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
Assignment 2 Due
Assignment 3 Out
WEEK 7
12 Mon 02/24/2025 (Neural) Implicit Rendering (Ioannis) Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance
13 Wed 02/26/2025 (Neural) Implicit Rendering (continued) (Ioannis) Volume Rendering of Neural Implicit Surfaces
NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
Objects as volumes: A stochastic geometry view of opaque solids
Project Proposals Due
WEEK 8 - Spring Break
WEEK 9
14 Mon 03/10/2025 (Neural) Surface Rendering: Appearance (Ioannis) NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wild

PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting
15 Wed 03/12/2025 Differentiable Primitive (e.g. Gaussians, Triangles) Rendering (Ioannis) Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning

3D Gaussian Splatting for Real-Time Radiance Field Rendering
Assignment 3 Due
Assignment 4 Out
WEEK 10
16 Mon 03/17/2025 Sparse View 3D and View Synthesis (Shubham) ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers

SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction

ReconFusion: 3D Reconstruction with Diffusion Priors
17 Wed 03/19/2025 Distilling 3D from 2D Diffusion (Shubham) DreamFusion: Text-to-3D using 2D Diffusion

Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

Zero-1-to-3: Zero-shot One Image to 3D Object
WEEK 11
18 Mon 03/24/2025 Generative 3D Modeling (Shubham) Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generation

pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis
19 Wed 03/26/2025 Point Cloud Processing: Classification & Segmentation (Shubham) PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation

Point Transformer

Vector Neurons: A General Framework for SO(3)-Equivariant Networks

4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
Assignment 4 Due
Assignment 5 Out
WEEK 12
20 Mon 03/31/2025 Point Cloud Processing: Detection (Shubham) Frustum PointNets for 3D Object Detection from RGB-D Data

Deep Hough Voting for 3D Object Detection in Point Clouds
21 Wed 04/02/2025 Modeling 3D in Time (Shubham) Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes

Nerfies: Deformable Neural Radiance Fields
WEEK 13
22 Mon 04/07/2025 Generalizable Neural Fields (Ioannis) DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation

Learned Initializations for Optimizing Coordinate-Based Neural Representations

pixelNerf: Neural Radiance Fields from One or Few Images

MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo
23 Wed 04/09/2025 Guest Lecture by David Held: 3D + Robotics Assignment 5 Due
WEEK 14
24 Mon 04/14/2025 Guest Lecture by Neehar Peri: 3D Detection
25 Wed 04/16/2025 Conclusion (Ioannis, Shubham)
WEEK 15
26 Mon 04/21/2025 Poster Presentations: I
27 Wed 04/23/2025 Poster Presentations: II
WEEK 16
Wed 04/30/2025 Project Reports Due