This schedule is preliminary and subject to change as the term evolves.
Lecture
Date
Topic
Suggested Reading
Assignments
WEEK 1
1
Mon 01/13/2025
Introduction
(Ioannis, Shubham)
Assignment 0 Out
2
Wed 01/15/2025
3D Representations I
(Ioannis)
WEEK 2
3
Wed 01/22/2025
3D Representations II
(Shubham)
Assignment 0 Due
Assignment 1 Out
Fri 01/24/2025
Pytorch3D Tutorial (NSH 3002, 4-5pm)
colab notebook
WEEK 3
4
Mon 01/27/2025
Image Formation
(Ioannis)
5
Wed 01/29/2025
Single-view 3D: History
(Ioannis)
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer
Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation
WEEK 4
6
Mon 02/03/2025
Single-view 3D: Depth & Objects
(Shubham)
Learning a predictable and generative vector representation for objects
Occupancy Networks: Learning 3D Reconstruction in Function Space
AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation
7
Wed 02/05/2025
Single-view 3D: Objects II
(Shubham)
Projects: Selection and Timeline
(Shubham)
Learning Category-Specific Mesh Reconstruction from Image Collections
Accelerating 3D Deep Learning with PyTorch3D
Assignment 1 Due
Assignment 2 Out
WEEK 5
8
Mon 02/10/2025
Single-view 3D: Humans, Hands, and Animals
(Shubham)
SMPL: A Skinned Multi-Person Linear Model
Embodied Hands: Modeling and Capturing Hands and Bodies Together
End-to-end Recovery of Human Shape and Pose
DOVE: Learning Deformable 3D Objects by Watching Videos
9
Wed 02/12/2025
Volume Rendering
(Ioannis)
Volume Rendering Digest
WEEK 6
10
Mon 02/17/2025
Neural Radiance Fields
(Ioannis)
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
11
Wed 02/19/2025
Neural Radiance Fields (continued)
(Ioannis)
Plenoxels: Radiance Fields without Neural Networks
ReLU Fields: The Little Non-linearity That Could
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
Assignment 2 Due
Assignment 3 Out
WEEK 7
12
Mon 02/24/2025
(Neural) Implicit Rendering
(Ioannis)
Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance
13
Wed 02/26/2025
(Neural) Implicit Rendering (continued)
(Ioannis)
Volume Rendering of Neural Implicit Surfaces
NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
Objects as volumes: A stochastic geometry view of opaque solids
Project Proposals Due
WEEK 8 - Spring Break
WEEK 9
14
Mon 03/10/2025
(Neural) Surface Rendering: Appearance
(Ioannis)
NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wild
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting
15
Wed 03/12/2025
Differentiable Primitive (e.g. Gaussians, Triangles) Rendering
(Ioannis)
Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning
3D Gaussian Splatting for Real-Time Radiance Field Rendering
Assignment 3 Due
Assignment 4 Out
WEEK 10
16
Mon 03/17/2025
Sparse View 3D and View Synthesis
(Shubham)
ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers
SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction
ReconFusion: 3D Reconstruction with Diffusion Priors
17
Wed 03/19/2025
Distilling 3D from 2D Diffusion
(Shubham)
DreamFusion: Text-to-3D using 2D Diffusion
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation
Zero-1-to-3: Zero-shot One Image to 3D Object
WEEK 11
18
Mon 03/24/2025
Generative 3D Modeling
(Shubham)
Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generation
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis
19
Wed 03/26/2025
Point Cloud Processing: Classification & Segmentation
(Shubham)
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Point Transformer
Vector Neurons: A General Framework for SO(3)-Equivariant Networks
4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
Assignment 4 Due
Assignment 5 Out
WEEK 12
20
Mon 03/31/2025
Point Cloud Processing: Detection
(Shubham)
Frustum PointNets for 3D Object Detection from RGB-D Data
Deep Hough Voting for 3D Object Detection in Point Clouds
21
Wed 04/02/2025
Modeling 3D in Time
(Shubham)
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes
Nerfies: Deformable Neural Radiance Fields
WEEK 13
22
Mon 04/07/2025
Generalizable Neural Fields
(Ioannis)
DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
Learned Initializations for Optimizing Coordinate-Based Neural Representations
pixelNerf: Neural Radiance Fields from One or Few Images
MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo
23
Wed 04/09/2025
Guest Lecture by
David Held
: 3D + Robotics
Assignment 5 Due
WEEK 14
24
Mon 04/14/2025
Guest Lecture by
Neehar Peri
:
3D Detection
25
Wed 04/16/2025
Conclusion
(Ioannis, Shubham)
WEEK 15
26
Mon 04/21/2025
Poster Presentations: I
27
Wed 04/23/2025
Poster Presentations: II
WEEK 16
Wed 04/30/2025
Project Reports Due