COMP 546 - Computational Perception
Here is the Course Outline from Winter 2025.
Below are materials from 2018. Materials for recent versions are on mycourses.
Lecture Slides and Notes
- introduction
(slides)
levels of analysis in perception, course outline
IMAGE FORMATION, EARLY VISUAL PROCESSING
- geometry
(slides)
(notes)
origins of spatial vision, visual angle, aperture, image projection, binocular disparity
- focus and blur
(slides)
(notes)
sampling, thin lens equation, depth of field, accommodation, aging and abnormal vision
- photoreceptors, color
(slides)
(notes)
spectra: emission, reflectance, absorptance; rods and cones, metamers, color displays, color blindness
- retina
(slides)
(notes)
spikes, color opponency, center-surround DOGs, cross-correlation
- orientation selectivity
(slides)
(notes)
retinotopic maps, simple cells, Gabor models
- disparity tuned cells
(slides)
(notes)
complex cells in V1, monocular vs. binocular, disparity space
- image motion 1
(slides)
(notes)
XYT, time dependent receptive fields, 3D Gabors and sine waves, normal velocity
- image motion 2
(slides)
(notes)
motion constraint equation, intersection of constraints, velocity tuned cells (MT)
VISUAL CUES FOR SURFACE AND DEPTH PERCEPTION
- egomotion
(slides)
(notes)
translation and direction of heading; rotation: VOR, smooth pursuit eye movements
- depth from blur, binocular steropsis
(slides)
(notes)
blur on slanted planes, Panum's fusional area, accommodation-vergence conflict,
random dot stereograms
- shape from X: perspective, texture, shading
(slides)
(notes)
vanishing points, depth gradient and texture cues, slant & tilt; curvature, Lambert's law
- illumination and reflectance
(slides)
(notes)
shape from shading (linear & cloudy day), lightness & color constancy
MEASURING AND MODELLING PERFORMANCE
- psychophysics
(slides)
(notes)
psychometric curves, thresholds, contrast and disparity sensitivity
- maximum likelihood
(slides)
(notes)
examples of likelihoods, probability review
-
cue combinations, Bayesian models
(slides)
(notes)
priors, MAP, depth reversal ambiguity
LINEAR SYSTEMS THEORY
- convolution
(slides)
(notes)
impulse response functions, complex numbers review
- Fourier transform and filtering
(slides)
(notes)
examples, convolution theorem, low/band/high pass filters
AUDITORY IMAGE FORMATION
- sound 1
(slides)
(notes)
pressure vs. intensity, dB
- sound 2
(slides)
(notes)
music and speech sounds, spectrograms
AUDITORY SYSTEM & SPATIAL HEARING
- head and ear
(slides)
(notes)
head and outer ear (HRIR, HRTF)
- auditory pathway, sound localization
(slides)
(notes)
cochlea and neural coding, duplex theory,
Jeffress model, level and timing differences
- auditory filters
(slides)
(notes)
spectrograms revisited, critical bands and masking, spike triggered averaging and A1
- echolocation and recognition by bats and porpoises
(slides)
(notes)
constant frequency, frequency modulation, interference