Computer Vision
Images, features, CNNs, detection, segmentation, transformers, generative models, 3D geometry, vision-language models and deployment.
AI-350 Year 3 3 credits 12 lessons · 5 h 33 min
Offered by HSM University · Artificial Intelligence
This is the American version of this course. See the Canadian version.
What you'll learn
- Explain image formation, sensors, color and sampling, apply the pinhole camera model, and use convolution for filtering and edge detection
- Apply point operations, color spaces, morphology, edge, line and corner detection, feature matching, homographies and RANSAC to classical vision problems
- Design and analyze convolutional neural networks, computing output sizes, parameters and receptive fields, and train and adapt them with augmentation and transfer learning
- Select efficient architectures for edge devices, build leakage-free datasets, evaluate classifiers with appropriate metrics, and calibrate model confidence
- Build and evaluate object detection and segmentation systems using IoU, non-maximum suppression, average precision, mean IoU and Dice, and assess the use of face recognition
- Explain assignment, focal loss, IoU-based losses and DETR set prediction, and apply panoptic segmentation, pose estimation and tiling for small objects
- Apply vision transformers, self-supervised learning and contrastive vision-language models such as CLIP, and analyze their costs and limitations
- Explain VAEs, GANs and diffusion models, including latent diffusion and guidance, evaluate generators with FID, and assess synthetic data and deepfake risks
- Estimate motion, track objects and recover 3D structure with optical flow, stereo, structure from motion and depth sensors, and reason about safety-critical vision systems
- Calibrate cameras and correct distortion, apply epipolar geometry, triangulation, PnP and bundle adjustment, and describe NeRF and Gaussian splatting
- Build and evaluate vision-language systems, including open-vocabulary detection, multimodal language models, OCR and document understanding
- Design, size, monitor and secure deployed vision systems, protect privacy and fairness under applicable law, and deliver a complete capstone project
Course content
12 lessons · 5 h 33 min total · final exam
- 1 Images and image formation 33 min · quiz
- 2 Image processing, features and geometric transforms 28 min · quiz
- 3 Convolutional neural networks 30 min · quiz
- 4 Efficient networks, evaluation and calibration 24 min · quiz
- 5 Detection and segmentation 28 min · quiz
- 6 Inside modern detectors and dense prediction 26 min · quiz
- 7 Vision transformers and self-supervision 27 min · quiz
- 8 Generative models for images and video 25 min · quiz
- 9 Video and 3D vision 31 min · quiz
- 10 Multiple-view geometry and 3D reconstruction 27 min · quiz
- 11 Vision-language models and document understanding 26 min · quiz
- 12 Deploying vision systems: robustness, privacy and a capstone project 28 min · quiz
- E Final exam 20 questions
Requirements
Recommended background. You can start any course at any time.
Description
Images, features, CNNs, detection, segmentation, transformers, generative models, 3D geometry, vision-language models and deployment.
Part of the Science stream, typically taken in year 3.