Computer Vision

Images, features, CNNs, detection, segmentation, transformers, generative models, 3D geometry, vision-language models and deployment.

AI-350 Year 3 3 credits 12 lessons · 5 h 33 min

Offered by HSM University · Artificial Intelligence

This is the American version of this course. See the Canadian version.

What you'll learn

  • Explain image formation, sensors, color and sampling, apply the pinhole camera model, and use convolution for filtering and edge detection
  • Apply point operations, color spaces, morphology, edge, line and corner detection, feature matching, homographies and RANSAC to classical vision problems
  • Design and analyze convolutional neural networks, computing output sizes, parameters and receptive fields, and train and adapt them with augmentation and transfer learning
  • Select efficient architectures for edge devices, build leakage-free datasets, evaluate classifiers with appropriate metrics, and calibrate model confidence
  • Build and evaluate object detection and segmentation systems using IoU, non-maximum suppression, average precision, mean IoU and Dice, and assess the use of face recognition
  • Explain assignment, focal loss, IoU-based losses and DETR set prediction, and apply panoptic segmentation, pose estimation and tiling for small objects
  • Apply vision transformers, self-supervised learning and contrastive vision-language models such as CLIP, and analyze their costs and limitations
  • Explain VAEs, GANs and diffusion models, including latent diffusion and guidance, evaluate generators with FID, and assess synthetic data and deepfake risks
  • Estimate motion, track objects and recover 3D structure with optical flow, stereo, structure from motion and depth sensors, and reason about safety-critical vision systems
  • Calibrate cameras and correct distortion, apply epipolar geometry, triangulation, PnP and bundle adjustment, and describe NeRF and Gaussian splatting
  • Build and evaluate vision-language systems, including open-vocabulary detection, multimodal language models, OCR and document understanding
  • Design, size, monitor and secure deployed vision systems, protect privacy and fairness under applicable law, and deliver a complete capstone project

Course content

12 lessons · 5 h 33 min total · final exam

  1. 1 Images and image formation 33 min · quiz
  2. 2 Image processing, features and geometric transforms 28 min · quiz
  3. 3 Convolutional neural networks 30 min · quiz
  4. 4 Efficient networks, evaluation and calibration 24 min · quiz
  5. 5 Detection and segmentation 28 min · quiz
  6. 6 Inside modern detectors and dense prediction 26 min · quiz
  7. 7 Vision transformers and self-supervision 27 min · quiz
  8. 8 Generative models for images and video 25 min · quiz
  9. 9 Video and 3D vision 31 min · quiz
  10. 10 Multiple-view geometry and 3D reconstruction 27 min · quiz
  11. 11 Vision-language models and document understanding 26 min · quiz
  12. 12 Deploying vision systems: robustness, privacy and a capstone project 28 min · quiz
  13. E Final exam 20 questions

Requirements

Recommended background. You can start any course at any time.

Description

Images, features, CNNs, detection, segmentation, transformers, generative models, 3D geometry, vision-language models and deployment.

Part of the Science stream, typically taken in year 3.