❮   all LABS
Photo credits

Lab 4: VisualServing Looks

Introduction

We are building our car to autonomously park in front of a cone, and follow a line. The car can access its zed camera and use pixel values to detect objects of certain hue. We create bounding boxes around the desired object color, and control our car movements based on that

Module 1: Cone Detection via Color Segmentation

  • Transform from RGB to HSV (find orange by hue)
  • Put mask on object
  • Run kernel over object to smooth out, instead of small orange, you do huge orange object

Module 2: Object Detection via Template Matching and SIFT

Module 3: Transforming pixels to a plane via Homography

  • Transforming from 2D image to x-y coordinate
  • Collecting 4 points, marking out physically, and in pixels, and using transformation matrix/homography
  • Given assumption that car is flat
  • Make a script to initialization

Module 4: Writing a parking controller

  • Make algorithm
  • Move forward to desired distance if angle is right Move backwards at an angle until done, and then move forward

Synthesis: Deploying all components together; Application to line following


About the Author

Team 11

Link to Presentation

Lab 4 Draft