ComputerVision
CS543/ECE549 UniversityofIllinois Instructors:DerekHoiem,DavidForsyth TA:VarshaHedau
Presenter: Derek Hoiem
Todaysclass
Introductions Introtocomputervision Courselogistics Questions
Introductions
ComputerVision
Makecomputersunderstandimagesand video.
What kind of scene? Where are the cars? How far is the building?
Visionisreallyhard
Visionisanamazingfeatofnatural intelligence
Visualcortexoccupiesabout50%ofMacaquebrain Morehumanbraindevotedtovisionthananythingelse
Is that a queen or a bishop?
Whycomputervisionmatters
Safety
Health
Security
Comfort
Fun
Access
Ridiculouslybriefhistoryofcomputervision
1966:Minsky assignscomputervision asanundergradsummerproject 1960s:interpretationofsynthetic worlds 1970s:someprogressoninterpreting selectedimages 1980s:ANNscomeandgo;shifttoward geometryandincreasedmathematical rigor 1990s:facerecognition;statistical analysisinvogue 2000s:broaderrecognition;large annotateddatasetsavailable;video processingstarts
Guzman 68
Ohta Kanade 78
Turk and Pentland 91
Currentstateoftheart
Someexamplesofwhatcurrentvisionsystems cando
Many of the following slides by Steve Seitz
Earthviewers(3Dmodeling)
Image from Microsofts Virtual Earth (see also: Google Earth)
[Link]
Based on Photo Tourism by Noah Snavely, Steve Seitz, and Rick Szeliski
3Dfrommultipleimages
Building Rome in a Day: Agarwal et al. 2009
3Dfromoneimage
Hoiem Efros Hebert SIGGRAPH 2005
Opticalcharacterrecognition(OCR)
Technology to convert scanned docs to text
If you have a scanner, it probably came with OCR software
Digit recognition, AT&T labs [Link]
License plate readers
[Link]
Facedetection
Manynewdigitalcamerasnowdetectfaces
Canon,Sony,Fuji,
Smiledetection?
Sony Cyber-shot T70 Digital Still Camera
Objectrecognition(insupermarkets)
LaneHawk by EvolutionRobotics A smart camera is flush-mounted in the checkout lane, continuously watching for items. When an item is detected and recognized, the cashier verifies the quantity of items that were found under the basket, and continues to close the transaction. The item can remain under the basket, and with LaneHawk,you are assured to get paid for it
Visionbasedbiometrics
How the Afghan Girl was Identified by Her Iris Patterns Read the story wikipedia
Loginwithoutapassword
Fingerprint scanners on many new laptops, other devices
Face recognition systems now beginning to appear more widely
[Link]
Objectrecognition(inmobilephones)
Thisisbecomingreal:
Point&Find,Nokia
Specialeffects:shapecapture
The Matrix movies, ESC Entertainment, XYZRGB, NRC
Specialeffects:motioncapture
Pirates of the Carribean, Industrial Light and Magic Click here for interactive demo
Sports
Sportvision first down line Nice explanation on [Link]
Smartcars
Slide content courtesy of Amnon Shashua
Mobileye
VisionsystemscurrentlyinhighendBMW,GM, Volvomodels By2010:70%ofcarmanufacturers.
Visionbasedinteraction(andgames)
Digimask: put your face on a 3D avatar.
Nintendo Wii has camera-based IR tracking built in. See Lees work at CMU on clever tricks on using it to create a multi-touch display!
Game turns moviegoers into Human Joysticks, CNET Camera tracking a crowd, based on this work.
Visioninspace
NASA'S Mars Exploration Rover Spirit captured this westward view from atop a low plateau where Spirit spent the closing months of 2007.
Vision systems (JPL) used for several tasks
Panorama stitching 3D terrain modeling Obstacle detection, position tracking For more, read Computer Vision on Mars by Matthies et al.
Industrialrobots
Vision-guided robots position nut runners on wheels
Mobilerobots
NASAs Mars Spirit Rover [Link]
[Link]
Saxena et al. 2008 STAIR at Stanford
Medicalimaging
3D imaging MRI, CT
Image guided surgery Grimson et al., MIT
Recentnews
Recentnews
Recentnews
Currentstateoftheart
Youjustsawexamplesofcurrentsystems.
Mostofthesearelessthan5yearsold
Thisisaveryactiveresearcharea,andrapidly changing
Manynewappsinthenext5years
Tolearnmoreaboutvisionapplicationsand companies
DavidLowemaintainsanexcellentoverviewof visioncompanies
[Link]
Courselogistics
Webpage:
[Link]
Attendance Officehours Assignmentsandgrades Finalproject
Whattoexpectfromthiscourse
Broadcoverage(geometry,imageprocessing, recognition,multiview,video) Backgroundtodelvedeeperintoany computervisionrelatedtopic Practicalexperience
Questions
