Main Content

Feature Detection and Extraction

Image registration, interest point detection, feature descriptor extraction, point feature matching, and image retrieval

Local features and their descriptors are the building blocks of many computer vision algorithms. Their applications include image registration, object detection and classification, tracking, motion estimation, and content-based image retrieval (CBIR). These algorithms use local features to better handle scale changes, rotation, and occlusion. Computer Vision Toolbox™ algorithms include the FAST, Harris, and Shi & Tomasi corner detectors, and the SIFT, SURF, KAZE, and MSER blob detectors. The toolbox includes the SIFT, SURF, FREAK, BRISK, LBP, ORB, and HOG descriptors. You can mix and match the detectors and the descriptors depending on the requirements of your application.

One item feature matched from a cluttered scene


expand all

detectBRISKFeaturesDetect BRISK features and return BRISKPoints object
detectFASTFeaturesDetect corners using FAST algorithm and return cornerPoints object
detectHarrisFeaturesDetect corners using Harris–Stephens algorithm and return cornerPoints object
detectKAZEFeaturesDetect KAZE features and return KAZEPoints object
detectMinEigenFeaturesDetect corners using minimum eigenvalue algorithm and return cornerPoints object
detectMSERFeaturesDetect MSER features and return MSERRegions object
detectORBFeaturesDetect ORB keypoints and return an ORBPoints object
detectSIFTFeaturesDetect scale invariant feature transform (SIFT) features and return SIFTPoints object
detectSURFFeaturesDetect SURF features and return SURFPoints object
extractFeaturesExtract interest point descriptors
extractLBPFeaturesExtract local binary pattern (LBP) features
extractHOGFeaturesExtract histogram of oriented gradients (HOG) features
matchFeaturesFind matching features
matchFeaturesInRadiusFind matching features within specified radius
imwarpApply geometric transformation to image
estimateGeometricTransform2DEstimate 2-D geometric transformation from matching point pairs
estimateGeometricTransform3DEstimate 3-D geometric transformation from matching point pairs
vision.AlphaBlenderCombine images, overlay images, or highlight selected pixels
vision.BlockMatcherEstimate motion between images or video frames
vision.LocalMaximaFinderFind local maxima in matrices
vision.TemplateMatcherLocate template in image
insertMarkerInsert markers in image or video
insertShapeInsert shapes in image or video
showMatchedFeaturesDisplay corresponding feature points
showShapeDisplay shapes on image, video, or point cloud
insertObjectAnnotationAnnotate truecolor or grayscale image or video stream
insertTextInsert text in image or video
imshowDisplay image
imshowpairCompare differences between images
vision.GammaCorrectorApply or remove gamma correction from images or video streams
vision.ChromaResamplerDownsample or upsample chrominance components of images
binaryFeaturesObject for storing binary feature vectors
BRISKPointsObject for storing BRISK interest points
cornerPointsObject for storing corner points
KAZEPointsObject for storing KAZE interest points
MSERRegionsObject for storing MSER regions
ORBPointsObject for storing ORB keypoints
SIFTPointsObject for storing SIFT interest points
SURFPointsObject for storing SURF interest points
affine2d2-D affine geometric transformation
affine3d 3-D affine geometric transformation
rigid3d3-D rigid geometric transformation
projective2d 2-D projective geometric transformation

Create Recognition Database

bagOfFeaturesBag of visual words object
invertedImageIndexSearch index that maps visual words to images

Retrieve Images

retrieveImagesSearch image set for similar image
imageDatastoreDatastore for image data
evaluateImageRetrievalEvaluate image search results


Local Feature Detection and Extraction

Learn the benefits and applications of local feature detection and extraction.

Point Feature Types

Choose functions that return and accept points objects for several types of features

Coordinate Systems

Specify pixel Indices, spatial coordinates, and 3-D coordinate systems

Draw Shapes and Lines

When you specify the type of shape to draw, you must also specify it’s location on the image.

Image Retrieval with Bag of Visual Words

Retrieve images from a collection of images similar to a query image using a content-based image retrieval (CBIR) system.

Featured Examples