GestureRecognizer

public final class GestureRecognizer

Performs gesture recognition on images.

This API expects a pre-trained hand gesture model asset bundle, or a custom one created using Model Maker. See .

  • Input image MPImage
    • The image that gesture recognition runs on.
  • Output GestureRecognizerResult GestureRecognizerResult
    • A GestureRecognizerResult containing hand landmarks and recognized hand gestures.

Nested Classes

class GestureRecognizer.GestureRecognizerOptions Options for setting up an GestureRecognizer. 

Public Methods

static GestureRecognizer
createFromBuffer(Context context, ByteBuffer modelBuffer)
Creates a GestureRecognizer instance from a model buffer and the default GestureRecognizer.GestureRecognizerOptions.
static GestureRecognizer
createFromFile(Context context, String modelPath)
Creates a GestureRecognizer instance from a model file and the default GestureRecognizer.GestureRecognizerOptions.
static GestureRecognizer
createFromFile(Context context, File modelFile)
Creates a GestureRecognizer instance from a model file and the default GestureRecognizer.GestureRecognizerOptions.
static GestureRecognizer
createFromOptions(Context context, GestureRecognizer.GestureRecognizerOptions recognizerOptions)
Creates a GestureRecognizer instance from a GestureRecognizer.GestureRecognizerOptions.
GestureRecognizerResult
recognize(MPImage image)
Performs gesture recognition on the provided single image with default image processing options, i.e.
GestureRecognizerResult
recognize(MPImage image, ImageProcessingOptions imageProcessingOptions)
Performs gesture recognition on the provided single image.
void
recognizeAsync(MPImage image, long timestampMs)
Sends live image data to perform gesture recognition with default image processing options, i.e.
void
recognizeAsync(MPImage image, ImageProcessingOptions imageProcessingOptions, long timestampMs)
Sends live image data to perform gesture recognition, and the results will be available via the OutputHandler.ResultListener provided in the GestureRecognizer.GestureRecognizerOptions.
GestureRecognizerResult
recognizeForVideo(MPImage image, long timestampMs)
Performs gesture recognition on the provided video frame with default image processing options, i.e.
GestureRecognizerResult
recognizeForVideo(MPImage image, ImageProcessingOptions imageProcessingOptions, long timestampMs)
Performs gesture recognition on the provided video frame.

Inherited Methods

Public Methods

public static GestureRecognizer createFromBuffer (Context context, ByteBuffer modelBuffer)

Creates a GestureRecognizer instance from a model buffer and the default GestureRecognizer.GestureRecognizerOptions.

Parameters
context an Android ERROR(/Context).
modelBuffer a direct ByteBuffer or a ERROR(/MappedByteBuffer) of the detection model.
Throws
if there is an error during GestureRecognizer creation.

public static GestureRecognizer createFromFile (Context context, String modelPath)

Creates a GestureRecognizer instance from a model file and the default GestureRecognizer.GestureRecognizerOptions.

Parameters
context an Android ERROR(/Context).
modelPath path to the gesture recognition model with metadata in the assets.
Throws
if there is an error during GestureRecognizer creation.

public static GestureRecognizer createFromFile (Context context, File modelFile)

Creates a GestureRecognizer instance from a model file and the default GestureRecognizer.GestureRecognizerOptions.

Parameters
context an Android ERROR(/Context).
modelFile the gesture recognition model File instance.
Throws
IOException if an I/O error occurs when opening the tflite model file.
if there is an error during GestureRecognizer creation.

public static GestureRecognizer createFromOptions (Context context,