MediaPipeTasksVision Framework Reference | Google AI Edge


                    
                    
                    poseLandmarks

The array of connections between all the landmarks in the detected pose.

Declaration

Objective-C

@property (class, nonatomic, readonly) NSArray<MPPConnection *> *_Nonnull poseLandmarks;


                    
                    
                    -initWithModelPath:error:

Creates a new instance of PoseLandmarker from an absolute path to a model asset bundle stored locally on the device and the default PoseLandmarkerOptions.

Declaration

Objective-C

- (nullable instancetype)initWithModelPath:(nonnull NSString *)modelPath
                                     error:(NSError *_Nullable *_Nullable)error;

Parameters

`modelPath`	An absolute path to a model asset bundle stored locally on the device.
`error`	An optional error parameter populated when there is an error in initializing the pose landmarker.

Return Value

A new instance of PoseLandmarker with the given model path. nil if there is an error in initializing the pose landmarker.


                    
                    
                    -initWithOptions:error:

Creates a new instance of PoseLandmarker from the given PoseLandmarkerOptions.

Declaration

Objective-C

- (nullable instancetype)initWithOptions:
                             (nonnull MPPPoseLandmarkerOptions *)options
                                   error:(NSError *_Nullable *_Nullable)error;

Parameters

`options`	The options of type `PoseLandmarkerOptions` to use for configuring the `PoseLandmarker`.
`error`	An optional error parameter populated when there is an error in initializing the pose landmarker.

Return Value

A new instance of PoseLandmarker with the given options. nil if there is an error in initializing the pose landmarker.


                    
                    
                    -detectImage:error:

Performs pose landmarks detection on the provided MPImage using the whole image as region of interest. Rotation will be applied according to the orientation property of the provided MPImage. Only use this method when the PoseLandmarker is created with running mode .image.

This method supports performing pose landmarks detection on RGBA images. If your MPImage has a source type of .pixelBuffer or .sampleBuffer, the underlying pixel buffer must use kCVPixelFormatType_32BGRA as its pixel format.

If your MPImage has a source type of .image ensure that the color space is RGB with an Alpha channel.

Declaration

Objective-C

- (nullable MPPPoseLandmarkerResult *)
    detectImage:(nonnull MPPImage *)image
          error:(NSError *_Nullable *_Nullable)error;

Parameters

`image`	The `MPImage` on which pose landmarks detection is to be performed.
`error`	An optional error parameter populated when there is an error in performing pose landmark detection on the input image.

Return Value

An PoseLandmarkerResult object that contains the pose landmarks detection results.


                    
                    
                    -detectVideoFrame:timestampInMilliseconds:error:

Performs pose landmarks detection on the provided video frame of type MPImage using the whole image as region of interest. Rotation will be applied according to the orientation property of the provided MPImage. Only use this method when the PoseLandmarker is created with running mode .video.

It’s required to provide the video frame’s timestamp (in milliseconds). The input timestamps must be monotonically increasing.

This method supports performing pose landmarks detection on RGBA images. If your MPImage has a source type of .pixelBuffer or .sampleBuffer, the underlying pixel buffer must use kCVPixelFormatType_32BGRA as its pixel format.

If your MPImage has a source type of .image ensure that the color space is RGB with an Alpha channel.

Declaration

Objective-C

- (nullable MPPPoseLandmarkerResult *)
           detectVideoFrame:(nonnull MPPImage *)image
    timestampInMilliseconds:(NSInteger)timestampInMilliseconds
                      error:(NSError *_Nullable *_Nullable)error;

Parameters

`image`	The `MPImage` on which pose landmarks detection is to be performed.
`timestampInMilliseconds`	The video frame’s timestamp (in milliseconds). The input timestamps must be monotonically increasing.
`error`	An optional error parameter populated when there is an error in performing pose landmark detection on the input video frame.

Return Value

An PoseLandmarkerResult object that contains the pose landmarks detection results.


                    
                    
                    -detectAsyncImage:timestampInMilliseconds:error:

Sends live stream image data of type MPImage to perform pose landmarks detection using the whole image as region of interest. Rotation will be applied according to the orientation property of the provided MPImage. Only use this method when the PoseLandmarker is created with running mode.liveStream.

The object which needs to be continuously notified of the available results of pose landmark detection must confirm to PoseLandmarkerLiveStreamDelegate protocol and implement the poseLandmarker(_:didFinishDetectionWithResult:timestampInMilliseconds:error:) delegate method.

It’s required to provide a timestamp (in milliseconds) to indicate when the input image is sent to the pose landmarker. The input timestamps must be monotonically increasing.

This method supports performing pose landmarks detection on RGBA images. If your MPImage has a source type of .pixelBuffer or .sampleBuffer, the underlying pixel buffer must use kCVPixelFormatType_32BGRA as its pixel format.

If the input MPImage has a source type of .image ensure that the color space is RGB with an Alpha channel.

If this method is used for performing pose landmarks detection on live camera frames using AVFoundation, ensure that you request AVCaptureVideoDataOutput to output frames in kCMPixelFormat_32BGRA using its videoSettings property.

Declaration

Objective-C

- (BOOL)detectAsyncImage:(nonnull MPPImage *)image
    timestampInMilliseconds:(NSInteger)timestampInMilliseconds
                      error:(NSError *_Nullable *_Nullable)error;

Parameters

`image`	A live stream image data of type `MPImage` on which pose landmarks detection is to be performed.
`timestampInMilliseconds`	The timestamp (in milliseconds) which indicates when the input image is sent to the pose landmarker. The input timestamps must be monotonically increasing.
`error`	An optional error parameter populated when there is an error in performing pose landmark detection on the input live stream image data.

Return Value

YES if the image was sent to the task successfully, otherwise NO.


                    
                    
                    -init

Undocumented

Declaration

Objective-C

- (instancetype)init NS_UNAVAILABLE;


                    
                    
                    +new

Undocumented

Declaration

Objective-C

+ (instancetype)new NS_UNAVAILABLE;