Send feedback
tflite_support.metadata_writers.writer_utils.get_tokenizer_associated_files
Gets a list of associated files packed in the tokenzier_options.
View aliases
Main aliases
tflite_support.metadata_writers.audio_classifier.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.audio_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.audio_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.audio_classifier.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.bert_nl_classifier.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.bert_nl_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.bert_nl_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.bert_nl_classifier.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_classifier.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_classifier.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_segmenter.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_segmenter.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_segmenter.metadata_writer.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.image_segmenter.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.nl_classifier.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.nl_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.nl_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.nl_classifier.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.object_detector.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.object_detector.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.object_detector.metadata_writer.writer_utils.get_tokenizer_associated_files
, tflite_support.metadata_writers.object_detector.writer_utils.get_tokenizer_associated_files
tflite_support . metadata_writers . writer_utils . get_tokenizer_associated_files (
tokenizer_options : Union [ None , _metadata_fb . BertTokenizerOptionsT , _metadata_fb .
SentencePieceTokenizerOptionsT , _metadata_fb . RegexTokenizerOptionsT ]
) -> List [ Optional [ str ]]
Args
tokenizer_options
a tokenizer metadata object. Support the following
tokenizer types:
BertTokenizerOptions:
https://github.com/tensorflow/tflite-support/blob/b80289c4cd1224d0e1836c7654e82f070f9eefaa/tensorflow_lite_support/metadata/metadata_schema.fbs#L436
SentencePieceTokenizerOptions:
https://github.com/tensorflow/tflite-support/blob/b80289c4cd1224d0e1836c7654e82f070f9eefaa/tensorflow_lite_support/metadata/metadata_schema.fbs#L473
RegexTokenizerOptions:
https://github.com/tensorflow/tflite-support/blob/b80289c4cd1224d0e1836c7654e82f070f9eefaa/tensorflow_lite_support/metadata/metadata_schema.fbs#L475
Returns
A list of associated files included in tokenizer_options.
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-05-08 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-05-08 UTC."],[],[]]