The AI Edge Torch Generative
API
is a library for converting transformer-based PyTorch models to
the LiteRT format, enabling you to convert Large Language Models (LLMs) for
on-device image and text generation with LiteRT-LM. The AI Edge Torch
Generative API currently supports CPU and GPU, with planned NPU support.
Developers can use the Generative API to integrate PyTorch LLMs
with LiteRT-LM to create apps that
run those converted PyTorch models completely on-device.
For more information, see the Generative Torch API GitHub
repo.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-12-05 UTC."],[],[]]
