The Command Line Interface (CLI) lets you run .litertlm models on Linux,
macOS, Windows, or Raspberry Pi.
Overview of CLI Capabilities
The LiteRT-LM CLI is a powerful tool for interacting with local LLMs. It supports:
- Quick Installation: Run on-demand with
uvxor install permanently usinguvorpip. See Installation. - Interactive Chat: Run models in an interactive chat session. See Usage.
- Advanced Capabilities: Optimize and extend your models with Multi-Token Prediction, Multi-modality attachments, and Function Calling.
- OpenAI-Compatible Server: Start a local server that emulates OpenAI endpoints. See OpenAI-Compatible Server.
To get started, proceed to the Installation guide.