slidedeckai.helpers.llm_helper.stream_litellm_completion#
- slidedeckai.helpers.llm_helper.stream_litellm_completion(provider: str, model: str, messages: list, max_tokens: int, api_key: str = '', azure_endpoint_url: str = '', azure_deployment_name: str = '', azure_api_version: str = '') Iterator[str][source]#
Stream completion from LiteLLM.
- Parameters:
provider – The LLM provider.
model – The name of the LLM.
messages – List of messages for the chat completion.
max_tokens – The maximum number of tokens to generate.
api_key – API key or access token to use.
azure_endpoint_url – Azure OpenAI endpoint URL.
azure_deployment_name – Azure OpenAI deployment name.
azure_api_version – Azure OpenAI API version.
- Returns:
Iterator of response chunks.