CompletionUsage.md

launch.api_client.model.completion_usage.CompletionUsage

Model Type Info

Input Type	Accessed Type	Description	Notes
dict, frozendict.frozendict, str, date, datetime, uuid.UUID, int, float, decimal.Decimal, bool, None, list, tuple, bytes, io.FileIO, io.BufferedReader,	frozendict.frozendict, str, decimal.Decimal, BoolClass, NoneClass, tuple, bytes, FileIO

Dictionary Keys

Key	Input Type	Accessed Type	Description	Notes
completion_tokens	dict, frozendict.frozendict, str, date, datetime, uuid.UUID, int, float, decimal.Decimal, bool, None, list, tuple, bytes, io.FileIO, io.BufferedReader,	frozendict.frozendict, str, decimal.Decimal, BoolClass, NoneClass, tuple, bytes, FileIO	Number of tokens in the generated completion.
prompt_tokens	dict, frozendict.frozendict, str, date, datetime, uuid.UUID, int, float, decimal.Decimal, bool, None, list, tuple, bytes, io.FileIO, io.BufferedReader,	frozendict.frozendict, str, decimal.Decimal, BoolClass, NoneClass, tuple, bytes, FileIO	Number of tokens in the prompt.
total_tokens	dict, frozendict.frozendict, str, date, datetime, uuid.UUID, int, float, decimal.Decimal, bool, None, list, tuple, bytes, io.FileIO, io.BufferedReader,	frozendict.frozendict, str, decimal.Decimal, BoolClass, NoneClass, tuple, bytes, FileIO	Total number of tokens used in the request (prompt + completion).
completion_tokens_details	CompletionTokensDetails	CompletionTokensDetails	Breakdown of tokens used in a completion.	[optional]
prompt_tokens_details	PromptTokensDetails	PromptTokensDetails	Breakdown of tokens used in the prompt.	[optional]
any_string_name	dict, frozendict.frozendict, str, date, datetime, int, float, bool, decimal.Decimal, None, list, tuple, bytes, io.FileIO, io.BufferedReader	frozendict.frozendict, str, BoolClass, decimal.Decimal, NoneClass, tuple, bytes, FileIO	any string name can be used but the value must be the correct type	[optional]

[Back to Model list] [Back to API list] [Back to README]