Open HPC infrastructure measures dataset - llm_api_usage table [12/13]
收藏资源简介:
HPC infrastructure measures dataset - llm_api_usage table This record contains the llm_api_usage table of the HPC infrastructure measures dataset. Column descriptions: timestamp: The time at which the measurement was collected. username: An identifier (anonymized) of the account or user that made the API call. model: The model name that was used to process the user request, as specified in the API call. prompt_tokens: The number of tokens in the prompt provided by the user in the API request. completion_tokens: The number of tokens in the completion generated by the model in response. total_tokens: The total number of tokens processed in the API request, calculated as the sum of prompt_tokens and completion_tokens. api_type: The type of API call made to the vLLM service. url_path: The URL path of the API endpoint that was called to process the user request.



