Error in generating model output, assumed longer than real token context length.

#8
by TheOneM - opened

πŸ˜ƒ: What are the trends in Angola's Tourism industry, and overall user feedback.
πŸ€–: Step 1
πŸ€–: Error in generating model output:
litellm.ContextWindowExceededError: litellm.BadRequestError: ContextWindowExceededError: OpenAIException - Error code: 400 - {'error': {'message': "This model's maximum context length is 128000 tokens. However, your messages resulted in 190097 tokens. Please reduce the length of the messages.", 'type': 'invalid_request_error', 'param': 'messages', 'code': 'context_length_exceeded'}}
πŸ€–: Step 1 | Duration: 18.24
πŸ€–: -----
πŸ€–: Step 2
πŸ€–: Error in generating model output:
litellm.ContextWindowExceededError: litellm.BadRequestError: ContextWindowExceededError: OpenAIException - Error code: 400 - {'error': {'message': "This model's maximum context length is 128000 tokens. However, your messages resulted in 190226 tokens. Please reduce the length of the messages.", 'type': 'invalid_request_error', 'param': 'messages', 'code': 'context_length_exceeded'}}
πŸ€–: Step 2 | Duration: 1.83
πŸ€–: -----
πŸ€–: Step 3
πŸ€–: Error in generating model output:
litellm.ContextWindowExceededError: litellm.BadRequestError: ContextWindowExceededError: OpenAIException - Error code: 400 - {'error': {'message': "This model's maximum context length is 128000 tokens. However, your messages resulted in 190351 tokens. Please reduce the length of the messages.", 'type': 'invalid_request_error', 'param': 'messages', 'code': 'context_length_exceeded'}}
πŸ€–: Step 3 | Duration: 2.05
πŸ€–: -----
πŸ€–: Step 4
πŸ€–: Error in generating model output:
litellm.ContextWindowExceededError: litellm.BadRequestError: ContextWindowExceededError: OpenAIException - Error code: 400 - {'error': {'message': "This model's maximum context length is 128000 tokens. However, your messages resulted in 190476 tokens. Please reduce the length of the messages.", 'type': 'invalid_request_error', 'param': 'messages', 'code': 'context_length_exceeded'}}
πŸ€–: Step 4 | Duration: 2.53
πŸ€–: -----
πŸ€–: Step 5
πŸ€–: Step 5 | Duration: 2.32
πŸ€–: -----

I'm seeing this as well @m-ric

Sign up or log in to comment