OpenAI/LocalAI's image question generation failed with: API request error: Invalid content type. image_url is only supported by certain models.

[Lawkss]

Which version of integration_openai are you using?

3.7.1

Which version of Nextcloud are you using?

32.0.1

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Edge

Describe the Bug

Hi,

When I try to analzye a photo with the NC Assistant using OpenAI API key I get the following error in the log:

A TaskProcessing core:analyze-images task with id 27 failed with the following message: OpenAI/LocalAI's image question generation failed with: API request error: Invalid content type. image_url is only supported by certain models.

RuntimeExceptionOpenAI/LocalAI's image question generation failed with: API request error: Invalid content type. image_url is only supported by certain models.

Expected Behavior

For it to analzye the photo. I thought GPT4 supports that?

To Reproduce

open NC AI assistant, analzye foto, get error message.

[oleksandr-nc]

Hello. By the GPT4 model you mean GPT4o?

[kyteinsky]

the default previously was gpt 3.5 which now in the latest release has been changed to gpt 4.1 mini. Try changing to this new model in "Default completion model to use" option in "admin settings -> Assistant -> openai" and it should work.