Is it support Github marketplace model?

[Macielyoung]

Github model list: https://github.com/marketplace/models/azure-openai/gpt-4o

[Eladlev]

Sure, you just need to provide your credentials here:

AutoPrompt/config/llm_env.yml

Line 8 in ab7f57e

azure:

Then in the config file modify the llm

AutoPrompt/config/config_default.yml

Line 51 in ab7f57e

name: 'gpt-4-1106-preview' # This is the meta-prompt LLM, it should be a strong model. For example, using GPT-3.5 will cause an error in many cases.

(type should be 'azure' and the name should be the model name ('gpt-4o' for example)

[Macielyoung]

but github model marketplace only provide developer key for free, can we connect to this model?

[Eladlev]

I see, unfortunately, we are using langchain and they still do not support this option.
There is an open PR that might be useful:
langchain-ai/langchain#25083

In any case, it's worth noting that the free plan only allows 50 requests per day (for gpt-4o and high-quality models). This is not enough for the system requirements (so it will take a few days)