Meta's latest class of model (Llama 3.1) launched with a variety of sizes and flavors.
from openai import OpenAI
client = OpenAI(
api_key="$CK_KEY",
base_url="https://conduit-api.aurixel.ai/v1",
)
resp = client.chat.completions.create(
model="llama-3.1-8b",
messages=[{"role": "user", "content": "Hi!"}],
)
print(resp.choices[0].message.content)