Free, blazing-fast LLM API for Devs
llmOS is the Linux of LLMs - providing free, permissionless access to the state of the art open-source LLMs. By devs, for devs
llmOS is the Linux of LLMs - providing free, permissionless access to the state of the art open-source LLMs. By devs, for devs
Give the API a spin - free, easy & fast
The first model you can use freely is Mistral-7B which is on par with GPT-3.5 on many benchmarks.
1
2
3
4
5
6
7
8
9
10
11
12
13
curl --request POST \
--url https://api.llmos.dev/v1/chat/completions \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer demo-api-key' \
--data '{
"messages": [
{
"content": "EDIT ME",
"role": "user"
}
],
"model": "mistral-7b-instruct"
}'
EDIT ME
$ send API request
{ "id": "a92721f9-b805-4749-998a-843974fc348e", "model": "mistral-7b-instruct", "created": 2503860, "usage": { "prompt_tokens": 11, "completion_tokens": 28, "total_tokens": 39 }, "object": "chat.completion", "choices": [ { "index": 0, "finish_reason": "stop", "message": { "role": "assistant", "content": "Hello! How can I help you today? Do you have any specific questions or topics you'd like me to provide information on?" }, "delta": { "role": "assistant", "content": "" } } ] }
How is this free?
We believe AI should be like the open Internet - free, permissionless and user owned. llmOS is building a peer-to-peer LLM network, akin to torrents for LLMs from which both developers and model providers benefit.
Copyright (c) 2023 llmOS. All rights reserved.