market-preview
market-preview- Market preview
market-preview is its own market on OpenFill. A request names market-preview, sets a price limit, and pays the level the market is clearing at when it runs.
A preview of the market, which opens soon. Its prices are simulated until then; fixed-price models run today.
- Context
- 256k
- Tokens
- Max output
- 128k
- Tokens
- First token
- Pending
- Typical, last 7 days
- Throughput
- Pending
- Typical, last 7 days
- Cache hits
- Pending
- Of prompt tokens
The market now
The clearing level, the price of each token kind at that level, and the quote a locked request bids.
Clearing level · market-preview · preview
Per 1M tokens: $0.0171 cache-hit · $0.1707 cache-miss · $0.3414 output
A price_lock request pays at most the locked price, and cancels with no charge if it has not started within 10 seconds.
The basis is the margin over the level, and a ceiling rather than a charge. See how the lock works.
Specifications
- Context length
- 262,144 tokens
- Max output
- 128,000 tokens
- Model id
- market-preview
- Pricing ratio
- 1:10:20
The ratio weights a cache-hit, a cache-miss and an output token in the price. max_tokens above the max output is clamped down to it.
Performance
last 7 days · OpenFill trafficTime to the first token, generation speed and cache hits on this model's own requests. Figures appear here once requests have run on it.
- First token
- Pending
- Typical, from dispatch
- Throughput
- Pending
- Typical, after the first token
- Cache hits
- Pending
- Of prompt tokens
- Requests
- Pending
- In the last 7 days
| Prompt | First token | Throughput | Cache hits |
|---|---|---|---|
| Under 1k | Pending | Pending | Pending |
| 1k to 4k | Pending | Pending | Pending |
| 4k to 16k | Pending | Pending | Pending |
| 16k to 64k | Pending | Pending | Pending |
| 64k to 256k | Pending | Pending | Pending |
| 256k and over | Pending | Pending | Pending |
Typical requestFirst token at p95
Uptime, last 24 hours
Each check is a chat completion through the public API, run the way the models board describes.
Uptime
Pending
Checks
0
Failures
0
Latency
Pending
Queue wait
Pending
Checks begin when the market opens.
market-preview Base URL https://api.openfill.ai/v1Set OPENFILL_API_KEY to a key from API keys before running an example. A key starts with of_live_ and is shown once.
import osfrom openai import OpenAI client = OpenAI( base_url=( "https://api.openfill.ai/v1" ), api_key=os.environ[ "OPENFILL_API_KEY" ],) r = client.chat.completions.create( model="market-preview", messages=[ {"role": "user", "content": "hi"} ], extra_body={"price_limit": 0.10},)print(r.choices[0].message.content)print(r.usage)import OpenAI from "openai"; const client = new OpenAI({ baseURL: "https://api.openfill.ai/v1", apiKey: process.env.OPENFILL_API_KEY,}); const r = await client.chat.completions.create( { model: "market-preview", messages: [{ role: "user", content: "hi" }], }, { headers: { "X-Price-Limit": "0.10" } },);console.log(r.choices[0].message.content);console.log(r.usage);curl "https://api.openfill.ai/v1/chat/completions" \ -H "Authorization: Bearer $OPENFILL_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "model": "market-preview", "messages": [ {"role": "user", "content": "hi"} ], "price_limit": 0.10 }'