Skip to main content
To evaluate Mercury 3 through Rock API, first look up mercury-3 in the current model catalog. Confirm that your account and selected group can use it, record the supported endpoint and request limits, then test it against your own workload. A model name in an article does not establish current availability or access for every group. This guide focuses on integration and evaluation. Use Inception’s official site to find the vendor’s current model documentation and announcements. Context limits, benchmark scores, release dates, and migration deadlines need a specific current source before you use them in a production plan.

Check the route before writing code

Record these details alongside your evaluation results: OpenAI compatibility describes a request format. It does not guarantee that every model implements every OpenAI endpoint or parameter. Read the model integration guide before carrying over provider-specific options.

Send a minimal request

Follow authentication to configure ROCKAPI_API_KEY in your environment. Run this example only after confirming the model and endpoint above; it sends a billable request.
An OpenAI Python client can express the same basic request:
Keep the request time, model, group, and request ID when available. If a request fails, consult errors and rate limits before retrying repeatedly.

Reconcile pricing instead of assuming a discount

Open the model’s details and record currency, price unit, billing mode, input/output categories, and any cache or context tiers. Apply the actual group multiplier only if it is not already included in the displayed effective rate. Rock API does not promise a universal discount across models or requests. Top-up payment determines the balance credited to your account; it is separate from API consumption pricing. A temporary reservation can also differ from settlement. Follow pricing and billing and reconcile a completed request using its saved rates, usage categories, and group. Today’s catalog is not a substitute for a historical settlement record.

Measure latency and useful output

Use the same representative prompts, output requirements, concurrency, and client region for Mercury 3 and your baseline. Separate cold-cache and warm-cache runs when relevant. Record failures and retries rather than discarding them. For streaming routes, measure time to first content separately from time to complete output. Tokens per second measures only a defined generation interval; it does not include every network, queue, prompt-processing, or tool delay. For agents, measure the entire task and count tool errors and repeated steps. Compare median and p95 completion times, task success rate, and settled cost per accepted result. Verify factual correctness, output schema, language quality, and tool arguments. Expand traffic gradually only when the candidate meets your own acceptance criteria, with a tested rollback path to the previous route.

Start an evaluation

Create a Rock API account, check the model details, and use the quickstart to prepare a small evaluation. Set a budget and quality threshold before deciding whether to migrate.