Early access
Five ways to work with us.
XLNC offers five ways to work on measurement and evaluation, starting with a Design-Partner Readout that explains one score change in about 30 days. Each starts with a short request and is offered as early access, because our results are early evidence and not yet certified.
Design-Partner Readout.
For one score change you need explained. Send a redacted slice of the evaluation data you already keep, traces included. In about 30 days you get a written early read of how much of the change came from the model, the judge, the dataset, the task, and the prompt.
Early access. An email address is enough to start.
Hosted AIM.
For teams that would rather not run the measurement themselves. The hosted service is designed to score your work only through judges measured on the same ruler, each reading dated and marked as early evidence.
Early access, by request. Routing between judges is in build. Five judges hold credentials at levels 6 to 10 under our earlier procedure; re-credentialing under our stricter new procedure is under way.
Self-hosted container.
For data that must stay on your side. The harness is designed to run in your own environment, with the model endpoints you pick, so your traces do not pass through our servers.
Early access, by request.
Custom measurement work.
For one decision you face that needs its own measure. A pilot scoped with your team, with your LLM judges and your human raters on one ruler.
Scoped with your team before any work starts.
Updates.
For judges that change under the same name. Updates is designed to keep your judges measured as their providers change them, with every reading dated. We are developing and piloting it now. In one published study, GPT-4's accuracy at telling prime from composite numbers fell from 84% to 51% in three months, under the same name (Chen, Zaharia and Zou, 2024).
In development. Ask and we will tell you when it opens.
Tell us which one fits.
Tell us which of the five fits your team, and the number behind it.
You will get a short note from Matt when a measurement slot opens. Nothing else, no drip sequence.
We store what you send with the few providers our Privacy Policy names, and use it to reply to you. We do not sell it. Email matt@xlnc.co and we delete it. Read our Privacy Policy.