NEO AI · NEOLABS

NEOLABS · NEO AI

Official LILI Capability Tests

NEOLABS measures what LILI, the brain of NEO AI, can do on demanding work, and publishes every official test with its methodology, its results and the proof that they were not changed.

Published MethodologyCryptographically Sealed ResultsIndependently Timestamped Proof

What is NEOLABS

The test bench of LILI, in the open.

NEOLABS is the testing programme of NEO AI. It answers four questions, every time, for every official test.

01

What do we test?

What LILI can really do on demanding work: analysis, judgement and decision support, task by task, against leading single models answering the same questions.

02

How do we measure it?

Real calls at real prices. The platform times every answer, prices every call from the tokens the provider reports, and two independent AI reviewers score each answer blind.

03

How do we prove it?

Every result is sealed in the Proof Ledger, a hash-chained register, then time-stamped by DigiCert under RFC 3161. Anyone can check the proof files without us.

04

How is LILI progressing?

Each official test is versioned, run under the same published rules and compared with the next. The archive grows with every edition.

How NEOLABS tests LILI

Seven steps from a frozen task to a public proof.

Follow one official test from start to finish. Select a step, or let the journey play.

Step 1 of 7

Frozen task set

The tasks are written and frozen before the test. Every system receives exactly the same wording.

  • 34 original analysis tasks in English and French
  • Decision memos, risk assessments and reviews of evidence
  • Version v4-2026-11-17, locked before the first call
The detailed methodology sheet

Scope

34 original analysis tasks (decision memos, risk assessments and reviews of evidence), in English and French. Task set v4-2026-11-17, frozen before the test. Each task answered once by each of the five systems.

Systems

  • NEO AUTO - LILI, balanced profile: a first answer, an independent verification, and a stronger model only when needed. Through LILI.
  • NEO PULSE - LILI, speed profile: the fastest route to an answer. Through LILI.
  • NEO PRIME - LILI, economy profile: the lowest cost per answer. Through LILI.
  • Claude Opus 5.5 - Reference: a leading single model. One call, no orchestration.
  • GPT-5.5 - Reference: a leading single model. One call, no orchestration.

Cost

Tokens reported by the provider for each call, multiplied by the price table in force on the day. One line per call, including LILI's verification calls.

Time

Server timestamps at the start of each request, at the first text and at the final answer. The reported time is the median over the tasks.

Quality

Two independent AI models, from two providers that wrote none of the answers, scored each anonymised answer out of 10 without knowing its author. The score of an answer is the average of the scores returned for it.

Statistics

  • A comparison pairs one LILI profile with one reference model on the tasks both answered.
  • Paired sign-flip test, 20,000 flips, seeded; significant at 0.05 after Holm's correction over all 24 comparisons of the run.
  • At least 10 paired tasks; the size is the mean paired difference with its 95% bootstrap interval.
  • Anything else is reported as not shown, never as a tie or a win.

Proof

hash = SHA-256( prev_hash || canonical({id, at, kind, account_id, actor_id, run_id, conversation_id, message_id, payload}) ); canonical = JSON with object keys sorted and no spaces. The entry is time-stamped under RFC 3161 by DigiCert.

Limits

  • One run, on one day, on the network of the server: times include the providers' queues and change from day to day.
  • Quality is judged by AI models, not by people: two reviewers from other providers than the answers, blind to the system; their agreement is reported.
  • Costs are priced from the tokens reported by each provider and the price table in force on the day.
  • Some providers do not stream their answers: time to first text is not compared in this test.

Proof & verification

Two levels of proof. Check them yourself.

The Proof Ledger proves that a record has not changed. An outside authority proves when it was made.

LEVEL 1 · PROOF LEDGER

Sealed in a hash-chained register

Every official test is recorded in NEOLABS' built-in Proof Ledger. Cryptographic hashing makes changes to sealed records detectable, so the integrity of the recorded results can be checked.

No. 1284

hash
cdf86806c642e143…
link
to no. 1283

No. 1285 · Official Test No. 2

answers
170
results
fb70d29bf897…
prev
cdf86806c642…
hash
b6aec2b0fd46d143…

Next entry

prev
b6aec2b0fd46d143…
link
intact
Recomputed: matches the sealed hash

This demonstration recomputes the real SHA-256 of entry no. 1285 in your browser. Altering one figure (170 answers becomes 171) changes the hash, and every later link breaks.

LEVEL 2 · INDEPENDENT TIMESTAMP

Certified in time by DigiCert

In the second the campaign ended, the hash of its sealed entry was sent to DigiCert, a public certificate authority, under RFC 3161, the international standard for trusted time-stamps. DigiCert signed the hash with its own clock. Only 32 bytes left NEO AI: no question, no answer, no figure, no name.

  • The results cannot be changed afterwards. Any change to an answer, a score or a cost changes the fingerprint; the token would no longer match.
  • The date cannot be moved. No one can obtain a token with an earlier time.
  • The whole history is covered. Each entry contains the hash of the one before, so one token covers all 1,285 entries up to this test.

Results timestamped by DigiCert · RFC 3161

Official Test No. 2 - proof of record

Time certified
Proof Ledger entry
No. 1285 (lab.campaign, sealed 2026-11-18 12:10:44.240 UTC)
Token serial
5da7bc65955b06f9c5efc6871bbf4a10
Hash signed
b6aec2b0fd46d143fac82b8ba9c63e0edf960084c93b2fbb24456fd2baedb7f2
Signed by
DigiCert SHA256 RSA4096 Timestamp Responder 2026 1 · RFC 3161 · root DigiCert Trusted Root G4
Third-party timestamp - doneVerified: DigiCert RFC 3161 token over ledger entry no. 1285.
External audit - not yet performedNot yet performed. The test has not been audited by an external party.
Independent replication - not yet performedNot yet performed. The test has not been reproduced by an outside party.

Official tests

The public archive.

Every published edition stays online at a permanent address, with its report, its Public Edition and its proof files.

PUBLISHED · 18 NOVEMBER 2026

Official Test No. 2

34 analysis tasks · 5 systems · 170 completed answers

LILI and two leading single models answered the same 34 analysis tasks through real calls at real prices. Every answer was timed and priced by the platform, scored blind by two independent AI reviewers, sealed in the Proof Ledger and time-stamped by DigiCert in the second the test ended.

Read the reportPublic Edition (PDF)