What do we test?
What LILI can really do on demanding work: analysis, judgement and decision support, task by task, against leading single models answering the same questions.
NEOLABS · NEO AI
NEOLABS measures what LILI, the brain of NEO AI, can do on demanding work, and publishes every official test with its methodology, its results and the proof that they were not changed.
What is NEOLABS
NEOLABS is the testing programme of NEO AI. It answers four questions, every time, for every official test.
What LILI can really do on demanding work: analysis, judgement and decision support, task by task, against leading single models answering the same questions.
Real calls at real prices. The platform times every answer, prices every call from the tokens the provider reports, and two independent AI reviewers score each answer blind.
Every result is sealed in the Proof Ledger, a hash-chained register, then time-stamped by DigiCert under RFC 3161. Anyone can check the proof files without us.
Each official test is versioned, run under the same published rules and compared with the next. The archive grows with every edition.
How NEOLABS tests LILI
Follow one official test from start to finish. Select a step, or let the journey play.
34 original analysis tasks (decision memos, risk assessments and reviews of evidence), in English and French. Task set v4-2026-11-17, frozen before the test. Each task answered once by each of the five systems.
Tokens reported by the provider for each call, multiplied by the price table in force on the day. One line per call, including LILI's verification calls.
Server timestamps at the start of each request, at the first text and at the final answer. The reported time is the median over the tasks.
Two independent AI models, from two providers that wrote none of the answers, scored each anonymised answer out of 10 without knowing its author. The score of an answer is the average of the scores returned for it.
hash = SHA-256( prev_hash || canonical({id, at, kind, account_id, actor_id, run_id, conversation_id, message_id, payload}) ); canonical = JSON with object keys sorted and no spaces. The entry is time-stamped under RFC 3161 by DigiCert.
Proof & verification
The Proof Ledger proves that a record has not changed. An outside authority proves when it was made.
Every official test is recorded in NEOLABS' built-in Proof Ledger. Cryptographic hashing makes changes to sealed records detectable, so the integrity of the recorded results can be checked.
This demonstration recomputes the real SHA-256 of entry no. 1285 in your browser. Altering one figure (170 answers becomes 171) changes the hash, and every later link breaks.
In the second the campaign ended, the hash of its sealed entry was sent to DigiCert, a public certificate authority, under RFC 3161, the international standard for trusted time-stamps. DigiCert signed the hash with its own clock. Only 32 bytes left NEO AI: no question, no answer, no figure, no name.
Results timestamped by DigiCert · RFC 3161
Download the entry and recompute its SHA-256 with the published rule.
Download the RFC 3161 token and read what it certifies: the hash, the time and the serial.
The cryptographic signature is checked with free software and DigiCert's public root certificate. One command, without NEO AI:
openssl ts -verify -in test-2-ledger-1285.tsr -digest b6aec2b0fd46d143fac82b8ba9c63e0edf960084c93b2fbb24456fd2baedb7f2 -CAfile digicert-trusted-root-g4.pem
Expected answer: Verification: OK. Root certificate SHA-256 fingerprint: 55:2F:7B:DC:F1:A7:AF:9E:6C:E6:72:01:7F:4F:12:AB:F7:72:40:C7:8E:76:1A:C2:03:D1:D9:D2:0A:C8:99:88.
The results digest (fb70d29b...8c5b) covers the 170 answers and 396 judgements; recomputing it needs those records, which are available on request under confidentiality. The ledger entry and the token can be checked by anyone with the files above.
Official tests
Every published edition stays online at a permanent address, with its report, its Public Edition and its proof files.
PUBLISHED · 18 NOVEMBER 2026
34 analysis tasks · 5 systems · 170 completed answers
LILI and two leading single models answered the same 34 analysis tasks through real calls at real prices. Every answer was timed and priced by the platform, scored blind by two independent AI reviewers, sealed in the Proof Ledger and time-stamped by DigiCert in the second the test ended.