Naming Ideas

[reisepass]

dEval (Decentralized Evaluation )
mpEval (multi party evaluation )
Robust Multi Party Rolling Evaluation (RMRE)
Perpetual Multiparty Evaluation (PMRE)
Perpetual Decentralized Evaluation (PDE)
Robust Generalization Error (RGRE)
Perpetual Blind Generalization Error ( PBGE)
Multi Party Benchmarking (mpBench) [minor prior ]
PeerBench
deBench [ minor prior art ]
RobustEval

[reisepass]

RobustBench is very much taken https://robustbench.github.io/

[saifmir700]

Instead of PMRE, thoughts on "Continuous Multiparty Evaluation" and making it CME rather than CMRE?

Also, PeerEval or EquiBench(equitable benchmarking) could be more memorable.

[CiTy-NG]

As a first reaction, the more memorable names seem well-suited for the blockchain industry, while the longer, more precise acronyms might resonate more with academia. Wondering who peeps want our ideal audience to be, both in terms of adoption and legitimacy, when choosing a name.
If we’re aiming for a balance between memorability and precision, one option could be Dynamic Decentralized AI Evaluation (D-DAE). This strikes a middle ground and might also be easy to recall, given its phonetic similarity to "D-Day".
Cool stuff all round; excited to see where this goes!

[Leibniz-01]

For reference some academic / AI project names dynaBench mlCommons lmSys liveBench

[reisepass]

Sal :

dEval

[reisepass]

I'm getting a lot of good feedback on PeerBench . Peer like peer review . And peer like p2p .