Search results

Модель при тестах потребляет в 50 раз больше VRAM

Status: Open.

#29 In ai-forever/MERA;

· JohnConnor123 opened on Jan 10, 2025

no targets in rummlu and others benchmarks

Status: Open.

#23 In ai-forever/MERA;

· thehir0 opened on Jun 6, 2024

0.4.0 lm-evaluation-harness

good first issueGood for newcomersGood for newcomers

Status: Open.

#15 In ai-forever/MERA;

· germanjke opened on Mar 6, 2024

Значения логов бенчмарка

good first issueGood for newcomersGood for newcomers

questionFurther information is requestedFurther information is requested

Status: Open.

#14 In ai-forever/MERA;

· thehumit opened on Feb 20, 2024

Как бенчмарк закрытой модели, у которой нету метода loglikelihood?

Status: Open.

#11 In ai-forever/MERA;

· chorus12 opened on Feb 8, 2024

[Feature Request] Support for OpenAI ChatCompletion models

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

Status: Open.

#10 In ai-forever/MERA;

· kristaller486 opened on Jan 30, 2024

Как добавить форматирование промпта?

good first issueGood for newcomersGood for newcomers

Status: Open.

#4 In ai-forever/MERA;

· dmitrymailk opened on Nov 28, 2023