fix unused parameters error for distributed training with multihead#1311

Open

bernstei wants to merge 1 commit intomainfrom

unused_parameters_readout_bias

Commits on Dec 18, 2025

when copying readouts from foundations models, don't copy if tensor has size 0, to avoid unused parameters error
Noam Bernstein
committed