#low-rank

1 article tagged low-rank.

TopicRepliesVotesActivity

EGGROLL: low-rank evolution strategies make gradient-free LLM fine-tuning fast
Sciences Mathematics evolution-strategies eggroll llm-fine-tuning black-box-optimisation
EGGROLL structures evolution-strategies perturbations as low-rank matrices, giving a 100x speedup for billion-parameter models and GRPO-competitive reasoning post-training.
0 replies0 votes1mo
0reply
0vote
1mo