5.9GB 27B was 6x faster when loaded on GPU — but on CPU alone, it took 35 minutes to respond: Bonsai 2 27B actual measurement

Hello! This is YaroTech.I tested the Bonsai 2 27B that I wrote I would try tomorrow yesterday.Related article: 27B is 5.9GB?