I’m on a laptop so adding a suitable GPU isn’t an option.
The code used for LLMs is madly inefficient right now. We should see 8x improvement once someone optimises it, that combined with processor improvements in the next few years should see impressive speed advances. I’m assuming the next generation of main processors will have GPU-like qualities ready for this sort of processing too.