Especially on small machines, you might want to look at information about llamafile from links in this page: https://www.oreilly.com/radar/radar-trends-to-watch-january-2024/