Software Engineer Runs Generative AI on 20-Year-Old PowerBook G4

Andrew Rossignol, a software engineer, successfully ran a generative AI on an old PowerBook G4 laptop from 2005, which has a 1.5GHz PowerPC G4 processor and 1GB of RAM. Despite the outdated hardware, he was able to achieve inference with Meta's LLM model Llama 2 on the laptop. To accomplish this, he ported the open-source llama2.c project and utilized a PowerPC vector extension called AltiVec to accelerate performance. The full blog post provides more technical details about the project and how he overcame the hardware limitations.