My 2012 laptop finally caught up with a 2024 AI tool
Read a post about local LLMs running on old hardware, tried it on my 12 year old ThinkPad from a pawn shop in Phoenix, and it handles a 7B model slow but steady, has anyone else squeezed new AI onto ancient machines?
Old laptops are like zombies, they just keep shambling along. My buddy had an ancient Dell from like 2009 that he turned into a Minecraft server and it ran for years without complaint. The other day I tried loading a 70B model on my 2015 MacBook Air and it basically turned into a space heater, took like five minutes just to say hello. But honestly, there's something kind of cool about watching a machine that old chew through something that uses so much math. It's like watching your grandpa try to understand TikTok, slow but somehow still kind of impressive. I bet that ThinkPad of yours has more personality than half the new laptops out there anyway.