Learning to use local AI is exciting, overwhelming, and frustrating

The Verge explores the growing trend of running artificial intelligence models locally, moving away from cloud-based services to protect personal data. The author documents their personal journey of setting up and experimenting with powerful open-source models like Hermes and Qwen on a Mac Studio. While the ability to leverage AI locally offers significant privacy benefits and control, the process is described as a steep learning curve. The article highlights the contrast between the excitement of accessing advanced capabilities and the technical frustrations encountered during setup and optimization. By testing these models on consumer hardware, the piece provides a realistic look at the current state of local AI, emphasizing that while the technology is becoming increasingly accessible, it still requires a level of technical patience and troubleshooting that may be daunting for the average user.