Why Inference Will Get Dirt Cheap Fast
We are no longer afraid that AI doesn’t work. Every day, we see it with our own eyes. No, the most persistent fear is that this honeymoon period is just temporary. Right now, in a fight for market share, the token dealers sell us inference at a loss, hoping to hook us. Once the market is saturated, they’ll start charging us the real deal. And at that point, all these cool new toys become prohibitively expensive. ...