@SemiAnalysis_ recently found something bizarre in the economics of AI coding subscriptions. If you run them at max usage limits, you’re actually paying 20x-70x cheaper than you would buying tokens through the API. Many people looked at this and said: oh my god, look how much the labs are subsidizing tokens, the bubble must be about to pop soon. This is the wrong response. The reason why labs are willing...
read more
I used to tell founders, the reaction you are going to get to your launch is not hate, it’s indifference. By default, nobody cares about your new chain. I have to stop telling them that now. Monad just launched this week, and I’ve never seen so much hate about a blockchain that just launched. I’ve been investing into crypto professionally for 7+ years now. Before 2023, almost every chain I’ve...
read more
Say you want to run a large language model like Llama2–70B. A model this massive requires more than 140GB of memory, which means you can’t run the raw model on your home machine. What are your options? You might jump to a cloud provider, but you might not be too keen on trusting a single centralized company to handle this workload for you and hoover up all your usage data....
read more
