Discussion about this post

User's avatar
Caspar's avatar

This is really great thanks for sharing such an in-depth piece. I'd love to get your view on how the nature of the models that underpin the use cases potentially resolves these constraints.

Right now, we are using LLMs even for the smallest most trivial query. That is, as you rightly say, not even close to sustainable (Arguably even at the higher complexity use cases one might argue).

What happens when we have models that are right sized to tasks? Does that reduce the load to a point where the whole system constraint you are talking about resolves itself to the point where the unit economics make sense again?

Or is that something that is resolved by the move away from SaaS models to Tokenisation anyway?

1 more comment...

No posts

Ready for more?