The problem with open weight models is that they are still hard to deploy. For DeepSeek for example you require NVIDIA HGX B200, these things are expensive.
Yes, unfortunately they are, and I do think efficiency is going to be a significant research front for open-weight models. The nature of this topic is highly speculative as our compute capabilities have only recently reached what is required to consider running generative AI models, what we have today are very crude first implementations of what I personally believe will become an everyday tool for developers, and more.
And we have seen this, there are models now capable of running on an individual’s hardware (and not particularly expensive hardware either) that can outperform what ChatGPT initially launched with.
The problem with open weight models is that they are still hard to deploy. For DeepSeek for example you require NVIDIA HGX B200, these things are expensive.
Yes, unfortunately they are, and I do think efficiency is going to be a significant research front for open-weight models. The nature of this topic is highly speculative as our compute capabilities have only recently reached what is required to consider running generative AI models, what we have today are very crude first implementations of what I personally believe will become an everyday tool for developers, and more.
And we have seen this, there are models now capable of running on an individual’s hardware (and not particularly expensive hardware either) that can outperform what ChatGPT initially launched with.