There are no open source AI models, at least not useful ones (yet [1]). Open weight is not the same as open source. "Open weight" models are still just inscrutable binary blobs that you can (theoretically) run on your own computer instead of through a SAAS web app. The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.
This is not open source and we should stop conflating the two things.
Completely agree with this, I'm sick of people conflating the two. Open-weight models should be treated no more favourably than proprietary freeware.
Sure you can run tests and benchmarks on open-weight models, but that is the extent - there is no scrutiny, no auditing for bias or copyright contamination - just a black box that you rely on for "intelligence". I'm still shocked the way people can hand over not just huge swathes of data, but also decisions of all shapes and sizes - to AI companies with no way of being able to assess how the sausage is made.
> Open-Source AI
There are no open source AI models, at least not useful ones (yet [1]). Open weight is not the same as open source. "Open weight" models are still just inscrutable binary blobs that you can (theoretically) run on your own computer instead of through a SAAS web app. The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.
This is not open source and we should stop conflating the two things.
[1] https://allenai.org/
>The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.
because the training data is full of copyrighted works.
the answer to "what went into the training data" is "everything we could get our hands on".
Completely agree with this, I'm sick of people conflating the two. Open-weight models should be treated no more favourably than proprietary freeware.
Sure you can run tests and benchmarks on open-weight models, but that is the extent - there is no scrutiny, no auditing for bias or copyright contamination - just a black box that you rely on for "intelligence". I'm still shocked the way people can hand over not just huge swathes of data, but also decisions of all shapes and sizes - to AI companies with no way of being able to assess how the sausage is made.
I think you would be pleasantly surprised by the content of the linked article.
I thought Nemotron tried to be pretty open?
How about learning the internals of LLMs, is Sebastian Raschka's content still the best in 2026?