I would never put something in my brain that doesn’t at least have a public API documentation. If the company discontinued the product I want to be able to keep using it. Open Source software would be best.

One of the papers about it https://arxiv.org/pdf/2206.07682.pdf

But bigger models have new “emergent” capabilities. I heard that from a certain size they start to know what they know and hallucinate less.