Which (realistic) feature(s) would you most like to see added to LLMs?

The ability to run completely on our own (affordable and completely private) devices would be nice.. wonder how many years before that will be possible? (Perhaps a good topic for a poll/thread!)

• Memory, (much) larger context, consistent predictable performance.
• Understanding diagrams, charts, formulas etc.
• A conceptual understanding of the real world. How it works and why it works. This would improve quality, and extend AI for use in many real world areas. Chair design, car dynamics, road work planning, material science, medicine etc.
• Adding curiosity, direction and self-learning. Point it in the direction of curing cancers and have it deep dive for a year or three. (Likely comes up with 42).
• Critical sense and keeping a tree of relations and truths from the ground up from hard basic truths. Say this new source claims this - how does it fit in with what I already know, how do I know what I know, how sure am I about what I already know, and if in conflict what seems more likely to be correct? Can both be true if a third concept is changed? How do I know that one and so on. Then keep an open mind on the options for later in case new evidence shows up in support of one or the other. Only discard claims in conflict with hard truths.

• Realtime memory

• An actual model for simulating the world it lives in, instead of just being an (amazing) next token prediction function.