Quoting Will Whitney
Dec 16, 2024
Some interesting ideas from Will on using generative AI to either manage the set of UI components shown to the user or generating the UI in raw pixels on the fly as we’re starting to see in gaming (i.e. Genie 2). I think a pixel based approach would be very complicated to do reliably, but an approach where a model dynamically generated the UI from a set of pre-defined components would be very interesting. Worth a read and a ponder about where we’re headed:
In place of a single static application built by a developer, a model will generate a bespoke application for the user and their immediate needs. In place of business logic implemented in code, the model will interpret the user’s inputs and update the UI. It’s even possible that this sort of generative UI will replace the operating system entirely, generating and managing interfaces and windows on the fly as needed.