The easiest approach would be configuring Linux to do this.
I have a Linux laptop without X or Wayland. It's mostly for CLI and TUI applications, but I do have some framebuffer applications like fbpdf.
There are a lot of little annoyances, many of which could be fixed with a proper Linux configuration, though others require improvement to the applications.
The framebuffer versions of graphical programs are unfortunately clunky compared against the conventional versions. And I'm disappointed that they don't work when called from tmux or Midnight Commander, or at least I haven't figured out how to make them work.
Some key combinations don't seem to work and I haven't been able to figure out why for all of them yet.
I miss having a unified clipboard.
I've also become more adept at Midnight Commander and its built in editor, diff tool, and viewer. Though this exposes some issues, for example: If a file is edited with F4 configured to be mcedit, then I can switch between the editor and file manager with the screen list (Alt-`). But if I open mcedit from the command line or user menu, then the screen list will only be for that mcedit run and not include any other screens open. I rarely use the Midnight Commander screen list outside of this specific computer.
(As for why I have this computer, it's to have a distraction-free setup. It works nicely for that purpose.)