In principle: yes. Things like font mapping, cursor etc are support by the framebuffer interface, but it takes a *lot* of bolt-ons.
I am working on the reverse: make the owner drawn widgetset use a frambuffer based canvas.
Note the framebuffer is actually legacy, but many - even new - applications still use it.