I was interested in these “light” phones for a bit, but they seem a bit gimmicky and expensive. I understand not having a browser on purpose, but for communication, none of them (AFAIK) support Matrix or even XMPP (even some old feature phones had a Java Jabber client). Punkt MP02 supports Signal though.
Android phone with custom ROM (Lineage, /e/, Graphene, DivestOS…) is a possibility, and would be usable until hardware is incompatible with the phone/wifi networks.
If you have a patience of a saint, PinePhone and Librem5 are Linux phones, both in fairly early stages.
Fossify Messages and QKSMS/QUIK (unmaintained but has worked well for years)