I've got an SE and I really like it.
Coming from an LG G4, the best feature is its size, it's great not having to worry about where to put the phone anymore.
And another thing I realized: while a big screen is definitely better for certain tasks, I really don't need it because during the time I really want to sit down and read a lot of web pages, write emails etc. I usually have a notebook nearby and do can do those things much better on my notebook.
And for the rest of the time, I simply do things where carrying a big phone around is more of a hassle than a benefit. YMMV.