I have them both.
I drive the Samurai (4.5" SPOA, 30" tires and Tracker seats - which help a little) long distances ONLY to Zukimelt (945 miles RT) and then if I am in a particularly dumb mood.  Last year, I drove it pulling an overloaded 4x8 trailer via SE Arkansas thus proving to my kidneys and lower back that my mind is not to be trusted.
Occasionally, I'll commute 13 miles to work in the Samurai just to scare the other drivers when I feel like it.  Assuming it's not in pieces.  The rest of the time I drive the 'Kick 4 door (JLX!) 'cause I'm getting too old for regular beatings except for the regulation ones at work ÂÂ

.
If'n I was young again and looking for a cheap 4x4 daily driver, I would  get a 2-door Tracker or Sidekick.  If I was young, had an iron constitution, had no money to speak of AND had a love for the classics, It's a Samurai.