I am uneducated, it's definitely not a term I have a problem with. And actually it's kinda liberating, as I feel I have more freedom to speculate and to philosophise.

This really does come down to what time actually is. It's not really about measurement, which is why it's not physics. I can totally understand why someone educated would dismiss these kind of speculations, because like your friend says, it's a waste of time when there are more productive things to think about. I'm not living within that boundary.