Going to Japan once could probably not hurt. As long as you sufficiently prepare so you don't look like a typical tourist and have overwhelming embarrassment wash over you each second.
The world has always been a merciless place for travelers. It's for the best that it's that way. Scenic tourists damage the land, and tourists of places leave filth and wear down historic sites faster than nature could hope to do.
I wish it weren't that way. I just want a change of scenery in my life, but I know there's tons of others pining for that same thing.
Most of the world is the same people with small changes. It's only what they eat and the lands they live on that change
The problem is that tourists are everywhere and everything is for tourists. It takes the charm from an old building when it's surrounded by modern carparks full of cars, has a lift build into the foundation to get to it and is absolutely full of people. Flying is a pain as well.
If I was a millionaire I might do it and just do to more rural and harder to reach places. Though if I was that rich I would probably just move to Europe and then when ever I felt like visiting a castle or something I could get there in not long with little effort.