To take on the undying samurai, you must first find four hidden windchimes in Ghost of Yotei's Ishikari Plain region.

There's an out of reach ladder at the Altar of Reflection near the Stone Spire Hideout in Ghost of Yotei, but there is a simple trick to it.