On foot
Incorrect: We went there with the feet. Or, We went there on our feet.
Correct : We went there on foot.
Note: "On foot' is a fixed phrase which means "by walking”.
Watch video to know: Shipwreck more tragic than Titanic https://youtu.be/7IVaHgxHU20