On foot
Incorrect: We went there with the feet. Or, We went there on our feet.
Correct : We went there on foot.
Note: "On foot' is a fixed phrase which means "by walking”.