Answer

It is a phrase which was used to described a person of mixed race. It is not used much now.

The term originates in India, where people of different races were not allowed to mix together.

Halfe-caste also means only half made, so the speaker stands on one leg in the opening stanza as if the other isn’t there.