Answer

The vase is called ‘that vase’ as if it is attached a certain stigma, perhaps it is not a very nice one. Maybe it has some special sentimental value. It is separated out from the rest of the ideas as if it does have some special, significant value. The vase is almost like an empty vessel, like Larkin’s feelings for the house and the house itself, which is empty.