No, this is not an entrance, but a tiny niche (called a taqa).
Probably used to store a vase or a jug of water.