"They already have three sons, aged 8, 6 and 4 and this was their fourth child," a police officer told the Indian Express.
"Bitto spoke of getting mocked by his friends for having four children in such quick succession and I think that is why he was disturbed. His friends would often apparently comment on the size of his wife's belly and keep prodding whether she's pregnant.
The two now face child abandonment and cruelty charges.
The baby was admitted to hospital and is reportedly healthy.