India will start their World Cup campaign against five-time champions Australia at Chennai on October 8.
The off-spinner is back in contention for a place in India's World Cup squad.
In a deciding Super Four contest, the hosts won by 2 wickets.
The pacer will be replaced by 22-year-old Zaman Khan, who has yet to make his ODI debut.
Kaur has been penalised for two offences during India's third ODI against Bangladesh on Saturday.
The third Test will be played in Indore from March 1 and the fourth in Ahmedabad from March 9.
Abdurahiman has blamed the weather and even the quality of Sri Lankan cricket.
V Abdurahiman made the controversial comment when asked about the higher entertainment tax on the match tickets.
The match will be played at the Greenfield International Stadium on January 15.
Jasprit Bumrah last played for India in September and had also missed the T20 World Cup in Australia due to a back injury.