The US president - who flies to Japan on Wednesday for a G7 summit - scrapped subsequent stops in Papua New Guinea and Australia, instead returning to Washington on Sunday.
Congress general secretary Jairam Ramesh's attack came after Jaishankar slammed Mr Gandhi for his "habit" of criticising India abroad and said taking national politics out of the country is not in the nation's interest.