check the attached file where i mentioned code which you have to add in robot.txt file: If you have any issue then let me know.