Your Speed drops to 2 if your Speed was higher than 2 and you cannot benefit from increases to Speed.