So the rate climbs in a straight line from 0 to its peak of 0.004 over the first 1,000 steps, then eases down along a cosine curve to a floor of 0.0004 at the final step. The cosine takes its argument in radians.
Reading through the training log, you note the learning rate recorded at step 325, during warmup.
At which step after the warmup does the schedule give exactly that same learning rate again?