Joanne,
You can do with out any issue, As shakthi said better not do because it may problem with Server issue and supporting packs issue its won't work done properly.
Except service packs bugs there is nothing much effect with in 4.0 and 4.1 as per my knowledge.
let me know if you face any issue while doing promote and I'm happy to reply you back.
Thanks
venkat