When there are double lines you should abide by the one closest to you.

If you have passed over to the opposite lane, you may nonetheless pass back to the right side of the road.