Don't buy any ignition coils just yet. Ignore the O2 codes for now, especially if your miss occurs even when the engine is stone cold.
Swap #4 ignition coil with one from another cylinder, erase the codes, drive vehicle and see if the misfire changes cylinders. If no change, do the same with...