I'm wondering if an app store video preview could be seen across multiple device sizes, or whether a different video is really required for each device size?
Yes you need a different video for each screen size. Resizing the video for the different screen size will also get rejected by apple.
Source Experience