Rainbows are always like that. Go in a plane while looking at a rainbow, you'll see. They also follow you because they are based on your vision, everyone sees their own rainbow because it's your own eyes reacting to the sun light refracting off water droplets.
Comments