Girls would often "go out on a limb" for Andre the Giant