Papa had quite a colorful youth