Harry Karl was a businessman and had his own shoe store. In 1959, Karl's Shoe Stores, which he took over in 1952, was the nation's largest privately held retail shoe chain. In his whole life, Harry Karl had got married for five times in total. Karl first married to his first wife Ruth Lamb in 1960 after her divorce from Eddie Fisher. Their marriage ended 13 years later, then again Karl was married twice between 1947 and 1958 to Marie McDonald. And after the divorce with McDonald, he again got married to Joan Cohn, a widow of Harry Cohn. Then again after living together for about just two months, he divorced Joan and then got married to her last wife Debbie Reynolds with whom he later divorced again.
Unfortunately, at the age of 68, Harry Karl died because of the complication of cardiac surgery in Los Angeles California, on 7 August 1982 and buried at Forest Lawn Memorial park. He had a child with Ruth, three children with McDonald, but on the death day of Karl, no one was with him.