Harvey was born as Harvey Skolnik. He grew up in Plainfield, New Jersey. Harvey started his career in New York City as comedian Sandy Baron's manager. Harvey furthered his career by working with his close longtime friends: Garry Marshall, Penny Marshall, Albert Brooks, James L. Brooks and Jerry Belson,

Harvey helped create Love American Style with Bill Idelson. Harvey also loved meeting celebrities so when he was head writer and director of TV's The Odd Couple, his invigoration of the show by introducing big name talent served dual purposes. Harvey was responsible for integrating the following people into the show: Howard Cosell, Bobby Riggs, Billie Jean King, Paul Williams, Betty White, Allen Ludden and many others.