James Allen Kline was born near Siddonsburg, Pennsylvania, on May 20, 1874. At the age of 18, Kline began an apprenticeship with the Cocklin Brothers optical business in Harrisburg, Pennsylvania, during which he became interested in bicycles and performed well in several amateur events.