Schwert was born in Angola, New York. He graduated from the Wharton School of the University of Pennsylvania in 1914. He played baseball for the New York Yankees from 1914 until 1915. He served in the United States Navy during World War I. He was elected to Congress in 1938 and served from January 3, 1939 until his death.