He first became a member of the Canadian House of Commons at the Fraser Valley West electoral district which he won in the 1968 federal election. Rose made an earlier, unsuccessful attempt at the Fraser Valley riding in 1965. He served two terms in the 28th and 29th Canadian Parliaments before being defeated by Robert Wenman of the Progressive Conservative party in the 1974 election.
Rose returned to Canadian Parliament in the 1979 federal election with a victory at the Mission—Port Moody electoral district. After a term in the 31st Canadian Parliament, he was re-elected in 1980 but resigned from his seat before completing his term in the 32nd Canadian Parliament to campaign in the British Columbia provincial election. He won his campaign and became a member of that province's Legislative Assembly.