Per Olsen won his first medal at the Norwegian swimming championships in 1949 when he finished third in the 400 metres freestyle. Olsen only had to wait a year to win his first gold when he won the 100 metres freestyle title. He went on to win gold in the 100 metres butterfly (1952, 1953) and in the 400 metres freestyle (1956). In total he won ten medals at the national championships from 1949 to 1958. Olsen swam in the 100 and 400 metres freestyle at the 1952 Helsinki Olympics, finishing 44th and 36th, respectively.