Scott Jaffe was a Boston native who started college at Harvard, where he earned All-American honors. Jaffe attended the 1988 Olympic Trials but failed to make the US team and stopped swimming for eight months after that disappointment. He began to swim again with the Boston Scrod, an unusual swim team that eschewed mega-distance and heavy load training in lieu of shorter training distances with an emphasis on technique.
After starting with the Scrod, Jaffe, who had started doing IM and breaststroke, switched to an emphasis on freestyle sprinting. He also transferred to U Cal Berkeley where he again earned All-American status. He finished second in the 200 freestyle at the 1991 US Nationals and made the 1992 US Olympic team, winning a bronze medal in the 4x200 freestyle relay.