A Banker's dozen
is a play on the name Baker's dozen
; it is one less than a dozen as compared to one more. It alludes to a method of lending where the interest is deducted beforehand, e.g. borrowing (owing) ten dollars but actually receiving only nine.
You might relate it to the baker's dozen because it has a similar but opposite principle. Instead of adding one number, it subtracts one.