According to Color Combos, brown goes with blue, light blue and shades of green. Brown and orange or varying shades of brown are also complementary matches.
Colors are thought to be experienced very personally and cause highly individualized responses in people, making it hard to claim which colors are the most complementary to brown. Limiting the principle colors and the number of contrasting or balancing tones tends to create an agreeable color scheme. Although there is no absolute consensus on which color scheme is the best to follow, colors are often used to create stimulation, relaxation or a sense of balance.