It's derived from the Latin word "bubalus," which referred to the water buffalo of Asia. When European explorers encountered the large, shaggy animals in North America, they mistakenly thought they were the same species and applied the name "buffalo" to them.
The North American animals are actually bison, but the name "buffalo" stuck and became the common term.