We present numerical and experimental evidences for multiple shear band formation in sheared granular materials. A modified Couette cell with a split bottom near the outer cylinder is made rough by gluing glass beads on all boundaries. The cell is filled with the same beads and sheared by slowly rotating the inner cylinder and the attached bottom disk. A wide shear band is mostly observed at the free surface of the material. However, depending on the filling height and grain size, simultaneous shear bands may form near the confining walls and in the middle of the system. By minimizing the rate of energy dissipation, we numerically find similar velocity profiles for intermediate filling heights and relatively large grain sizes.