That's the breaks

Would like to know the origin of "that's the breaks" haven't been able to find -perhaps it's too obvious. Somehow, though, I thought it had to do with gambling or something like that. Any ideas would be most appreciated.