[Warning: Extreme Political Incorrectness Ahead!]
Here’s an interesting article that says that human tribes without words for numbers larger than very small numbers (e.g., one) have trouble counting:
Some argue that–at least until recently–the Pirah