Scientists have found that the earliest ancestor of the horse was a small animal about 10 to 20 inches tall. About 3 million years ago horses probably looked somewhat like modern horses. They were larger than their ancestors. No one was able to find out where horses originated. Different fossils show that during the Ice Age horses lived on every single continent on earth except Australia.