One of the purposes of the Buddha’s coming was to break the extreme ritualism that had become the dominant Vedic interpretation, the rigid caste system based on birth etc. The truth of the Vedas was lost in Vedavada, intellectual debates and philosophical schools rather than the living experience through which the Vedas should be transmitted.
But more importantly, the Anatmavada of the Buddha, not-Self which came to be interpreted as no-God attracted a substantial group of humanity that does not want to believe in a higher Power or had even revolted against it. That is why perhaps even now Buddhism has a greater appeal outside the Indian soil as it opens a door of escape for even the Atheist and the Agnostic to turn towards a higher and nobler way of life.