In that he saith, A new covenant, he hath made the first old. Now that which decayeth and waxeth old is ready to vanish away.
He says there's a new agreement, so the old one is not needed anymore. Anything that gets old and weak will eventually disappear.