There are tons of players in the league today that are very good to great that were not drafted. Bart Scott was never drafted. Neither was Kurt Warner or Tony Romo. I'm sure there are tons of others too. I know Herm never was, and he was a pretty good DB.
I'm not worried at all.