Apple could certainly release a minor update (iOS 5.0.2) in the next couple days to kill the jailbreak exploit. You should definitely get your iPad 2 updated to iOS 5.0.1 as Apple is certainly preparing an update to iOS to further stop jailbreakers. Apple has released iOS 5.1 beta 2 to developers which will certainly block the corona exploit.
You can use the newly released TinyUmbrella tool from @notcom to backup your iPad SHSH Blobs. This will allow you to save iOS 5.0.1 SHSH blobs for your iPad 2 (build 9A405) including the iPhone 4S second firmware (build 9A406) update.
[Download Link (Windows)] TinyUmbrella latest version
[Download Link (OS X Mac)] TinyUmbrella latest version