Keep your cam and pop in some Rhoades lifters.
I used them on a 340 with a 484"/284° cam and it increased my idle from 10" at 1100 RPM to 13" at 800 RPM with a much smoother idle. It added more low end torque and hp.
Here's the list of part numbers:
http://www.rhoadslifters.com/Pages/PartNumber.html
Here's how they work. Read the second article on the link.
http://www.rhoadslifters.com/Pages/PartNumber.html
I've been using Rhoades for over 25 years now and had no problems with them. I once got one that had a small defect where there was a little porosity in the casting that did not machine out. I called them and described the defect to them and they sent me another one out that week and didn't even ask me to send the bad one back. I was very happy with how they support the customer.
I also had them make a set for my dad's Hemi. They usually don't have Hemi lifters (back then at least), so they told me to buy a set of Sealed Power Hemi liftes and send them in to them, and they machined their special groove in them. They work fine.
I've also ran them on daily drivers and run them over 250,000 miles. they hold up and help performance. I would just put in the Rhoades lifters with your current cam. You will like the performance increase and smoother idle.