If you've got an auto now, you probably won't get a 4 speed in there for under $2k. An 833 will set you back at least $500, and that would be for a core still needing a rebuild. A rebuilt 833 will set you back about $1,300 from Brewers or Passon. Big block bell housing? Yeah, probably 400 to $500. Pedals are $100 or more, shift linkage will be at least another $100, shifter mechanism will set you back $200 or more, another $100 or more for the shift handle, 200-$300 for the flywheel, $300 or more for the clutch, $100 or more for a 4 speed hump, $80 or more for a new slip yoke, etc, etc, etc.
Even if you buy all the parts used, rebuild the transmission yourself, have a used flywheel reconditioned, rebuild a used shifter mechanism, etc, you will probably STILL exceed $2k. Maybe not by a lot, but $2k is probably the minimum you'll need to get a swap done. That's why the auto-manual conversion "kits" cost $4k from Brewers. With all new parts that's pretty close to where you'd end up. Figuring that about the best you can do on good used parts is 50% on the cost of new, you're back at $2k. And if you can get all of your parts at 50% the cost of new you're doing really well.
I've collected enough parts to convert most of my cars over to 4 speeds, the Duster is already converted over. Even collecting parts over the course of several years, I've probably got close to $2k into the conversion parts for each car. And all of my cars are small blocks, which saves a few hundred bucks on the bellhousing straight off. And most of the transmissions I've picked up are 833OD's, which usually cost half as much as a regular, non-overdrive 833. And then of course I do all of my work myself, so I'm not paying someone to cut the floor and install the 4 speed hump. Or pull the old trans and install the new one.