If you're gonna do this, let's do it right:

1. **[Define a custom off-topic reason.][1]** Doesn't have to be a permanent addition, but for the purpose of this cleanup swapping one in means less tedious clicking for the folks closing. Make something *specific and descriptive* and link to your meta discussion from it; ideally, this should describe why these questions are being closed well enough that anyone reading won't be confused. This is something you & the rest of the mods can do at any time.

2. **[Increase the number of close votes available.][2]** That's probably over-due anyway; ping me once you have #1 squared away & I'll take care of this. 

3. **Keep an eye on [the close review queue][3].** Hopefully folks are balancing their time between working through the backlog and reviewing questions others have found, but if it starts to pile up then encourage others to pitch in before going back to the cleanup. Also, make sure no one's getting fatigued; if anyone appears to be reviewing blindly, encourage them to take a break - yes, this needs to be done, but it doesn't need to be a death-march. 


  [1]: http://meta.stackexchange.com/questions/184637/what-do-site-moderators-need-to-do-to-support-the-new-custom-question-close-reas/185097#185097
  [2]: http://meta.serverfault.com/questions/6663/can-we-increase-the-number-of-close-votes-per-day
  [3]: http://serverfault.com/review/close