Is there a way to set the max amount of wrong cards I can have before it ONLY shows the wrong cards? If I have 20 new kanji for the day, and I press Again 5 times, I want it to keep cycling through these 5 cards until I press good on one. The idea being that I want to be able to pull a larger pool of kanji to learn in a day(30-50) and memorize 5 at a time. Is there a way to do this? Thanks.

You could set it to 5 cards/day and increase it (using Custom Study - more convenient than editing the value in Options) once you're done with those.

I thought of that after I wrote the post But I guess there isn't really a "natural" way to do it within Anki. I like the way Memrise works in this regard. I can learn 5 kanji at a time, then go on to the next 5, then review them all in a couple hours.

In old Anki 1.0 there were some settings you could set up for a cram deck and one of the features was that it wouldn't go past X cards until you passed them enough. But Anki 2.0 seems to have fewer settings in that regard so I don't think its doable unless you have a plugin.