Am I doing the most appropriate things to improve listening ability?

I've made a thread about listening before but now I'm kinda in a quandary.  As background info, my vocabulary and reading skills are fairly good (abt 37k words and over 50 light novels read).  To practice listening, I went through some N1 practice books such as Kanzen Master and Soumatome.  I am now using the NHK nightly news show, anime, and jdrama with Japanese subtitles (at least I try to have the subtitles).  But in the order I have listed them, I am finding native material increasingly difficult.  The NHK news isn't so bad as long as you leg up on the political vocabulary but anime and jdramas are hard for me with jdrama's being the hardest.  The speech is fast and slurred in anime and jdrama with jdrama being the worst offender.  I pick up a lot of things but not everything and have to resort to looking at the subtitles.  Should I just keep at it with new material every day?  I don't think going back to learning materials such as N1 stuff will help since native Japanese materials are at a much harder level due to the speed and slurring.    

Thanks in advance for you help.