Well I can only speak from personal experience here, but
nobody around sees me as a "weirdo" for anything more than the fact that I am a gaijin.
Well yea, you can see that from a mile afar, I'm 2 heads taller than the people around me, 2 times as broad (they really are slim, aren't they?) and I have blue eyes.
Other than that, what sometimes alienates me from Japanese people, or rather say, is reason for 違和感 is the fact that I at times say things in Japanese the way I'd say them in German, which is less a Japanese language problem, but more one of cultural background. Then again, like stated above, I'm a gaijin, so I usually get away with that.
I even think that some amount of 違和感 is healthy.
We could argue night and day and still come to the conclusion that westerners are still somewhat scary for many people in huge parts of the country, and a westerner indistinguishable in behavior and language from a Japanese person surely makes one even more of a creepy guy.
However, talking with colleagues about anime or manga actually has the opposite effect. People have a topic to talk about with you, they have a way to socialize, even when they normally wouldn't. It's like 暑っ!in summer, or the どちらの方ですか that got old months ago and don't provide the same kind of interaction you want as a learner of the language.
Japanese people like manga (even more so than anime, which is indeed somewhat polarizing), and they love to talk about it. It's something you can use as a tool, because having something in common makes you appear closer to "what" they are. I hope I expressed this probably long-winded point in a manner that's easy to follow.
_________________________________________________________________________
As for your retention rates and "RealWorldJapanese", yeah, it's not worth it to beat yourself up.
Words in ANKI will stay "words in ANKI" for quite some time, until you saw/heard them a certain amount of times outside of that, and used them successfully. This must be some kind of learning related thing.
Maybe your connections haven't grown strong enough yet - and I do mean that physically. Your brain needs to literally grow your Japanese language center and all the connections, and the more connections you add, the more stable it becomes, and that takes time ... and it seems, your brain needs to identify such an "ANKI word" as a "real word" before it becomes usable.
I experienced that myself time and time again.
I could identify something in ANKI, but not in the real world.
I could however remember that I must have learned it at some point, sometimes I was aware that this was a word I had in a deck, but I couldn't come up with it.
A few weeks or months along the way, the stuff surfaced seemingly out of nowhere and was just there when I needed it. I was very surprised sometimes and felt the need to double-check if that "knowledge was real", and it was.
It's a bit mysterious. Why do bits of Japanese go into camouflage mode for some time sometimes and come back when you least expect it?
I don't know, but what I learned from this is, to trust my brain. I don't understand the underlying mechanics well enough to exploit them, but I do know that sometimes just being patient solves problems I thought would be insurmountable.
つまり
It's no problem, just give it time and you'll see it'll work out.
Don't take my word for it, experience it yourself
Edited: 2014-02-04, 10:27 am