Well, as embarrassing as it is, you're right, I had 32-bit python. I had it for a while and for some reason I assumed I'd have 64-bit version, but it actually installs 32-bit if you take what they give you. Had to browse the site for 64-bit specifically.
Everything compiled and installed (other than not finding vcvarsall.bat).
For those who might try to replicate this later, note that if the instructions say to get Visual Studio 2013, then get that version. In e.g. 2015 they rearranged where all the files are, so you'd have to figure out all the new paths and settings yourself.
Anyway, mecab now works for me on the command line, but it doesn't want to recognize python strings. I ran the test app that has the hardcoded string "太郎はこの本を二郎を見た女性に渡した。" and the output I get with Shift-JIS dictionary is:
Code:
螟 名詞,一般,*,*,*,*,*
ｪ 名詞,一般,*,*,*,*,*
驛弱 名詞,一般,*,*,*,*,*
・ 記号,一般,*,*,*,*,*
縺薙 名詞,固有名詞,組織,*,*,*,*
・ 記号,一般,*,*,*,*,*
譛 名詞,固有名詞,組織,*,*,*,*
ｬ 名詞,一般,*,*,*,*,*
繧剃 名詞,一般,*,*,*,*,*
ｺ 名詞,一般,*,*,*,*,*
碁 名詞,一般,*,*,*,*,碁,ゴ,ゴ
ヮ 名詞,一般,*,*,*,*,*
繧定 名詞,一般,*,*,*,*,*
ｦ 名詞,一般,*,*,*,*,*
九 名詞,数,*,*,*,*,九,キュウ,キュー
◆ 記号,一般,*,*,*,*,◆,◆,◆
螂 名詞,固有名詞,組織,*,*,*,*
ｳ 名詞,一般,*,*,*,*,*
諤 名詞,一般,*,*,*,*,*
ｧ 名詞,一般,*,*,*,*,*
縺 名詞,一般,*,*,*,*,*
ｫ 名詞,一般,*,*,*,*,*
貂 名詞,一般,*,*,*,*,貂,テン,テン
｡ 名詞,サ変接続,*,*,*,*,*
縺励 名詞,一般,*,*,*,*,*
◆ 記号,一般,*,*,*,*,◆,◆,◆
縲 名詞,固有名詞,組織,*,*,*,*
・記号,一般,*,*,*,*,*
EOS
With UTF-8 dictionary it's even worse:
Code:
螟ｪ驛・蜷崎ｩ・蝗ｺ譛牙錐隧・莠ｺ蜷・蜷・*,*,螟ｪ驛・繧ｿ繝ｭ繧ｦ,繧ｿ繝ｭ繝ｼ
縺ｯ 蜉ｩ隧・菫ょ勧隧・*,*,*,*,縺ｯ,繝・繝ｯ
縺薙・ 騾｣菴楢ｩ・*,*,*,*,*,縺薙・,繧ｳ繝・繧ｳ繝・
譛ｬ 蜷崎ｩ・荳€闊ｬ,*,*,*,*,譛ｬ,繝帙Φ,繝帙Φ
繧・蜉ｩ隧・譬ｼ蜉ｩ隧・荳€闊ｬ,*,*,*,繧・繝ｲ,繝ｲ
莠・蜷崎ｩ・謨ｰ,*,*,*,*,莠・繝・繝・
驛・蜷崎ｩ・荳€闊ｬ,*,*,*,*,驛・繝ｭ繧ｦ,繝ｭ繝ｼ
繧・蜉ｩ隧・譬ｼ蜉ｩ隧・荳€闊ｬ,*,*,*,繧・繝ｲ,繝ｲ
隕・蜍戊ｩ・閾ｪ遶・*,*,荳€谿ｵ,騾｣逕ｨ蠖｢,隕九ｋ,繝・繝・
縺・蜉ｩ蜍戊ｩ・*,*,*,迚ｹ谿翫・繧ｿ,蝓ｺ譛ｬ蠖｢,縺・繧ｿ,繧ｿ
螂ｳ諤ｧ 蜷崎ｩ・荳€闊ｬ,*,*,*,*,螂ｳ諤ｧ,繧ｸ繝ｧ繧ｻ繧､,繧ｸ繝ｧ繧ｻ繧､
縺ｫ 蜉ｩ隧・譬ｼ蜉ｩ隧・荳€闊ｬ,*,*,*,縺ｫ,繝・繝・
貂｡縺・蜍戊ｩ・閾ｪ遶・*,*,莠疲ｮｵ繝ｻ繧ｵ陦・騾｣逕ｨ蠖｢,貂｡縺・繝ｯ繧ｿ繧ｷ,繝ｯ繧ｿ繧ｷ
縺・蜉ｩ蜍戊ｩ・*,*,*,迚ｹ谿翫・繧ｿ,蝓ｺ譛ｬ蠖｢,縺・繧ｿ,繧ｿ
縲・險伜捷,蜿･轤ｹ,*,*,*,*,縲・縲・縲・
EOS
Not just the input, but even the output is messed up. My Windows is currently in Japanese locale.
When I saved test.py with Shift-JIS encoding, everything printed correctly (with Shift-JIS dictionary). Is it simply that Windows cmd doesn't support UTF-8?
EDIT: Let me ask a more specific question: If I don't care about what's printed to stdout, I just want to check which part of speech certain words are in input text, then I should be fine using UTF-8 string literals in python source with UTF-8 input files and UTF-8 MeCab dictionary?
P.S. I implore the Japanese to get their encoding anarchy under control.
