Awesome! Very interesting.
By the way, there's newer ways that might be better, beyond Hayashi. I was looking at correlations of Hayashi with grade levels, and found this paper and it describes their methods and applicability to different types of text beyond textbooks (such as web pages), and how it doesn't use sentence/word analysis or somesuch, but ‘operative characters’. They have an online tool for people similar to the addedbytes tool that I linked above, here (interface has English option): http://kotoba.nuee.nagoya-u.ac.jp/sc/obi2/ - For more info in addition to the paper, there's also the ‘more information’ link (they provide a link to the program there, as well as a poster).
Main page in English: http://kotoba.nuee.nagoya-u.ac.jp/index_en.html
Edit: I only just looked for the grade correlations and discovered the above after you posted the Hayashi 5000 list, so didn't have time to do more than skim that paper, for the record, so no idea how sound and/or widely applicable their method is.
By the way, there's newer ways that might be better, beyond Hayashi. I was looking at correlations of Hayashi with grade levels, and found this paper and it describes their methods and applicability to different types of text beyond textbooks (such as web pages), and how it doesn't use sentence/word analysis or somesuch, but ‘operative characters’. They have an online tool for people similar to the addedbytes tool that I linked above, here (interface has English option): http://kotoba.nuee.nagoya-u.ac.jp/sc/obi2/ - For more info in addition to the paper, there's also the ‘more information’ link (they provide a link to the program there, as well as a poster).
Main page in English: http://kotoba.nuee.nagoya-u.ac.jp/index_en.html
Edit: I only just looked for the grade correlations and discovered the above after you posted the Hayashi 5000 list, so didn't have time to do more than skim that paper, for the record, so no idea how sound and/or widely applicable their method is.
Edited: 2011-02-19, 3:38 am