Rethinking the Failed Pile

Index » Feedback

  • 1
 
Reply #1 - 2008 June 20, 8:47 pm
woodwojr Member
From: Boston Registered: 2008-05-02 Posts: 530

As it stands, it's my belief that the failed pile is an anti-feature--it's more harmful than it is helpful. Why? Because it takes cards you have failed, and removes them from review. If you're diligent and go through the pile soon afterwards, restudying and then shifting it back into circulation, it's no problem, but if you let it sit there it can be days or even a week or more before it comes up again.

On the other hand, there's great value in being able to see which cards you've failed, to permit you to consider whether the stories need re-tweaking. So that's good.

A better way to do it, then? At least in my opinion, it would be preferable to do it like so:

1) Maintain the failed list in the Study area. Cards go onto the failed list when they're failed, obviously. Cards come off of the failed list when they're marked as Learned.

2) The failed list is no longer a pile. Cards which are failed go directly into the bottom stack (well, stack 2 I guess; the first stack on which cards actually expire).

3) In addition to #1, cards come off of the failed list when they are passed.

Thus, the failed list consists always of cards which have been failed more recently than they have been passed and which have not been marked learned. Nevertheless, the cards there still expire and come up for review.

Thoughts?

~J

Last edited by woodwojr (2008 June 20, 8:47 pm)

Reply #2 - 2008 June 20, 9:03 pm
PrettyKitty Member
From: USA Registered: 2007-07-02 Posts: 178

I always thought it would be nice to "review" the failed stack. As in, cards get shuffled and you review them like any other deck until you're ready to promote them. Then I could keep all my troublesome cards together in the failed deck and review them as a deck until they are no longer an issue for me.

Reply #3 - 2008 June 20, 9:23 pm
Zarxrax Member
From: North Carolina Registered: 2008-03-24 Posts: 949

You can review from the failed stack using this link: http://kanji.koohii.com/review/review.p … ;filt=rtk1

There is a firefox greasemonkey script which makes it so you can get there by just clicking on the failed stack. I think that definitely needs to be integrated directly into the site though.

Advertising (register and sign in to hide this)
JapanesePod101 Sponsor
 
Reply #4 - 2008 June 20, 9:47 pm
Henke New member
Registered: 2007-09-14 Posts: 4

If you just review the failed kanji without going back to fix your stories, the chance of failing the same kanji again is quite high, I think.

The thing about the system is that you should take time and review your stories for the failed kanji. Alter it to make it stick better, or maybe make up (or pick) a new one.

Reply #5 - 2008 June 20, 9:55 pm
playadom Member
Registered: 2007-06-29 Posts: 468

It would actually be nice if that review script put the cards in a probationary 1-day timer box.

Last edited by playadom (2008 June 20, 10:09 pm)

Reply #6 - 2008 June 21, 12:04 am
lazar Member
From: Canada Registered: 2007-12-06 Posts: 103

It's pretty funny, today I was thinking on how Anki is different from this site, and noticed the failed pile. Anki just asks you w.e. card you failed again and again in closer intervals than the cards you passed.... I agree, this needs to be fixed.

Reply #7 - 2008 June 21, 12:07 am
Jarvik7 Member
From: 名古屋 Registered: 2007-03-05 Posts: 3946

lazar wrote:

It's pretty funny, today I was thinking on how Anki is different from this site, and noticed the failed pile. Anki just asks you w.e. card you failed again and again in closer intervals than the cards you passed.... I agree, this needs to be fixed.

The lack of a failed pile is my single largest complaint about Anki.

Reply #8 - 2008 June 21, 12:40 am
PrettyKitty Member
From: USA Registered: 2007-07-02 Posts: 178

The reason I would like to review the fail pile is this. If I fail a card, it goes to the fail pile to await a story revision. I revise my stories until I feel like I've "learned" the kanji again. Then if I clicked "learned," the kanji will go to the green pile in the next stack to await another revision in 3 days. I would prefer to review these troublesome cards again the following day rather than wait 3 days to see if my story stuck. I'd like a quick fail pile review at the end of my brainstorming session, and another the next day before I decide promote them to the true "learned" pile. I can't really tell if my story was good enough or not until I sleep on it.

Currently, I end up reviewing the cards that are up for review and see them get promoted through the stacks while the cards giving me problems fall to the fail stack and take up a long term residence there. I know this was not the intent of the creator, but it is what I end up doing although I'm not sure quite why. Oh, the shame!

But to sum that all up, I'd like to be able to review the fail deck so that I won't have to wait another 3 days to see if I really learned them this time. But anyway, I'm gonna check out that greasemonkey script now...

Reply #9 - 2008 June 21, 12:48 am
lazar Member
From: Canada Registered: 2007-12-06 Posts: 103

Jarvik7 wrote:

The lack of a failed pile is my single largest complaint about Anki.

Yeah I would've agreed with you until I found out about this

http://www.sciencentral.com/articles/vi ? =218393117

So perhaps its best to try, but not dwell on the kanji in your failed pile... I dono but once again I feel the right answer is in between that study and what we currently have. I think more attention needs to be put on the failed cards for revision, (certainly more than anki gives to failed cards) but not so much attention that their taken out of the cycle...

Reply #10 - 2008 June 21, 1:00 am
woodwojr Member
From: Boston Registered: 2008-05-02 Posts: 530

Henke wrote:

If you just review the failed kanji without going back to fix your stories, the chance of failing the same kanji again is quite high, I think.

Yeah, but that's the beauty of it--failing it again is what lets you know that you need to go back and fix your stories, the ones that you've failed again are still available in a special place to see and fix your stories, and ultimately, failing it again doesn't hurt.

There are actually about three kanji whose stories I can't remember for the life of me, but during a period in which I didn't have the (time/discipline) to do a solid review of failed cards, they just came up often enough that I now know them cold. It's too slow to do all >2000 kanji by that method (which, after all, is why we're using Heisig's method in the first place), but it lets you pick up a few here and there.

Basically, the only drawback I can see is if someone is actively discouraged from reevaluating the failed cards--but I see letting a big failed stack rot as being more likely than that, and more damaging besides (repeated exposure will eventually bring learning, nonexposure will not).

~J

Last edited by woodwojr (2008 June 21, 1:01 am)

Reply #11 - 2008 June 21, 4:40 am
Savara Member
From: London Registered: 2007-09-08 Posts: 104 Website

One of my problems is that, if I get a kanji in a normal review that I failed 'many times' (more than 4/5 times) before... I'll think "Oh that was a hard kanji!" and doubt my initial answer and often change it and... fail it again.

I think the failed pile is ok as it is... As long as you make sure to deal with it every day.

Reply #12 - 2008 June 21, 5:04 am
woodwojr Member
From: Boston Registered: 2008-05-02 Posts: 530

My contention is that that "as long as" is a big enough caveat that it makes it not ok anymore, but your mileage apparently varies.

Edit: I should add that, at least in my experience, it's not always even the card in the "failed" pile that needs a story review--I've had some reviews where I'll fail a card because one of the components has a bad story (or one I've forgotten), while the component comes up sometime in the next few days and I ended up learning it from the card that failed.

Anyway, I think I've presented about all of the anecdotes and opinions I have that are relevant to this. Any other opinions?

~J

Last edited by woodwojr (2008 June 21, 5:13 am)

Reply #13 - 2008 June 21, 6:09 am
wccrawford Member
From: FL US Registered: 2008-03-28 Posts: 1551

woodwojr wrote:

My contention is that that "as long as" is a big enough caveat that it makes it not ok anymore, but your mileage apparently varies.
~J

The whole site only works "as long as" you use it properly.  That means daily reviews, and daily fail pile reviews.  I don't think it's a caveat at all.

On the other hand, it is apparently a big enough pain that it doesn't fit in with how easy the rest of the studying is.  I think think this is the reason that it should be re-thought, rather than the "as long as" caveat.

Reply #14 - 2008 June 21, 8:15 am
Nukemarine Member
From: 神奈川 Registered: 2007-07-15 Posts: 2347

I've posited in other threads we need both options for the "study" pile (my term for the more negatively termed Failed stack).

One is you can "study"/"review" your missed cards similar to before. The other is you can "test" it as if it were a stack of new cards.

In addition, this would apply to the new card stacks. You can either do an initial review (like now), or go through clicking "learned" on new cards that move them to stack 2 for review in 3 days.

Seeing that I'm now adding in more new cards from RTK3, this has come to thought again.

Reply #15 - 2008 June 21, 10:25 am
ファブリス Administrator
From: Belgium Registered: 2006-06-14 Posts: 4021 Website

woodwojr, welcome, and thanks for bringing the topic again.

I can see that there are a few problems with the current implementation :

* People tend to leave cards on the failed pile for too long (I'm a prime example of this). The fact that it's a "fail" pile also encourage people to procrastinate on it.

* Re-learning a kanji sends it onto a 3 day interval before review, probably too long.

I agree that this needs to be worked on. As lazar pointed out, the best would be something between what we have now and continuous review cycle. I still think the current implementation works, but not for everyone.

So the best would be a solution that allows for different approaches. One such solution would be to keep the list of failed cards, but allow direct review of the failed pile. Clicking "Learned" from the study page could also use a 1 day interval, whereas reviewing directly through the Red pile would use the default intervals (3 days).

It's interesting to note also this is a design problem with the "flow" of the reviewing. Going through the Study area interrupts the flow. An interesting solution would be, in addition to what I mentionned above (your suggestions), to add a Study link in the review page. This could open the corresponding Study page in a popup window. I wanted to do this way back, but it causes some technical problems in maintaining the review page and study page synchronized.

This and finishing the Study area filtering/moderation system is on my priority list for the existing site features. I will take care of it when I can begin my break off the day job but I may have to wait another month or two.

Until then we can continue to brainstorm on this. Articles like you posted above are especially useful (here 's the correct link). Haven't had the time to read it through yet.

Reply #16 - 2008 June 21, 10:48 am
ファブリス Administrator
From: Belgium Registered: 2006-06-14 Posts: 4021 Website

Having read the article, I think it goes more towards supporting the current implementation than the other way, actually.

I think what the article is saying, when applied to RtK, is that if you try to "dig" too long you reinforce stories that don't work well. Thus everytime you try to remember a "difficult" kanji you go through memory links that don't work well. So it's best not to reinforce it, and go for a completely different story (this goes also beyond the fail pile issue, in that you could also answer "No" to something you remembered, but took a long time to recollect).

I think we've all experienced and verified this : a so-so story never gets better by repetition. Failing and reviewing a kanji straight away gives the false impression that we know it better because the reviews intervals are short. Soon as the intervals get several weeks, the "tip of the tongue", or long memory retrieval, comes back.

Remaking a story can be difficult, once you've made a mental association, they can take a while to fade away. So the article here is saying, the sooner you can let it fade away the better!

So I'd conclude that that article does in fact support for encouraging users to rework a story after they answer "No" rather than force on with early repetitions.

I think the fail pile needs a better "flow" in the review cycle, and also the information on the failed kanji list needs to be improved to become directly useful rather than a reference list. Ie. to be come functional rather than informative. However I think turning the fail pile directly into a review pile doesnt address the "tip of the tongue" problem.

Reply #17 - 2008 June 21, 11:08 am
Ryuujin27 Member
Registered: 2006-12-14 Posts: 824

I really like the idea of having a 1 day period after you "re-learn" it from the failed pile and it coming up for review.

I know, for me at least, that would help tremendously in reviewing. I think I would have a better retention rate on failed kanji if I could review the day after re-learning it and then more as it moves through the Leitner system.

Also, thanks for the article about letting stories fade and conjuring up brand new ones. I might have to try that.

Reply #18 - 2008 June 21, 4:58 pm
usis35 Member
From: Buenos Aires Registered: 2007-03-31 Posts: 205

I sensed the same as many people here, the lack of a "1 day review" for failed kanjis.
But I found a shortcut to solve this problem:

When I review, and tick a failed kanji, I study the failed one on the spot. So, the next day when I check the previous day failed list (I never do it the same day after reviewing), I am getting a "1 day review".

Reply #19 - 2008 June 21, 5:25 pm
ivoSF Member
From: The Netherlands Registered: 2005-11-29 Posts: 144

i think the current situation is not so bad.
but instead of having to use tricks or greassmonkey there should be a button on the studypage to review the failed cards.
this button should be below the list of failed kanji tha  you see when you click  "see all failed kanji"

Reply #20 - 2008 June 21, 7:13 pm
Nukemarine Member
From: 神奈川 Registered: 2007-07-15 Posts: 2347

We're assuming that we're failing the card because we completely forgot it. Some of us have failed cards: accidentally, for minor stroke mistakes, realizing we forgot it as a primitive in an earlier kanji tested that day (ie, it would have been a miss had it come up first), etc. Not all are to do with a poor story or complete forgetting.

That said, with RevTK, going to the study pile is not too bad but not too good either. We want to discourage brute force memorizing, but we also want to continue the flow. Hence, three implementations (which seem simple enough) fix a majority of complaints.

1. Downgrade missed kanji in higher stacks instead of going straight to the study stack.
2. In "study" pile, missed cards can be tested the next day if you click on a link (sort of like the link for testing new cards). So, there may need to be a third box in the first stack (missed reviews that have aged a day or more).
3. In the "study" pile, missed cards can be studied, which moves them to three days away.

To be honest, RevTK could stay as is and still work. Users need a way to be reminded that some of their stories are lacking. However, I remember the feeling of a 300 card failed stack. Before finding my flow, it was a big ego buster.

Reply #21 - 2008 June 21, 11:09 pm
Cirion Member
From: USA Registered: 2008-05-11 Posts: 19

What would be nice is if the you could sort the study my stories page http://kanji.koohii.com/study/my-stories.php by the card's failed status. That way you could see the story but not the kanji until you roll over it. smile Sort of a compromise to having to recall the story and the kanji.

Now that I think about it, there could be a way to trick it by going into your study pile and resaving the stories so they are the most recently edited. Then you could sort by the "last edit" field.

I like that the failed pile is separate and takes 3 days to come up again. If it's too fresh, it doesn't prove I've learned it. I go through the failed word in the study screen, but I don't click learned until I'm sure I can do it.

  • 1