掲示板 Forums - Upcoming change - duplicate removal (volunteers needed)

It seems the mastery of one of the suggested merge terms is deleted anyways… I have the same issue with my words.

I understand that wish to clean up renshuu material, yet, I chose to study different versions of, for example 止まる、留まる、on purpose and my mastery is gone.

I don‘t quite understand the consequences of the hint I get, when setting mastery values manually. So I have never done that until now. What exactly do I interfere with, when setting my mastery level manually?

Thanks for the mastery-adjustment-answer! I guess I will try that with those terms.

For me as well, the terms are visible in advanced search and stay in my lists (which I want!), but with that change, my 御飯, … terms went to 0% and will likely pop up in my schedules… (I have too many terms to repeat there, so I don‘t know whether they already show up for repeat. I assume that though.)

I know the idea is to reduce the duplicates, yet the „new“ ご飯, for example, isn‘t shown as 御飯 in quizzes although I have something like „rare Kanji instead of hiragana“ checked in my options.

So it seems I‘m set back to 0% with my rare kanji words since I can‘t study the half-hiragana-versions with rare kanji… I guess I will change my word lists to remove the hiragana versions and add the kanji versions manually with adjusted mastery… From what I understand, that should still be possible after the change.

Since I‘m using only few renshuu lists, I cannot say anything about terms popping up in other/multiple lists…

The state with multiple versions in advanced search could as well be the result of the test phase since the change is not fully made at this point…

Maybe at this point Mike can clear up some questions…?

My yesterdays learning (dark blue square in statistics) is completely gone, showing a white didn‘t-study-square… Is that an unrelated coincidence? (had around 500 terms studied yesterday) Since my user data is touched with this beta test, it‘s my best guess…

All your mastery data is stored as backup, so if any mastery was removed, I will be able to get it back. I don't have time at the moment, but I'll be looking into everything mentioned here! I can answer a few questions:

1. "Words I know" (the lightbulb) - merged terms were not removed from this.

2. Even if you choose to not delete a merged term, all this does is keep (if everything is working) the mastery data. It will NOT keep both of them in the renshuu maintained lists. You can add back the alternate terms using the + button, but it is too difficult to maintain options for users to select whether to keep mastery data or not AND which ones to keep in the schedules themselves.

3. For the time being, usage notes will not be moved. There is no guarantee that all usage notes on one version will be applicable on another. It might be that they apply in most cases, but moving potentially hundreds of usage notes over is not something I feel comfortable doing automatically.

4. If there is an issue with the blue boxes, I can fix the data after. Also with the missing mastery data, can be fixed. If anyone else has instances of that, please give specifics so I can look into it.

Just ran the merge tool and it looks like vocab was added to my hiragana schedule and 13 new words added to one of my vocab schedule's. The latter may be the new default forms, but they should have already been learned

Thanks so much for writing this tool!

I clicked the merge button, merged all terms, and while it seems to have worked, some bugs began to appear. Instead of going down, my reviews have spiked up by a bit. I got reviewed on a lot of old learned vocab, and now I'm stuck on one review I am unable to take on two of my vocabulary schedules (N4 and N3 vocab). It just keeps loading forever for some reason.

I also got a kanji quizzed that I never learned in the kanji->kana vector for a known vocab I removed dupes for.

And today a lot of previously learned words showed up as unlearned. I hope this information helps!

Another point for discussion. Let's say (this happened to a user) that you have schedules that might have originally be based on renshuu materials, but had been merged in the past with other schedules, leaving it as a custom schedule (no longer bound to the original materials). It contained a secondary term (or many). They ran the merge tool, and it removed the mastery data for these secondary terms, and updated the schedule contents for any renshuu-schedules. However, because this merged schedule was not considered a renshuu one, it still has the secondary term in it, which is now at 0% (since the mastery data was removed).

I am leaning towards adjusting the tool so that it makes adjustments to all schedules, even non-renshuu ones, but can you think of any reason to not do this?

Yes, I can think of reasons. Please don‘t do that!

It‘s removing „duplicates“ (especially those that really aren‘t) in user defined, self-picked, edited, put-thoughts-in schedules. Especially of advanced learners, as I believe. That‘s interfering with the base idea of making your own (maybe odd) lists and schedules. It‘s interfering with the base idea of I-choose-my-learning-material.

I don‘t think that‘s „cleaning up“ anymore. Users will have their self-made schedules the way they want them, with (almost) every mess in there intended.

For me in particular: I‘m loosing my mastery values on my beloved uncommon forms already. I‘ll adjust that mastery manually. Ok. But if I loose my words in my schedules, I‘d actually be upset. I wouldn‘t even know, if after a search for them, I could find all… I do not need to clean up to common-versions, when I come across the uncommon in the things I read. Those are my personal „common“ words. I want my schedules to be my choice of words and versions of them.

Post merge report

9/30 update - no additional issues noticed 👍

9/26 - just merged. noticed two instances of words using kanji I've never studied before in first post-merge vocab quiz. I already forgot the first one, but the second was 嘘 in うそをつく. Not in any of my lists and haven't seen it before. I still have like 500 words to go through to catch up this week. I'll report any other irregularities

Yes, that would be great. Thanks.