You only need about 3000 really, though.

Maybe 4000 or 5000 if you want to learn Chinese as well. Yes, I'm aware that that's not
that much better.

If it helps, even some of my Japanese friends have trouble writing some of the less common kanji. You're in good company.
