Those of you who think that he is unhelpful and ignores students that are not math wizzes haven't taken a look at your own work ethic. Fuj has no tolerance for a lack of effort. He's tough, but if you put the effort to see him outside of class you will gain a whole new appreciation for how great of a teacher and guy he is.
It's true that if math is not your forte he will pretty much ignore you. He has clear favorites in all of his classes and acts inappropriately toward female students. If there is any way to AVOID his class, I suggest you do.
If you are not a math wiz, then he, essentially, ignores you.