Japanese ivory figurine

I inherited this from a woman who spent a lot of time in Japan. I was very young when she passed, so I don't know a lot about it. I know it is very old, pure ivory and the man used to have a fishing pole with a fish attached. Any information would be appreciated.