The movie that seems to fit the description is "The Night of Tanizaki" or more commonly referred to in the context of such themes, "In the Realm of the Senses" (1976) is not the exact match but another film "A Dedicated Life" does however tackle complex family dynamics.