The Carousel by Belva Plain

The Grey family, a wealthy, successful, socially elite dynasty built by patriarch Oliver Grey, is being torn apart by greed, adultery, jealousy, allegations of sexual abuse, and murder.
 
- Goodreads Summary