You’ve gotta keep control of your time,” Buffett says, “and you can’t unless you say no. You can’t let people set your agenda in life.