I think you're on the right track, Āµ4/3 strengths include tele reach, fast focus, and light weight. DEFINITELY keep the 75-300 for the reach, you'll never match it for the price and weight.
If you're a prime lens afficionado I'd give up the 25 for the Fuji 35 to start, and then swap the 17...