What parts do I need to change 32mm tires to 23mm?

I have a C'dale Quick 4, but would like to change 23mm tires. Hoping to increase speed. I know I need a new rim set, tubes, tires and quick releases. Would purchasing a new cassette be good? That way I can simply interchange if/when necessary.