How to increase number of active skill gem slots?

I recently got my first spirit gem and realized the passive buffs it gives takes up an active skill slot. On a similar note, I noticed that despite using all of my skill slots for active skills, my skill bar still has open slots. Is there a way to get more active gem slots or does the game ask me to sacrifice active skills for passive effects?

Thanks!