it depends on which gems you need. Most are gotten through the mining aspect of the game. Gm mining adjusted or better will get these to start dropping. 80 fishing or above to get the White Pearls and Gm lumberjacking to get the Briliant Amber. All other gems are from mining. They can be slow to drop but they will drop for Elf or Human gatherers.