When I was a plant science student at the Agricultural College, to see yellow in foliage often suggested a nutrient deficiency or other problem. It took me a long time to embrace the colour gold, or cream, or yellow, in ornamental plants, but here's what turned the tide for me:
Hostas. Of course it would be hostas, with their splendid foliage that utilizes only a few colours--cream, green, yellow, blue--in such dramatic ways. I love the flowers of hostas, too, but the fresh, perfect foliage is what really does it for me. They are calming plants with their tidy clumps of leaves (especially if they're slug-resistant or you've done battle to keep slugs at bay), and if you have a shady spot, they really brighten it up. It's true that deer adore hostas so if you live in an area where deer are a problem, you may have to opt for hostas only in containers out of reach of hungry bambis.
Pretty much any plant with gold foliage is best suited for a partially shaded site; from a practical point of view, many need some protection from full sun sites because their foliage will otherwise burn. The golden colour just glows in a shaded garden, as demonstrated with this 'Dickson's Gold' campanula.
Plants that are bombastic or invasive in one area of the country (and beyond) are not necessarily so in other areas. This is Tansy 'Isla Gold', a golden leafed form of the common wildflower tansy. It is a vigourous grower but easy to control, and it's deer resistant to boot. Some like to dry the flowers to use in arrangements and wreaths.
Where do you fall on the spectrum with golden leafed plants? Love or not?