Thank you! I switched over to a two terminal socket and was able to get it to work - thanks for your explanation!

Thanks for the insights! The lamp is intended to be dimmable and I was using a dimmable bulb. That being said I don't need it to be dimmable and the original socket did only have the two screws. I'll try to find a socket with just the two terminals and try that.