So I have found that the emergency candles found and my local dollar store will work in the lantern! They are 5" long and 3/4" in diameter and come in a pack of 5 for a dollar!
Also the candles from Ikea fit these lanterns perfectly once cut to the proper length.