Empty oil lamps can either be filled with lamp oil to create oil lamps or attached to an oil lantern frame (forged from iron) to make an oil lantern for 50 Crafting experience. Combining the lantern frame with the lamp does not require a furnace or anvil.