According to Empire, Colbert recently visited the Hobbit set in New Zealand:
I flew out and watched them shoot some scenes and went to some locations. I saw a 25-minute cut, and it was amazing. [Peter] Jackson knows I'm a big fan of the films.
Asked if he would be making a cameo, Colbert replied coyly: "Could be."