Stayed at one of the oldest places in Key West named Casa Marina back in 1998. Nice dinner at Flaglers in the hotel, they even had cigars and brandy for after. Another great place to eat is Pepe's Café. Don't forget to hit Sloppy Joe's and then Sunset pier for the pirates.
http://sloppyjoes.com/