Source : Webster's Revised Unabridged Dictionary (1913)

Guiltily \Guilt"i*ly\ (g[i^]lt"[i^]*l[y^]), adv.
   In a guilty manner.

Source : WordNet®

guiltily
     adv : in the manner of someone who has committed an offense; "she
           blushed guiltily as she spoke"