Source : Webster's Revised Unabridged Dictionary (1913)

Penally \Pe"nal*ly\, adv.
   In a penal manner.

Source : WordNet®

penally
     adv : in a punishing manner [syn: {punitively}, {punitorily}]