From lover + -ly.

loverly

1. Characteristic of lovers.
   • 1853, Caroline Chesebro, The Children of Light: A Theme for the Time, page 314:

     Oftentimes Angelo would spend an hour with them in the lowly parlor of the quiet, whitewashed house. It had been his custom to do so often while the mother was at home; and even after distractions came upon his mind, and wrestled with him as an armed man, he did not forget these pastoral, or rather brotherly, or, perhaps still more to the point, these loverly visits.

possibly from My Fair Lady

loverly

1. (UK, nonstandard, pronunciation spelling) lovely