I was at school with a girl named Lisle, same pronunciation, who was a pretty good golfer. So that's got something of a healthy outdoor exercise vibe for me; but it was also the name of the textile that 19th century schoolgirls' long black stockings were made of, which is pretty unattractive, frankly.
Lyle ... I connect it with
Tate &
Lyle, a company that makes sugar, treacle and golden syrup!
Adjectives ... sticky, unhealthy, unattractive.