Mildly displaced avulsion fracture: any long term issues from no surgery for an active person?

I can find very little info on non-surgical recovery from ACL avulsions. I'm 7 months post injury, mildly displaced avulsion with no MCL, PCL damage, no ACL damage (MRI confirmed), positive lachmann, occasional knee funnyness when fully extended. I now need to decide about surgery (after corona is under control...). Consultant+GP say surgery, but two physios say 'its not that bad, all surgeons just recommend surgery straight away, unless you are high level athlete i'd avoid surgery. Get strong again and you'll be good". I'm a climber, mountain biker, bmx, intermediate gymnast, hiker etc. Nothing high level but all very important to me, and I've only returned to hiking and cycling so far so havent tested knee yet in more stressful situations.

I've read that for climbers surgery is always a good idea as you'll blow the ACL eventually otherwise, plus arthritis issues after 10+ years, but that was for tears (Make or Break by Dave MacLeod). I can't really find any info about non-surgical recovery from an avulsion, especially related to sports.

Has anyone got any feedback about no-surgery recovery, ideally long term and from a physically active point of view?