IMO i would say your approach is ussually harder but also more likely to sound fresh than using fingerings but, thats not a given. It moslty is a individual thing ...wich ever way helps you understand the best. I use the same system you do pretty much except i think mostly in intervals and only note names if I have too and when a chord name gets kinda out there i think your doing the best thing by just turning to your ears..it helps give a splash to the playing. I would also say i have practiced a good bit with both approaches and i really like to use them both together it just adds another angle to things but i really use chord tones more than I ever use fingerings and if you can move around quickly the way you do it then you pretty much no the fingerings but you just look at them differently but knowing them by note name is really ideal though and the faster you get at that the more personalized your playing will be cause everyone has there own style of approach.
