I have been in your situation plenty of times. The fact is tech and non-tech people pretty much speak different languages, so having the ability to be "bi-lingual" is very important. If you are running a fintech startup this skill is very important and I would highly suggest against avoiding it. If you want we can hop on a call and I can go into detail on my experiences and see how best you can proceed without leaving your team.