"I am starting my own website." - This suggests this may be your first attempt?
If so, and everyone starts somewhere, then the answer would be 'yes'.
UX (the user experience) is naturally extremely important. We recently did an overhaul of our sites with a simplified and more mature UX experience. The results were outstanding, nearly doubling interaction with our visitors.
There are MANY factors to consider, in order of importance (at the stage I am guessing you are at) - also I'll assume you are in it for the long-ish term?
1 - Value to your visitors (whatever that may be). Keep it real if you want success. There are many fake and spammy websites out there, or projects that are transparently about money and nothing else.
2 - UX: Put some thought into what your users will be doing on your site, check with sites like https://www.usertesting.com/ to see if you've made it easy for them to get around, and can direct them where needed.
3 - Stick with it, it takes time. Implement things like Google Tag Manager / Universal Analytics from day one, keep an eye on what people are doing / how long they are staying.
Hope this helps.