Are fibroids harmfull ?

I suffered from serious back problems during mu pregnancy due to fibroids, since having my son I have continued to feel a strain in my which has effected me at work n find it hard to sleep at times, i am constanley having to explain to people tht I'm not pregnant as my stomach sticks out as if I were this has becaome quite upsetting for me. So I finally went to the doc who examined me her conclusion was tht I do have a large fibroid the size of a 14week pregnancy. I feel so Depresed now n worry this is going to effect my next pregnancy. Has anyone experienced this problem or had them removed. I have been told tht if I plan in having another child this may not b podsible as it will b IVf.