Neighbors complaining about me riding my dirt bike?

Hi, I live on a mountain kind of outside of society and away from a city. I have a dirt bike and i have been riding it ever since i was 9 years old (17 now) and a few days ago i was riding and a neighbor came to complain about noise. She had a dog that kept biting my leg and was pissing me off so i told her to take her dogs and leave right now. I thought about it and decided i would ride less, so i was riding every other day, only for about 20-30 minutes a day at around 2pm. the next time i rode the girl's boyfriend or husband came down saying he would call the cops if i didn't stop. Is there anything he can actually do? i ride a rm125 so it is a 2 stroke and is a bit noisy but they are just renting out the house and we have lived here our whole life, also it is entirely on our PRIVATE property. Also i have a spark arrestor so there is no possible way for a fire starting. I don't ride on their property and its in the middle of the day and its summer so i don't see why i cant have my 20 minutes of fun like i have for 8 years now. The only thing i need to know is if i can get the bike impounded or if i can get a ticket or any sort of trouble, if so what can i do to not get in trouble, would i need to buy a muffler of some sort? thanks.