Check your toilet and see if flapper is leaking, put some egg dye in tank and see if it comes through into bowl, if it does it will leave water out and cause ballcock to fill, and if it has bad washer in it will viabrate, just a suggestion , did you check water press. and see what you have, you might try to turn it down and see if it stops the noise, let me know.You have a closed system and the PRV has a chance to build up pressure, some times you need aexpansion tank on the water heater. Did this happen when you had old PRV.
Art retired plbg