Yes, neighbors. And don't forget ex girlfriend or wife, postman,like @GBAUTO says^^^ that's too many under a 300W light. Depending on the footprint of the light, that'll do 2, or at most 4 in a 2 plant x 2 plant configuration.
Not sure what the laws/penalties are where you're at. They're probably not going to get you with heat signature in a heli, but they will get pretty stinky, especially during the final 4 weeks of flower. I'd be more concerned about nosy neighbors and visitors to the home saying something. Be sure to have good odor control.
Good luck! Peace