Heh. I never had an issue with anything near Fenway. Then again, I love baseball and deliberately chose a Fenway location for easy access. But the crowds were never especially loud where I was, it was just that it *was* crowded during home games. Also, I never felt unsafe in that area, ever. You should be fine.