Casey Affleck's letting himself go to the dark grey side. Casey was hanging with his boys Wednesday in Bev Hills ... and it's pretty clear the "Manchester by the Sea" star is letting Father Time do his thing. There's tons of grey on that now-thicker…