This advice here is it, OP. I've watched the whole series close to 10 times by now, and sometimes even I skip season 1. However, it does add some good context, and flashbacks in later seasons will make sense and give you a better feeling of attachment to the events if you've seen them.