Read carefully what you just wrote, and I suggest you rewatch The Avengers; the films pretty much in its third act before they properly "Assemble".
And there's the key word, "film". That was a movie, and this is an 8 episode show. This has more time to set up and while it drags in the first two episodes, it makes sense so far.