I would be one who cares.I see two teams that each lost an expected game, each won two top tier teams, and both lost a game they should have won. Who cares what the margin of victory is in this scenario. Truthfully, for most common opponent games, unless the margin of victory is something like a 30 to 1 disparity, the margin of victory is a worthless stat without looking into a plethora of other scenarios that lead to those margins.
Now, in the grand scheme of things, really we're talking about stats and figures to sort two teams that are basically comparable. I don't think you get it wrong either way.
That said, crafting a program to capture all the nuances of rankings is flatly impossible.
And this doesn't even get to the "who do I want to play" question. Because I don't want to play the worst team but rather the most consistently bad team. So even with these rankings you have those crazy teams that are up and down all the time.