Indeed. Unfortunately, deciding cases on legal merit alone isn't really possible - important decisions (the kind lower courts won't satisfactorily resolve) are necessarily political in some sense. I do think there's a legitimate constitutional question here, though, that the Court should clarify. Defining limits of congressional power is an important function for the Court, even if it seems unfair to override the will of the people/Congress/etc. With that said, it makes sense for the Court to give Congress great latitude in regulation (as it has in the past), so that intervention by the Court is only necessary in the most extreme of cases.
I have the feeling this is debate is meandering in the direction of a discussion on the purpose of the Supreme Court in general - and whether its necessary at all.