Yea, the swaybar connects to tabs on the subframe. If the subframe is rotting away, you probably should replace the whole assembly. The 2000-2001 subframes were not properly coated to prevent rust during manufacture, but the 2002-2004 frames are.

That said, if the subframe is rotted, the 4 subframe bolts are probably not in great shape.. and will be quite difficult to remove without sheering them off.