Fundamental limits to radiative heat transfer: the limited role of nanostructuring in the near field