D'oh. If you're seeing this, your DocumentRoot is set incorrectly. It should be set to the public directory.