By default it will always start like that. You can change what template you use to start with, so you can either turn off the borders or delete the background sheets from your default template and save it to another name and then specify the saved file as your default template.
This is a dynamic of the way the standard templates are set up....you'd need to modify, or create, one of your own and save it as a template (named accordingly) in the same locale as the standard templates. If you double click on the Sheet1 (tab) name there is a check box to show/hide the background...amongst other sheet setup options. HTH.
EDIT: BTW, this should've been posted in the Solid Edge Q&A section of the community. [It may well get moved there by an admin]
EDIT: ...reposted as an answer, in the new Q&A area.
Design Manager Streetscape Limited
Solid Edge ST10 [MP2] Classic [x2 seats]