How to add go back link to my site in SharePoint 2013

We can use this PowerShell script to change SuiteBarBrandingElementHtml:

$webapp = Get-SPWebApplication | where {$_.displayname -eq "SharePoint Portal" }
$webapp.SuiteBarBrandingElementHtml = '<div class="ms-core-brandingText"><a style="color:#fff;text-decoration:none;" href="/">Contoso</a></div>'
$webapp.Update()

References:

http://www.wictorwilen.se/sharepoint-2013-central-administration-productivity-tip