If you want to hide the widget automatically when all agents are offline,  login and click on Chat status from the main menu.

Toggle ON the option "Hide widget when no agents are available".

Now, the chat widget will be hidden when all agents are offline. 

If you want to show the "Leave us a Message" form to your visitors when all agents are offline, just Toggle OFF the above option.