The Team Chat tab allows you to set the maximum number of Customer Chat windows an agent can have open at the same time.
Max Concurrent Chat Sessions – Use the drop down menu to select a value between 1 and 10 and click Update.
...
Note: Always click Update, located in the upper top right corner to save your changes. This will apply each team setting to all the agents within the team (excluding security settings).