Open carry isn't allowed. The permit allows you to carry a CONCEALED weapon.
MS statute states....
§ 45-9-101. License to carry concealed pistol or revolver.
The Department of Public Safety is authorized to issue licenses to carry concealed pistols or revolvers to persons qualified as provided in this section. Such licenses shall be valid throughout the state for a period of four (4) years from the date of issuance. Any person possessing a valid license issued pursuant to this section may carry a concealed pistol or concealed revolver.
(b) The licensee must carry the license, together with valid identification, at all times in which the licensee is carrying a concealed pistol or revolver and must display both the license and proper identification upon demand by a law enforcement officer. A violation of the provisions of this paragraph (b) shall constitute a noncriminal violation with a penalty of Twenty-five Dollars ($25.00) and shall be enforceable by summons.