Jersey cap with fleece lining