Patterned jersey cap with fleece lining