I have found that the most important layer for riding in cooler weather is an outer shell that blocks the wind. Nylon overmitts, Nylon over jacket with a high neck (fleece neck gaitor underneath). Textile riding pants. If you keep the wind & moisture on the outside you don't need too many layers underneath.