One issue to address is that when you talk about "aluminium" you're really talking about an aluminium alloy. And each alloy will have different properties to another alloy. Some will have higher strength, for example, but perhaps be more brittle. Likewise, CFRP is actually a group of materials each with its own properties both in terms of the fibres themselves but also how they're laid.
Also, the materials aren't used alone. CFRP might have a nomex or aluminium alloy honeycomb core, for example. Likewise, aluminium F1 cars would have had cores in the panels too. Most likely aluminium in that case.