When you say smaller do you mean , 5 foot tall, 5foot6, 6 foot? If you're shorter than 5 foot 8 i'd go the 165mm.
I'm bang on 6 foot tall and run 165 cranks on the DH bike for ground clearance and better stance (feels better having feet closer together when cranks are flat) and 175mm on...