my personal opinion is that if the child is too young, their brains might not be developed enough or exposed to concepts that allow them to understand abstract concepts
My opinion is based more on motivation rather than 'ability'. People can learn amazing things when they are motivated: but it's very easy to turn a fun subject into unfun. Look at what high school does to Math.