Interconnected

Looking for Madam Tetrachromat [via slashdot]. Wow. Which touches on something that really bugs me: When you see something yellow, how do you know whether it's yellow photons, or a mix of red photons and green ones?