Anxiety speeds up your digestive tract, which can alter the amount of nutrients you absorb. This could turn it yellow, in many cases.
In most cases, it comes down to diet and lack of nutrients in general.
If you're seriously worried, I would suggest talking with your general practitioner.