If the fretboard is maple (light colored wood), it may have a lacquer-like finish on it. If so, a wet (very damp) rag will do.
For anything else, you'll be able to feel the grain of the wood. For that, you can also try a wet rag and maybe add an old toothbrush for scrubbing. If it's REALLY bad...