There are lots of reasons to walk away from an assignment or a stock sale. Bob Krist outlines a stock deal to stay away from (Frommer's) here. Personally I just walked away from an assignment that I really wanted to do because the Director of Photography wouldn't sign and return my estimate but still wanted me to front the travel expenses. Something else came up so I took the other job.
But how does a photographer know when to turn something down?