You couldn't use it at ports of entry and couldn't travel on it, possibly with the exception of domestic flights. It couldn't be used to rent a car, get a loan, or do anything else (but you could pay a check). Yes, someone could pose as you, but for what purpose and advantage? The worst-case scenario adds up to the expense and hassle of having to replace it.