A Canadian man who got almost $1 billion worth of contracts to rebuild the World Trade Center and its transportation hub was accused by federal prosecutors Thursday of defrauding the Port Authority into thinking that his firm was qualified as a minority-owned enterprise.