A California man was charged with filing false tax returns with the Internal Revenue Service, the Justice Department announced Thursday.