how to roll back all inserted records if any record has error

SQL Server SET XACT_ABORT controls the atomicity of any user defined transaction.