Yes, if you violate a service agreement (other than for reasons beyond your control and which must be accepted by your agency), you will have incurred a debt due to the Government and you must reimburse all costs that your agency has paid towards your relocation expenses including withholding tax allowance (WTA) and relocation income tax (RIT) allowance.
41 C.F.R. §302-2.15