If the Government buys (imports) more than it sells (exports) there will be a trade deficit which will require financing. The main source of financing could be debt. This Government would once again go into the market and borrow and cause an upward pressure on funds available for lending.
This causes the interest rates to go up. If there was a favourable balance of trade the Government could not borrow and the interest rates could remain relatively stable.