If you are not using accounting to enter invoices then make sure the POs are getting closed through receiving or PO-K.  However, there was a problem with AP-A that has been fixed in IS Tech Updates that related to the AP-A screen pointing to the wrong record and not allowing you to delete a vendor that you should be able to.  So you should look into subscribing to the IS Tech DBA updates so you can get the fix.