Yes, the "Invoice fields" area in the control panel can be used for this purpose.
To place a department, PO number or similar on your invoice, the invoice field can easily be used.
It can also be used to edit the contact on the invoice.
This can be included or edited under Shipping and Payment > Invoice Fields: