Gatorbait,
No, you should not be acting in the capacity as a duty agent. Your supervisor (BIB chief, Superintendent, Detco) should not have you as the primary responder to an incident. Refer to 71-113 if you need some clarification (the newest one). Let me know if you have any questions.