It probably is leaking when it's running too but it burns off on hot exhaust or something. You need to pressure test the system to follow the leak back to it's source to determine what is leaking.
Here's what the pressure tester llooks like. You may be able to borrow one from the local parts chain store.
Images available only to Customers.
If I was helpful, please click the ACCEPT
button.