If the checkvalve in the pump is working about 1/4 to 1/2 quart is ok. After you shut the engine off there is still oil in the top end and in the oil galleries that will run down into the sump. It is normal for oil to leak out of the tank after sitting for extended times...weeks or months. After new check valve seals they normally dont leak down any oil unless it sits for many months, they all will leak down after long periods even with new parts. If the tank runs dry in a week you have problems....couple weeks, probably still a problem, month or more then it just becomes a pain to deal with it. If the tank runs completely dry drain the engine and fill the sump before cranking. If the tank is dry and you start it to pump the oil back to the tank you will have no oil to the engine for quite a few seconds, you will cause excessive wear guaranteed. People say they have done it and never had an issue but they are causing damage, you cant run an engine without oil and not cause damage even if its for 10 or 15 seconds.