Unfortunately not, it takes a couple of minutes of the stove on before it starts to smell, and he didn't stick around that long.
If all else fails and you want someone to look into gas leaks asap for free...
a) calm your gas company. They should have a 24 hr 1800gasleak number.
They will come down with a sensor and check everything out.
b) if you want to get more aggressive, call 911. The fire dept will be glad to pull up with their equipment and check everything out.