Well, the max of Acetaminophen is 4000mg (1000 mg 4 times a day)
Ibuprofen you want <1200 mg per day (so depends on your pill size).
Dextromethorphan you want < 120mg per day.
Dayquil has acetaminophen, Phenylephrine and Dextromethorphan.
Nyquil has acetaminophn, dextromethorphan, and doxalamine succinate
So look at the amounts in your nyquil/dayquil and figure out if you're close to that.
If you're worried, take just benadryl (diphenhydramine), which does the same thing as the doxalamine succinate in nyquil but doesn't have the acetaminophen and dextromethorphan in it.
But it sounds like you're ok.