The rule about not needing a TRV only really applies if the sole purpose of your trip was to visit the US and return directly from the US. If you left Canada for another country and came back via the US the rule does not apply.
If you’re from a visa-required country
You’ll need a valid visa and a valid work permit to return to Canada to work. You don’t need a valid visa if you return directly from a visit only to the United States or St. Pierre and Miquelon. You must re-apply for a visitor visa if your visa:
has expired or
was only valid for a single entry to Canada
I guess your next question will be how will they know and the answer might be do you want to misrepresent yourself at the border by stating that you only visited the US from Canada and are returning directly, do you want to take that risk, is up to you ?