After some fiddling, it works!
Now I have a pretty stupid problem. The old hand-me-down TV I have (RCA model L26HD31R) is stuck on the wrong resolution and I need a remote with a specific button called "format" to fix it.
The cheapest remote I can find online with this button is 40 CAD!!