Don’t take this the wrong way, but one could argue that maybe you should use something other than PIGPIO (if thats possible) or a different IR solution.
I’m thinking the use of any DAC for sound is going to have the same problem, they all use i2s, as far as I know anyway.
I used an older version of this with my Pirate Radio / pHat Beat (DAC).
I should mention that although I did get it working, it would sometimes just stop working. I never did sort out why? More than likely an error in my code.