You might want to try the Scroll pHAT HD development branch to see how well it works with that ;)
You can grab and install it by running:
git clone http://github.com/pimoroni/scroll-phat-hd -b devel scroll-phat-hd-devel
cd scroll-phat-hd-devel/library
sudo python ./setup.py install
See: https://github.com/pimoroni/scroll-phat-hd/pull/14 for the list of changes/fixes.