Turns out buildx needs its own proxy settings—otherwise it won't use Docker's proxy.