So the default color encoding for matplotlib appears to be RGB where the rgb values are floats in the range [0,1], you can pass in larger values, 20,0,0 still makes red, while 255,0,0 makes black. (Which I don't understand.)

The color model being used previously looks to be some version of HSV so I may need some mapping layer to fix this...