It depends on whether you are discussing at the image as a whole, or only parts of the image.
For instance, if you have a backlit model at the beach, the pixels over the model may be exposed exactly a desired, yet the background pixels may be blown out.
One can also look at only the pixels behind green Bayer Pattern pixels. One could even limit the discussion to only pixels on the left or right side of the image.
So yes, depending on the context of the discussion, one might talk about the image as a whole, or separate out the discussion by classes of pixel.
Dividing the pixels by the corresponding Bayer Pattern color does make sense. As these are usually processed with different parameters (for instance the White Balance setting will affect the relative processing of the different color classes of pixels).