Mostly Raw Raspberry and Macadamia White Chocolate Slice I think many people assume you can't have white chocolate if you are plant based or avoiding dairy because it is made up of a lot of milk. However the white chocolate taste comes predominantly from the cacao butter, which is the fatty part of the cacao seed.