Newborn 4 days old screams only during diaper change?

Hello, my boy is 4 days old and he is very docile, except when he gets his diaper changed. the only thing that calms him down is sucking on my pinkie finger. i'm not sure if this is a good or bad idea this early. there seems to be mixed ideas on pacifiers, especially this early so i don't wan to consider that. thanks.