Difference is pedophiles actively prey on and harm other people. We should endeavor to stop said predatory behavior when it comes to ways (like the overexposure of gay shit to children in the school system) but two consenting adults fucking doesn't hurt anybody but themselves.