What makes your opinion correct, and the next person's wrong? What makes this or that society more correct, and the standard for our perception of history? Why should history guide us on this point? Is this weight equally applied to all things?
When there is no absolute standard, those questions will always legitimately be around to undermine any person's morality.