Robust Knowledge Requires both Consensus and Disagreement