Do Not Lean on Your Own Understanding