I have seen numerous debates about the singularity hinge on the question of whether machines could ever become conscious. Specifically, one side takes the position that the singularity will never happen because we will never be able to create conscious machines to make it happen. That position conflates intelligence and consciousness, I believe erroneously. First, let me point out that the success of a singularity, fueled by superhuman AI, does not depend on whether the AI is conscious or not. It only depends on intelligence, and it seems very likely that a machine could have intelligence without consciousness.
Understanding and generating consciousness is a much harder problem than generating intelligence. For one thing, there are ready ways to measure intelligence. Continue reading